00000100:00100000:0.0:1746126593.692352:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3296:x1830945721112960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (398us total) trans 17179872815 rc 0/0 00000100:00100000:0.0:1746126593.692361:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11872 00000100:00100000:0.0:1746126593.692369:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11873 00000100:00100000:0.0:1746126593.692372:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721113472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126593.692441:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3296:x1830945721113472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (454us total) trans 17179872816 rc 0/0 00000100:00100000:0.0:1746126593.692446:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11873 00000004:00080000:0.0:1746126593.692468:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d91aa00/2, rc 0, transno 17179872815 00000100:00100000:0.0:1746126593.692471:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721112960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126593.692477:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d918380/2, rc 0, transno 17179872816 00000100:00100000:0.0:1746126593.692480:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721113472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126593.692485:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e2300/2, rc 0, transno 17179872813 00000100:00100000:0.0:1746126593.692487:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721112832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126593.692493:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d919880/2, rc 0, transno 17179872814 00000100:00100000:0.0:1746126593.692495:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721113344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126593.695063:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721113856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126593.695090:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126593.695118:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721114368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126593.695131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126593.695145:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126593.695149:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721113984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126593.695161:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126593.695171:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721114496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126593.695181:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126593.695207:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721113856 00000100:00100000:0.0:1746126593.695210:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721113856 00000100:00100000:0.0:1746126593.695237:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721114368 00000100:00100000:0.0:1746126593.695239:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721114368 00000100:00100000:0.0:1746126593.695246:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721113984 00000100:00100000:0.0:1746126593.695248:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721113984 00000100:00100000:0.0:1746126593.695255:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721114496 00000100:00100000:0.0:1746126593.695257:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721114496 00000100:00100000:0.0:1746126593.695264:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11882 00000100:00100000:0.0:1746126593.695268:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721113856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126593.695350:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126593.695353:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126593 -> 1746126593 00002000:00010000:0.0:1746126593.695354:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126593 -> 1746126593 00002000:00010000:0.0:1746126593.695356:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126593 -> 1746126593 00002000:00010000:0.0:1746126593.695357:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126593.695379:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721113856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (289us total) trans 21474839998 rc 0/0 00000100:00100000:0.0:1746126593.695383:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11882 00000100:00100000:0.0:1746126593.695392:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11883 00000100:00100000:0.0:1746126593.695396:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721114368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126593.695465:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721114368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (331us total) trans 21474839999 rc 0/0 00000100:00100000:0.0:1746126593.695470:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11883 00000100:00100000:0.0:1746126593.695478:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11884 00000100:00100000:0.0:1746126593.695481:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721113984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126593.696615:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721113984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (389us total) trans 21474840000 rc 0/0 00000100:00100000:0.0:1746126593.696629:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11884 00000100:00100000:0.0:1746126593.697865:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720835456 00000100:00100000:0.0:1746126593.697870:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720835456 00000100:00100000:0.0:1746126593.697894:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8563 00000100:00100000:0.0:1746126593.697899:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:30563:x1830945720835456:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126593.697914:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.697928:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e82586760f992 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b804 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.697969:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e82586760f992 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b804 expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.697979:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e82586760f992 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b804 expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.697993:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126593.697996:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126593.697998:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d4e800, rc 0) 00000100:00100000:0.0:1746126593.698028:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:30563:x1830945720835456:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 129us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.698033:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8563 00000100:00100000:0.0:1746126593.728656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.756955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.758500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.762657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.763316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.763337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.767567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.795159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.809462:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720837888 00000100:00100000:0.0:1746126593.809469:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720837888 00000100:00100000:0.0:1746126593.809503:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8569 00000100:00100000:0.0:1746126593.809510:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:30576:x1830945720837888:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126593.809527:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.809542:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1eba00/0xb50e82586760fa2c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b83c expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.809586:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1eba00/0xb50e82586760fa2c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b83c expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.809596:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1eba00/0xb50e82586760fa2c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b83c expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.809606:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126593.809609:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126593.809611:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1eba00/0xb50e82586760fa2c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b83c expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.809617:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1eba00, rc 0) 00000100:00100000:0.0:1746126593.810079:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30576:x1830945720837888:12345-192.168.203.2@tcp:101:cat.0 Request processed in 568us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.810085:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8569 00000100:00100000:0.0:1746126593.829801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.833117:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720838144 00000100:00100000:0.0:1746126593.833122:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720838144 00000100:00100000:0.0:1746126593.833296:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8570 00000100:00100000:0.0:1746126593.833404:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:30574:x1830945720838144:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126593.833412:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.833420:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1ebc00/0xb50e82586760fa3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b843 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.833441:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1ebc00/0xb50e82586760fa3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b843 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.833449:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1ebc00/0xb50e82586760fa3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b843 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.833458:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126593.833460:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126593.833462:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1ebc00, rc 0) 00000100:00100000:0.0:1746126593.833478:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30574:x1830945720838144:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 176us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.833483:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8570 00000100:00100000:0.0:1746126593.839553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.839697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.841474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.841498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842551:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.842631:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720838784 00000100:00100000:0.0:1746126593.842634:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720838784 00000100:00100000:0.0:1746126593.842650:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720838912 00000100:00100000:0.0:1746126593.842652:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720838912 00000100:00100000:0.0:1746126593.842657:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720839040 00000100:00100000:0.0:1746126593.842659:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720839040 00000100:00100000:0.0:1746126593.842664:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720839168 00000100:00100000:0.0:1746126593.842665:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720839168 00000100:00100000:0.0:1746126593.842671:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720839296 00000100:00100000:0.0:1746126593.842672:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720839296 00000100:00100000:0.0:1746126593.842678:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720839552 00000100:00100000:0.0:1746126593.842679:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720839552 00000100:00100000:0.0:1746126593.842688:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11906 00000100:00100000:0.0:1746126593.842692:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945720838528:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126593.842700:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.842708:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9e00/0xb50e82586760fa48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b858 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.842719:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.842720:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.842725:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9e00/0xb50e82586760fa48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b858 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.842735:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9e00/0xb50e82586760fa48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b858 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.842741:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c9e00, rc 0) 00000100:00100000:0.0:1746126593.842758:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945720838528:12345-192.168.203.2@tcp:101:cat.0 Request processed in 65us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.843979:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11906 00000100:00100000:0.0:1746126593.844006:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11909 00000100:00100000:0.0:1746126593.844013:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945720839040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126593.844021:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.844029:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8e00/0xb50e82586760fa56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b86d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.844042:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844043:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844048:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8e00/0xb50e82586760fa56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b86d expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844056:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8e00/0xb50e82586760fa56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b86d expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844063:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8e00, rc 0) 00000100:00100000:0.0:1746126593.844082:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945720839040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 71us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.844087:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11909 00000100:00100000:0.0:1746126593.844098:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11910 00000100:00100000:0.0:1746126593.844103:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945720839168:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126593.844108:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.844113:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009360aa00/0xb50e82586760fa64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b874 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.844122:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844134:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009360aa00/0xb50e82586760fa64 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b874 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844140:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009360aa00/0xb50e82586760fa64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b874 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844152:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009360aa00, rc 0) 00000100:00100000:0.0:1746126593.844167:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945720839168:12345-192.168.203.2@tcp:101:cat.0 Request processed in 65us (1637us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126593.844172:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11910 00000100:00100000:0.0:1746126593.844183:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11911 00000100:00100000:0.0:1746126593.844188:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945720839296:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126593.844193:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.844199:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b87b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.844208:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844210:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844224:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b87b expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844232:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b87b expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844239:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d941000, rc 0) 00000100:00100000:0.0:1746126593.844251:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945720839296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 63us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.844263:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11911 00000100:00100000:0.0:1746126593.844272:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11912 00000100:00100000:0.0:1746126593.844277:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:30574:x1830945720839552:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126593.844283:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.844288:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d941800/0xb50e82586760fa72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b882 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.844300:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098dfde00/0xb50e82586760f937 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b7ef expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844306:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8e00/0xb50e82586760fa56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b86d expref: 24 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844311:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844312:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.844315:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d941800/0xb50e82586760fa72 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1974272->2097151] (req 1974272->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b882 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.844335:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8e00/0xb50e82586760fa56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b86d expref: 24 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844343:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8e00/0xb50e82586760fa56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b86d expref: 24 pid: 8438 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746126593.844352:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721117440:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126593.844395:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098dfde00/0xb50e82586760f937 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b7ef expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126593.844408:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098dfde00/0xb50e82586760f937 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b7ef expref: 10 pid: 4640 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746126593.844416:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e644380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721117568:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126593.844435:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126593.845996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.855358:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721117440:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126593.855365:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e644380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721117568:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126593.855384:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d941800/0xb50e82586760fa72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1974272->2097151] (req 1974272->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b882 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.855397:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d941800, rc 0) 00000100:00100000:0.0:1746126593.855411:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:30574:x1830945720839552:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11134us (12848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.855417:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11912 00000100:00100000:0.0:1746126593.857742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.857948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.861474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.863987:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720840576 00000100:00100000:0.0:1746126593.863993:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720840576 00000100:00100000:0.0:1746126593.864028:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720840960 00000100:00100000:0.0:1746126593.864031:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720840960 00000100:00100000:0.0:1746126593.864047:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11913 00000100:00100000:0.0:1746126593.864053:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:30576:x1830945720840576:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126593.864074:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.864089:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800997f6400/0xb50e82586760fa79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b889 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864114:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.864116:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126593.864122:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800997f6400/0xb50e82586760fa79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b889 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864135:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800997f6400/0xb50e82586760fa79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b889 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864147:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997f6400, rc 0) 00000100:00100000:0.0:1746126593.864177:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:30576:x1830945720840576:12345-192.168.203.2@tcp:101:cat.0 Request processed in 124us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.864183:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11913 00000100:00100000:0.0:1746126593.864195:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11914 00000100:00100000:0.0:1746126593.864200:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:30574:x1830945720840960:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126593.864206:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126593.864226:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997f7e00/0xb50e82586760fa80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b890 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864241:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009360b600/0xb50e82586760fa41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b851 expref: 22 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864247:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126593.864248:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126593.864255:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997f7e00/0xb50e82586760fa80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b890 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864277:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009360b600/0xb50e82586760fa41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->2953215) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b851 expref: 22 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.864286:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009360b600/0xb50e82586760fa41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->2953215) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b851 expref: 22 pid: 9686 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746126593.864297:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721117952:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126593.864343:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126593.864888:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720841216 00000100:00100000:0.0:1746126593.864891:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720841216 00002000:00100000:0.0:1746126593.864911:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009b2fea00 x1830945720841216/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:354/0 lens 488/0 e 0 to 0 dl 1746126604 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126593.864918:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fea00 with x1830945720841216 ext(0->1048575) 00002000:00010000:0.0:1746126593.864922:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fea00 00000100:00100000:0.0:1746126593.865539:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6939 00000100:00100000:0.0:1746126593.865545:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945720841216:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126593.870820:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720841600 00000100:00100000:0.0:1746126593.870824:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720841600 00000100:00100000:0.0:1746126593.870867:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3546 00000100:00100000:0.0:1746126593.870873:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+222:30571:x1830945720841600:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126593.871017:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:30571:x1830945720841600:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 144us (4462us total) trans 8589942689 rc 0/0 00000100:00100000:0.0:1746126593.871022:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3546 00000100:00100000:0.0:1746126593.871062:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721117952:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126593.871081:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997f7e00/0xb50e82586760fa80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b890 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126593.871093:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997f7e00, rc 0) 00000100:00100000:0.0:1746126593.871107:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:30574:x1830945720840960:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6908us (7517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126593.871113:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11914 00000100:00100000:0.0:1746126593.872648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.872687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.882778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.894478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.899921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.907933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.909089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.913930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.922370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.928465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.928499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.928629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.928644:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720845056 00000100:00100000:0.0:1746126593.928647:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720845056 00002000:00100000:0.0:1746126593.928662:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008f1e1180 x1830945720845056/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:354/0 lens 488/0 e 0 to 0 dl 1746126604 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126593.928670:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1180 with x1830945720845056 ext(3145728->4194303) 00002000:00010000:0.0:1746126593.928673:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e1180 00000100:00100000:0.0:1746126593.956658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.957735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.967661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.967769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126593.993067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.008338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.019746:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720846720 00000100:00100000:0.0:1746126594.019749:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720846720 00002000:00100000:0.0:1746126594.019761:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e805180 x1830945720846720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:355/0 lens 488/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.019768:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805180 with x1830945720846720 ext(2097152->3145727) 00002000:00010000:0.0:1746126594.019771:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e805180 00000100:00100000:0.0:1746126594.019798:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6952 00000100:00100000:0.0:1746126594.019803:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945720846720:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126594.028915:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945720846720:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9105us (9244us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126594.028924:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6952 00002000:00100000:0.0:1746126594.028933:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e805180 x1830945720846720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:355/0 lens 488/440 e 0 to 0 dl 1746126605 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.028940:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805180 with x1830945720846720 ext(2097152->3145727) 00002000:00010000:0.0:1746126594.028945:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e805180 00000100:00100000:0.0:1746126594.047967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.067867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.107260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.117765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.125939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.130328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.132087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.133746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.148950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.164875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.181934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.192822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.204369:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720850048 00000100:00100000:0.0:1746126594.204377:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720850048 00002000:00100000:0.0:1746126594.204414:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880099250380 x1830945720850048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:355/0 lens 504/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.204423:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250380 with x1830945720850048 ext(1048576->2097151) 00002000:00010000:0.0:1746126594.204428:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099250380 00000100:00100000:0.0:1746126594.204445:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6959 00000100:00100000:0.0:1746126594.204451:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945720850048:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126594.205558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.207983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.210759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.213447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.214395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.214406:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720850688 00000100:00100000:0.0:1746126594.214408:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720850688 00010000:00010000:0.0:1746126594.214421:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b87b expref: 28 pid: 8438 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.214435:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6225 00000100:00100000:0.0:1746126594.214440:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945720850688:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.214445:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.214459:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b87b expref: 28 pid: 8438 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.214466:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b87b expref: 28 pid: 8438 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.214476:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e82586760fa6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b87b expref: 28 pid: 8438 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.214488:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126594.214505:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945720850688:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.214510:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6225 00000100:00100000:0.0:1746126594.217567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.219324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.222403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.222472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.228589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.232992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.241028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.241183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.248453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.248537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.251221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.255954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.263985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.281114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.281170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.286868:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.286894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.286921:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720854272 00000100:00100000:0.0:1746126594.286925:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720854272 00002000:00100000:0.0:1746126594.286957:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012cb3ca80 x1830945720854272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.286966:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cb3ca80 with x1830945720854272 ext(2097152->3145727) 00002000:00010000:0.0:1746126594.286971:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cb3ca80 00000100:00100000:0.0:1746126594.286987:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720854016 00000100:00100000:0.0:1746126594.286989:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720854016 00002000:00100000:0.0:1746126594.287002:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4308991) req@ffff88012cb3e680 x1830945720854016/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.287009:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cb3e680 with x1830945720854016 ext(4194304->4308991) 00010000:00010000:0.0:1746126594.287016:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e82586760fb28 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8f2 expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.287027:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e82586760fb28 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8f2 expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746126594.287032:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cb3e680 00000100:00100000:0.0:1746126594.287044:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1569 00000100:00100000:0.0:1746126594.287048:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945720854016:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126594.290278:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945720854016:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3226us (3380us total) trans 21474840014 rc 0/0 00000100:00100000:0.0:1746126594.290288:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1569 00002000:00100000:0.0:1746126594.290298:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4308991) req@ffff88012cb3e680 x1830945720854016/t21474840014(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/448 e 0 to 0 dl 1746126605 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.290312:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cb3e680 with x1830945720854016 ext(4194304->4308991) 00010000:00010000:0.0:1746126594.290322:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e82586760fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8f2 expref: 22 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.290333:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e82586760fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4308991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8f2 expref: 22 pid: 4641 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746126594.290339:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cb3e680 00000100:00100000:0.0:1746126594.290742:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721121024:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.290751:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721121152:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.290780:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013489e600/0xb50e82586760fb44 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126594.293088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.293129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126594.294103:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013489e600/0xb50e82586760fb44 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126594.294112:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013489e600/0xb50e82586760fb44 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126594.294139:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126594.295755:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013489e200/0xb50e82586760fb3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b907 expref: 230 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.295784:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013489e600/0xb50e82586760fb44 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b907 expref: 229 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.295803:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126594.295806:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126594.295808:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013489e600, rc 0) 00000100:00100000:0.0:1746126594.295857:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+229:30595:x1830945720853888:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8935us (9252us total) trans 8589942697 rc 0/0 00000100:00100000:0.0:1746126594.295863:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8575 00000100:00100000:0.0:1746126594.298084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.307496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.311376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.311426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.313079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.313106:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720855808 00000100:00100000:0.0:1746126594.313112:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720855808 00002000:00100000:0.0:1746126594.313141:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008f254380 x1830945720855808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.313151:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254380 with x1830945720855808 ext(3145728->4194303) 00002000:00010000:0.0:1746126594.313155:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254380 00000100:00100000:0.0:1746126594.313177:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6967 00000100:00100000:0.0:1746126594.313185:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945720855808:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126594.314380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.342756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.352676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.377893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.388513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.393423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.395045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.398792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.444360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.450819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.453360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.453400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.456690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.462559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.470155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.470195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.475476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.478260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.494952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.499750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.505537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.511168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.514746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.522909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.526147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.531666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.534925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.538415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.538466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.538505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.547012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.551197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.553502:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720861952 00000100:00100000:0.0:1746126594.553509:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720861952 00000100:00100000:0.0:1746126594.554057:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11943 00000100:00100000:0.0:1746126594.554072:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945720862208:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126594.554092:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554103:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec02800/0xb50e82586760fb91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b931 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554109:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126594.554111:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126594.554113:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554127:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec02800/0xb50e82586760fb91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b931 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554136:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec02800/0xb50e82586760fb91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b931 expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.554144:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721124736:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.554167:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.554247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.554302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.554359:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720862336 00000100:00100000:0.0:1746126594.554363:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720862336 00000100:00100000:0.0:1746126594.554378:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720862464 00000100:00100000:0.0:1746126594.554380:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720862464 00000100:00100000:0.0:1746126594.554391:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11944 00000100:00100000:0.0:1746126594.554396:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945720862336:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126594.554416:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e84e00/0xb50e82586760fc39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554426:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c0400/0xb50e82586760fb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2387968->3100671) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b923 expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554431:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126594.554433:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126594.554434:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e84e00/0xb50e82586760fc39 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554449:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57c0400/0xb50e82586760fb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2387968->3100671) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b923 expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554456:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57c0400/0xb50e82586760fb83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2387968->3100671) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b923 expref: 26 pid: 4641 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.554464:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721124864:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.554486:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.554500:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11945 00000100:00100000:0.0:1746126594.554505:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945720862464:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126594.554521:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554531:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554547:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fe00/0xb50e82586760fbc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b954 expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.554554:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbcb600/0xb50e82586760fb36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b900 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554559:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.554560:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.554562:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554575:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbcb600/0xb50e82586760fb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b900 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554582:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbcb600/0xb50e82586760fb36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b900 expref: 19 pid: 4641 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.554589:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721124992:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.554613:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16fe00/0xb50e82586760fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b954 expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.554621:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f16fe00/0xb50e82586760fbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b954 expref: 13 pid: 20294 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.554628:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721125120:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.554655:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.554661:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.554667:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721125248:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.554677:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.569358:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720863104 00000100:00100000:0.0:1746126594.569364:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720863104 00010000:00010000:0.0:1746126594.569377:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013091c600/0xb50e82586760fa4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b85f expref: 27 pid: 10890 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.569390:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720862976 00000100:00100000:0.0:1746126594.569392:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720862976 00010000:00010000:0.0:1746126594.569399:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98200/0xb50e82586760fa25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b835 expref: 20 pid: 8437 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.569410:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6245 00000100:00100000:0.0:1746126594.569415:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945720862592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.569428:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.569448:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c5a800/0xb50e82586760f9df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b819 expref: 21 pid: 4642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.569457:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c5a800/0xb50e82586760f9df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b819 expref: 21 pid: 4642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.569497:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c5a800/0xb50e82586760f9df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b819 expref: 21 pid: 4642 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.569516:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126594.569558:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945720862592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 142us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.570839:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6245 00000100:00100000:0.0:1746126594.570886:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721124864:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.570899:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e84e00/0xb50e82586760fc39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.570919:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721124736:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.570928:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.570966:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720863360 00000100:00100000:0.0:1746126594.570970:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720863360 00002000:00100000:0.0:1746126594.570998:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1531904->2097151) req@ffff8800930f8000 x1830945720863360/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.571007:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930f8000 with x1830945720863360 ext(1531904->2097151) 00010000:00010000:0.0:1746126594.571012:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ec02a00/0xb50e82586760fb8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b92a expref: 19 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.571020:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ec02a00/0xb50e82586760fb8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b92a expref: 19 pid: 4641 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746126594.571032:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930f8000 00000100:00100000:0.0:1746126594.571057:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720863488 00000100:00100000:0.0:1746126594.571060:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720863488 00002000:00100000:0.0:1746126594.571074:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1114111) req@ffff8800930f8380 x1830945720863488/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/0 e 0 to 0 dl 1746126605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.571080:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930f8380 with x1830945720863488 ext(1048576->1114111) 00010000:00010000:0.0:1746126594.571084:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec02800/0xb50e82586760fb91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b931 expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.572802:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec02800/0xb50e82586760fb91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b931 expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746126594.572809:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930f8380 00000100:00100000:0.0:1746126594.572848:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1570 00000100:00100000:0.0:1746126594.572858:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945720863360:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126594.573387:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721124992:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.573397:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721125120:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.573404:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721125248:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.573426:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.573461:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1571 00000100:00100000:0.0:1746126594.573467:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945720863488:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126594.581973:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720864000 00000100:00100000:0.0:1746126594.582017:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720864000 00010000:00010000:0.0:1746126594.582035:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.582053:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6253 00000100:00100000:0.0:1746126594.582058:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945720864000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.582065:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.582074:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.582081:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.582093:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e82586760fb21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b8eb expref: 26 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.582112:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.582114:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.582118:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582126:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582144:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126594.582175:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945720864000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 117us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.582189:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6253 00010000:00010000:0.0:1746126594.582220:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582228:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582247:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582255:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582261:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582267:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e84c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126594.582270:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582277:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582286:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.582292:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e84c00/0xb50e82586760fc40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.582335:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945720862464:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 27829us (28032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.582342:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11945 00000100:00100000:0.0:1746126594.606579:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945720863360:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 33721us (35968us total) trans 17179872831 rc 0/0 00000100:00100000:0.0:1746126594.606587:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1570 00002000:00100000:0.0:1746126594.606592:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1531904->2097151) req@ffff8800930f8000 x1830945720863360/t17179872831(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:355/0 lens 488/448 e 0 to 0 dl 1746126605 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126594.606601:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930f8000 with x1830945720863360 ext(1531904->2097151) 00010000:00010000:0.0:1746126594.606608:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ec02a00/0xb50e82586760fb8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b92a expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.606617:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ec02a00/0xb50e82586760fb8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b92a expref: 20 pid: 4641 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746126594.606623:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930f8000 00000100:00100000:0.0:1746126594.611809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.611923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126594.614478:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614485:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614503:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614516:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614522:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614527:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e84200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126594.614529:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614536:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614545:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614551:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e84200/0xb50e82586760fc32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.614588:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945720862208:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 60517us (61147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.614595:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11943 00010000:00010000:0.0:1746126594.614629:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614635:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614650:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614656:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614662:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614666:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009af8cc00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126594.614669:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614674:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614682:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.614688:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af8cc00/0xb50e82586760fc2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.614721:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945720862080:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 60869us (61316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.614726:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11942 00000100:00100000:0.0:1746126594.618937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.624779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.631174:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721125376:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.631255:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720864768 00000100:00100000:0.0:1746126594.631261:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720864768 00010000:00010000:0.0:1746126594.631290:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb57400/0xb50e82586760fb75 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b91c expref: 14 pid: 20362 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.631318:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6257 00000100:00100000:0.0:1746126594.631324:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:1964:x1830945720865152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.631336:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.631341:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099079800/0xb50e82586760fa10 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b820 expref: 229 pid: 15560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.631349:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099079800/0xb50e82586760fa10 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b820 expref: 229 pid: 15560 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.631368:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126594.631373:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec02200/0xb50e82586760fc47 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126594.631380:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126594.631411:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:1964:x1830945720865152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 87us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.631416:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6257 00000100:00100000:0.0:1746126594.631446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.631867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.637079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.673633:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721125888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.673690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673734:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721126400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.673751:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673764:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721126912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.673780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673796:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721127424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.673812:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673824:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746126594.673844:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721126272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.673861:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673872:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721126784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.673885:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673896:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721127296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.673908:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673915:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721127808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.673928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673942:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721126016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.673957:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673963:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721126656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.673983:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.673993:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721127040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.674007:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.674013:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721127552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.674025:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.674049:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721126016 00000100:00100000:0.0:1746126594.674052:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721126016 00000100:00100000:0.0:1746126594.674064:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721127552 00000100:00100000:0.0:1746126594.674066:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721127552 00000100:00100000:0.0:1746126594.674079:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11948 00000100:00100000:0.0:1746126594.674083:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830945721126400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126594.674179:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126594.674760:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126594.674764:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126594.674766:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126594.674768:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126594.674791:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830945721126400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 707us (1038us total) trans 17179872834 rc 0/0 00000100:00100000:0.0:1746126594.674797:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11948 00000100:00100000:0.0:1746126594.674814:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11954 00000100:00100000:0.0:1746126594.674819:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3295:x1830945721127808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.674921:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3295:x1830945721127808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (991us total) trans 21474840020 rc 0/0 00000100:00100000:0.0:1746126594.674926:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11954 00000100:00100000:0.0:1746126594.674935:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11956 00000100:00100000:0.0:1746126594.674939:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3296:x1830945721126656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.675011:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3296:x1830945721126656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1026us total) trans 17179872837 rc 0/0 00000100:00100000:0.0:1746126594.675016:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11956 00000100:00100000:0.0:1746126594.675025:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11958 00000100:00100000:0.0:1746126594.675029:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3296:x1830945721127552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.675115:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3296:x1830945721127552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1089us total) trans 21474840021 rc 0/0 00000100:00100000:0.0:1746126594.675120:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11958 00000100:00100000:0.0:1746126594.676019:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721127936 00000100:00100000:0.0:1746126594.676024:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721127936 00000100:00100000:0.0:1746126594.676043:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11959 00000100:00100000:0.0:1746126594.676047:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721127936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.676199:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3294:x1830945721127936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (1044us total) trans 17179872839 rc 0/0 00000100:00100000:0.0:1746126594.676204:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11959 00000100:00100000:0.0:1746126594.676293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.676317:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721126528 00000100:00100000:0.0:1746126594.676320:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721126528 00000100:00100000:0.0:1746126594.676644:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721127168 00000100:00100000:0.0:1746126594.676647:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721127168 00000100:00100000:0.0:1746126594.676663:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721127680 00000100:00100000:0.0:1746126594.676665:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721127680 00000100:00100000:0.0:1746126594.676674:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11960 00000100:00100000:0.0:1746126594.676678:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3297:x1830945721126528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.676769:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3297:x1830945721126528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (484us total) trans 21474840022 rc 0/0 00000100:00100000:0.0:1746126594.676774:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11960 00000100:00100000:0.0:1746126594.676782:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11961 00000100:00100000:0.0:1746126594.676785:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3297:x1830945721127168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.676988:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3297:x1830945721127168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (661us total) trans 21474840023 rc 0/0 00000100:00100000:0.0:1746126594.676993:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11961 00000100:00100000:0.0:1746126594.677007:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11962 00000100:00100000:0.0:1746126594.677010:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3297:x1830945721127680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.677079:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3297:x1830945721127680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (726us total) trans 21474840024 rc 0/0 00000100:00100000:0.0:1746126594.677083:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11962 00000100:00100000:0.0:1746126594.691652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.691676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.692505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.692779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.693594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.693630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.693647:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720865920 00000100:00100000:0.0:1746126594.693651:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720865920 00000100:00100000:0.0:1746126594.693668:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720866176 00000100:00100000:0.0:1746126594.693669:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720866176 00000100:00100000:0.0:1746126594.693679:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720866432 00000100:00100000:0.0:1746126594.693681:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720866432 00000100:00100000:0.0:1746126594.693691:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11966 00000100:00100000:0.0:1746126594.693696:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945720865920:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126594.693702:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126594.693710:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800937c9a00/0xb50e82586760fc71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b99a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126594.693723:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c701, atime: 0x6813c701, ctime: 0x6813c701, blocks: 0x81f 00010000:00010000:0.0:1746126594.693730:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.693732:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.693736:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c9a00/0xb50e82586760fc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b99a expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.693759:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800937c9a00/0xb50e82586760fc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b99a expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.693765:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c9a00, rc 0) 00000100:00100000:0.0:1746126594.693794:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945720865920:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 97us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.693799:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11966 00000100:00100000:0.0:1746126594.693812:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11967 00000100:00100000:0.0:1746126594.693816:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945720866176:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126594.693821:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126594.693846:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800937c8800/0xb50e82586760fc78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b9a8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126594.693857:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c702, atime: 0x6813c701, ctime: 0x6813c702, blocks: 0x81f 00010000:00010000:0.0:1746126594.693864:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.693865:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.693869:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800937c8800/0xb50e82586760fc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9a8 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.693877:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800937c8800/0xb50e82586760fc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9a8 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.693884:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c8800, rc 0) 00000100:00100000:0.0:1746126594.693899:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945720866176:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.693911:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11967 00000100:00100000:0.0:1746126594.693921:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11968 00000100:00100000:0.0:1746126594.693926:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945720866432:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126594.693931:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126594.693938:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800937c9800/0xb50e82586760fc7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b9b6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126594.693948:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c701, atime: 0x6813c701, ctime: 0x6813c701, blocks: 0x1029 00010000:00010000:0.0:1746126594.693954:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.693956:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.693959:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c9800/0xb50e82586760fc7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9b6 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.693967:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800937c9800/0xb50e82586760fc7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9b6 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.693973:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c9800, rc 0) 00000100:00100000:0.0:1746126594.693988:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945720866432:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 62us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.693992:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11968 00000100:00100000:0.0:1746126594.711739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.725389:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6982 00000100:00100000:0.0:1746126594.725404:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1966:x1830945720867712:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126594.725445:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e82586760fcbe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.725467:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.725469:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.725475:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e82586760fcbe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.725488:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e82586760fcbe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758633:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758652:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758661:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758668:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec03200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126594.758671:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758678:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758695:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.758702:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec03200/0xb50e82586760fcb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.760105:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1966:x1830945720867456:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 38188us (44665us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126594.760118:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6981 00000100:00100000:0.0:1746126594.777681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.781966:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720868352 00000100:00100000:0.0:1746126594.781973:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720868352 00000100:00100000:0.0:1746126594.782004:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720868608 00000100:00100000:0.0:1746126594.782006:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720868608 00000100:00100000:0.0:1746126594.782016:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720868864 00000100:00100000:0.0:1746126594.782018:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720868864 00000100:00100000:0.0:1746126594.782027:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720868480 00000100:00100000:0.0:1746126594.782029:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720868480 00000100:00100000:0.0:1746126594.782037:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720868736 00000100:00100000:0.0:1746126594.782039:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720868736 00000100:00100000:0.0:1746126594.782047:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720868992 00000100:00100000:0.0:1746126594.782048:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720868992 00000100:00100000:0.0:1746126594.782057:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11969 00000100:00100000:0.0:1746126594.782064:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945720868352:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126594.782264:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746126594.782267:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782269:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782280:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782282:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1847 -> 1847 00000100:00100000:0.0:1746126594.782320:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945720868352:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 257us (555us total) trans 21474840025 rc 0/0 00000100:00100000:0.0:1746126594.782327:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11969 00000100:00100000:0.0:1746126594.782341:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11970 00000100:00100000:0.0:1746126594.782345:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945720868608:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126594.782433:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126594.782436:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.782437:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782439:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.782441:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126594.782455:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945720868608:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 110us (659us total) trans 17179872841 rc 0/0 00000100:00100000:0.0:1746126594.782460:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11970 00000100:00100000:0.0:1746126594.782468:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11971 00000100:00100000:0.0:1746126594.782472:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945720868864:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126594.782522:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126594.782525:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.782526:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782528:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.782529:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126594.782542:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945720868864:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 69us (724us total) trans 21474840026 rc 0/0 00000100:00100000:0.0:1746126594.782546:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11971 00000100:00100000:0.0:1746126594.782560:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11972 00000100:00100000:0.0:1746126594.782564:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945720868480:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126594.782615:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126594.782617:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782619:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782620:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782622:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126594.782634:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945720868480:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 70us (771us total) trans 17179872842 rc 0/0 00000100:00100000:0.0:1746126594.782639:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11972 00000100:00100000:0.0:1746126594.782647:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11973 00000100:00100000:0.0:1746126594.782651:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945720868736:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126594.782696:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126594.782698:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.782700:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782702:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.782704:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126594.782716:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945720868736:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 64us (834us total) trans 21474840027 rc 0/0 00000100:00100000:0.0:1746126594.782719:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11973 00000100:00100000:0.0:1746126594.782725:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11974 00000100:00100000:0.0:1746126594.782729:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945720868992:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126594.782775:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126594.782777:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782782:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782784:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126593 -> 1746126594 00002000:00010000:0.0:1746126594.782786:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126594.782802:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945720868992:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 72us (867us total) trans 17179872843 rc 0/0 00000100:00100000:0.0:1746126594.782807:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11974 00000100:00100000:0.0:1746126594.791750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.813516:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721128192 00000100:00100000:0.0:1746126594.813520:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721128192 00000100:00100000:0.0:1746126594.813538:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11977 00000100:00100000:0.0:1746126594.813543:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721129600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.815014:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721128832 00000100:00100000:0.0:1746126594.815018:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721128832 00000100:00100000:0.0:1746126594.815034:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721129344 00000100:00100000:0.0:1746126594.815036:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721129344 00000100:00100000:0.0:1746126594.815042:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721129856 00000100:00100000:0.0:1746126594.815043:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721129856 00000100:00100000:0.0:1746126594.815050:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11983 00000100:00100000:0.0:1746126594.815054:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721128832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126594.815133:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126594.815136:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126594.815138:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126594.815139:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126594.815141:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126594.815164:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3297:x1830945721128832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (363us total) trans 17179872850 rc 0/0 00000100:00100000:0.0:1746126594.815169:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11983 00000100:00100000:0.0:1746126594.815191:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11984 00000100:00100000:0.0:1746126594.815195:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721129344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126594.815278:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126594.815281:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.815282:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.815284:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.815285:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126594.815303:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3297:x1830945721129344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (477us total) trans 21474840030 rc 0/0 00000100:00100000:0.0:1746126594.815308:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11984 00000100:00100000:0.0:1746126594.815316:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11985 00000100:00100000:0.0:1746126594.815321:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721129856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.815396:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3297:x1830945721129856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (520us total) trans 21474840031 rc 0/0 00000100:00100000:0.0:1746126594.815401:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11985 00000100:00100000:0.0:1746126594.815545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.815576:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3295:x1830945721129600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2033us (2626us total) trans 21474840028 rc 0/0 00000100:00100000:0.0:1746126594.815582:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11977 00000100:00100000:0.0:1746126594.819923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.852973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.853343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.858548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.858608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.862615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.863575:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6263 00000100:00100000:0.0:1746126594.863591:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945720871168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.863599:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.863603:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135ec0a00/0xb50e82586760fd12 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9cb expref: 12 pid: 14549 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.863850:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135ec0a00/0xb50e82586760fd12 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9cb expref: 12 pid: 14549 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.863863:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135ec0a00/0xb50e82586760fd12 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9cb expref: 12 pid: 14549 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126594.863877:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126594.863881:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66c00/0xb50e82586760fd27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126594.863886:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66c00/0xb50e82586760fd27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126594.863892:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66c00/0xb50e82586760fd27 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126594.863898:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009341f400/0xb50e82586760fd43 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126594.863903:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009341f400/0xb50e82586760fd43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126594.863907:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009341f400/0xb50e82586760fd43 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126594.863923:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126594.863947:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945720871168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 357us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.863958:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6263 00010000:00010000:0.0:1746126594.864008:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009341f400/0xb50e82586760fd43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126594.864014:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009341f400/0xb50e82586760fd43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126594.864025:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126594.864145:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29e00/0xb50e82586760fd3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9e7 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.864156:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009341f400/0xb50e82586760fd43 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9e7 expref: 11 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.864162:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126594.864165:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126594.864167:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009341f400, rc 0) 00000100:00100000:0.0:1746126594.864187:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30612:x1830945720871424:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 920us (981us total) trans 8589942711 rc 0/0 00000100:00100000:0.0:1746126594.864193:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8589 00000100:00100000:0.0:1746126594.864216:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720871680 00000100:00100000:0.0:1746126594.864219:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720871680 00000100:00100000:0.0:1746126594.864235:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8590 00000100:00100000:0.0:1746126594.864240:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:30614:x1830945720871680:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126594.864247:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126594.864254:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1b1800/0xb50e82586760fd51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4b9ee expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.864288:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1b1800/0xb50e82586760fd51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9ee expref: 225 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.864296:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1b1800/0xb50e82586760fd51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9ee expref: 225 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.864309:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126594.864311:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126594.864313:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b1800, rc 0) 00000100:00100000:0.0:1746126594.864327:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:30614:x1830945720871680:12345-192.168.203.2@tcp:101:cat.0 Request processed in 87us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.864332:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8590 00000100:00100000:0.0:1746126594.867997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.873351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.879236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.893742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.900394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.900576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.902390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.905173:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721130624:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.905463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.906079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.906442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.934395:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721132416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.934426:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126594.934453:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721132928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.934476:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721132416 00000100:00100000:0.0:1746126594.934480:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721132416 00000100:00100000:0.0:1746126594.934497:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721132288 00000100:00100000:0.0:1746126594.934499:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721132288 00000100:00100000:0.0:1746126594.934508:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721132800 00000100:00100000:0.0:1746126594.934510:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721132800 00000100:00100000:0.0:1746126594.934520:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12004 00000100:00100000:0.0:1746126594.934524:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3295:x1830945721132416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126594.934631:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126594.934634:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.934636:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.934637:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126594.934639:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126594.934661:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3295:x1830945721132416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (234us total) trans 21474840036 rc 0/0 00000100:00100000:0.0:1746126594.934667:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12004 00000100:00100000:0.0:1746126594.936685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.936723:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721133184 00000100:00100000:0.0:1746126594.936726:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721133184 00000100:00100000:0.0:1746126594.936743:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12011 00000100:00100000:0.0:1746126594.936749:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3297:x1830945721133184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126594.936876:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3297:x1830945721133184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (200us total) trans 17179872861 rc 0/0 00000100:00100000:0.0:1746126594.936882:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12011 00000100:00100000:0.0:1746126594.936899:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126594.936923:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098d9a300/2, rc 0, transno 21474840036 00000100:00100000:0.0:1746126594.936926:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721132416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126594.939530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.939586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.940155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.942342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.948714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.949139:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.949189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.951884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.951913:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720874752 00000100:00100000:0.0:1746126594.951919:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720874752 00010000:00010000:0.0:1746126594.951944:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c9800/0xb50e82586760fc7f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9b6 expref: 15 pid: 8437 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.951969:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6266 00000100:00100000:0.0:1746126594.951974:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e580e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945720874752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.951987:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.952007:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800937c9800/0xb50e82586760fc7f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9b6 expref: 15 pid: 8437 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.952019:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800937c9800/0xb50e82586760fc7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9b6 expref: 15 pid: 8437 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.952042:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.952044:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.952050:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e82586760fd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba26 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.952059:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e82586760fd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba26 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.952095:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e82586760fd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba26 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.952106:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721133440:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126594.952159:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.964739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.969957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.971796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.971867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.971895:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720875136 00000100:00100000:0.0:1746126594.971903:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720875136 00000100:00100000:0.0:1746126594.972187:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12015 00000100:00100000:0.0:1746126594.972194:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:30612:x1830945720875136:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126594.972202:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126594.972220:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ba2d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.972237:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 13 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.972243:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.972244:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.972247:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->3694591] (req 3145728->3694591) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.972273:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 13 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.972300:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 13 pid: 23766 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.972311:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721133568:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.972507:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.973501:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.974688:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721133568:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.974714:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->3694591] (req 3145728->3694591) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974726:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013489ee00, rc 0) 00000100:00100000:0.0:1746126594.974754:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:30612:x1830945720875136:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2561us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126594.974761:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12015 00000100:00100000:0.0:1746126594.974778:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12017 00000100:00100000:0.0:1746126594.974784:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:30611:x1830945720875520:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126594.974795:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126594.974805:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013489f800/0xb50e82586760fdb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ba42 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974823:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800937c9a00/0xb50e82586760fc71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b99a expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.974849:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b883600/0xb50e82586760fd82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba0a expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974864:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b882600/0xb50e82586760fd66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9fc expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974870:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.974872:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.974875:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013489f800/0xb50e82586760fdb3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba42 expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974895:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b882600/0xb50e82586760fd66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9fc expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974904:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b882600/0xb50e82586760fd66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9fc expref: 28 pid: 8437 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.974913:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721133696:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.974971:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b883600/0xb50e82586760fd82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba0a expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.974978:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b883600/0xb50e82586760fd82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba0a expref: 21 pid: 8437 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.974986:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721133824:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126594.975006:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800937c9a00/0xb50e82586760fc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b99a expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126594.975023:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800937c9a00/0xb50e82586760fc71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b99a expref: 13 pid: 8437 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.975030:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721133952:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126594.975047:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.976744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.984342:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720875648 00000100:00100000:0.0:1746126594.984353:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720875648 00010000:00010000:0.0:1746126594.984396:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 14 pid: 23766 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746126594.984436:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720876032 00000100:00100000:0.0:1746126594.984439:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720876032 00010000:00010000:0.0:1746126594.984452:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b883600/0xb50e82586760fd82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba0a expref: 24 pid: 8437 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.984476:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720876160 00000100:00100000:0.0:1746126594.984479:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720876160 00010000:00010000:0.0:1746126594.984490:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b882600/0xb50e82586760fd66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9fc expref: 28 pid: 8437 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746126594.984504:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6267 00000100:00100000:0.0:1746126594.984510:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945720875648:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126594.984525:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126594.984547:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 14 pid: 23766 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.984572:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 14 pid: 23766 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.984594:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009360ba00/0xb50e82586760fc86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4b9af expref: 14 pid: 23766 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746126594.984614:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.984616:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126594.984622:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.984630:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126594.984662:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126594.984674:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721134080:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126594.984751:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126594.991690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.999797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126594.999968:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.005668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.011312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.011365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.021598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.021983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.021998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.022025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.044574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.044628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.051183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.051247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.051380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.059889:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720879872 00000100:00100000:0.0:1746126595.059900:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720879872 00002000:00100000:0.0:1746126595.059951:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3178496->4194303) req@ffff880134c3d500 x1830945720879872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:356/0 lens 488/0 e 0 to 0 dl 1746126606 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126595.059961:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d500 with x1830945720879872 ext(3178496->4194303) 00002000:00010000:0.0:1746126595.059967:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3d500 00000100:00100000:0.0:1746126595.060014:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6998 00000100:00100000:0.0:1746126595.060024:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945720879872:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126595.067340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.067913:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945720879616:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15252us (16532us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126595.067925:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6997 00002000:00100000:0.0:1746126595.067937:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3178495) req@ffff88008f254a80 x1830945720879616/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:356/0 lens 504/440 e 0 to 0 dl 1746126606 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126595.067946:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254a80 with x1830945720879616 ext(2097152->3178495) 00002000:00010000:0.0:1746126595.067952:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f254a80 00000100:00100000:0.0:1746126595.084006:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721135104:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126595.084042:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a9ea00/0xb50e82586760fddd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba6c expref: 30 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.084057:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9ea00, rc 0) 00000100:00100000:0.0:1746126595.084084:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:30614:x1830945720880000:12345-192.168.203.2@tcp:101:cat.0 Request processed in 14223us (16756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.084092:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12023 00000100:00100000:0.0:1746126595.084130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.084145:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720880128 00000100:00100000:0.0:1746126595.084149:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720880128 00002000:00100000:0.0:1746126595.084175:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3694591) req@ffff88008f257480 x1830945720880128/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:356/0 lens 488/0 e 0 to 0 dl 1746126606 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126595.084183:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f257480 with x1830945720880128 ext(3145728->3694591) 00010000:00010000:0.0:1746126595.084189:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 26 pid: 8438 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746126595.084199:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013489ee00/0xb50e82586760fda5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba2d expref: 26 pid: 8438 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746126595.084214:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f257480 00000100:00100000:0.0:1746126595.084228:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1573 00000100:00100000:0.0:1746126595.084233:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945720880128:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126595.095433:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721135872 00000100:00100000:0.0:1746126595.095442:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721135872 00000100:00100000:0.0:1746126595.095759:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1746126595.095766:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3294:x1830945721135872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746126595.095799:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 3407872 granted 450166784 pending 18743296 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746126595.095852:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3294:x1830945721135872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.095858:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1746126595.101150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.106804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126595.110986:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a9ea00/0xb50e82586760fddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba6c expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.111006:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f256680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721136128:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126595.111076:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.119237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.155652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.155702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.161282:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.174164:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721136512:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126595.174210:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800933e6000/0xb50e82586760fdf9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba88 expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.174227:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933e6000, rc 0) 00000100:00100000:0.0:1746126595.174269:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:30614:x1830945720881536:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9240us (9895us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.174277:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12027 00000100:00100000:0.0:1746126595.181898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.181934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.181967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.185883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126595.186017:0:8438:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff880092b15f80 x1830945721136896) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e82586760fd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba26 expref: 28 pid: 4640 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.186049:0:8438:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e82586760fd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba26 expref: 28 pid: 4640 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.187584:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721136896:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126595.187603:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.187606:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.187612:0:8438:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800933e6000/0xb50e82586760fdf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba88 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.187621:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800933e6000/0xb50e82586760fdf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba88 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.188126:0:8438:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800933e6000/0xb50e82586760fdf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba88 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.188140:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721137024:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126595.188217:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.201303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.201343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.201373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.243554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.245495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.254822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.267357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.278679:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.281230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.300785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.310045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.311137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.318388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.334390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.337995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.341114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.346399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.354179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.364417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.364470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126595.365320:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126595.370274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.376109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.389720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.396298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.396332:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.399578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.399621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.405187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.405231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.405260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.405283:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720888192 00000100:00100000:0.0:1746126595.405291:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720888192 00000100:00100000:0.0:1746126595.405344:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720888448 00000100:00100000:0.0:1746126595.405346:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720888448 00000100:00100000:0.0:1746126595.405375:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720888704 00000100:00100000:0.0:1746126595.405377:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720888704 00000100:00100000:0.0:1746126595.405392:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12037 00000100:00100000:0.0:1746126595.405399:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945720888192:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126595.405418:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.405438:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009360ba00/0xb50e82586760fea1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bae3 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.405490:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721138944:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126595.405563:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.405581:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12038 00000100:00100000:0.0:1746126595.405586:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945720888448:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126595.405593:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.405603:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1e00/0xb50e82586760fea8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4baf1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.405627:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721139072:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126595.405647:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.405669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.405685:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720888320 00000100:00100000:0.0:1746126595.405687:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720888320 00000100:00100000:0.0:1746126595.405703:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12039 00000100:00100000:0.0:1746126595.405707:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945720888704:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126595.405713:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.405719:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e82586760feaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4baff expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.405749:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721139200:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126595.405767:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.405821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126595.408410:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126594 -> 1746126595 00002000:00010000:0.0:1746126595.408417:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126594 -> 1746126595 00000100:00100000:0.0:1746126595.408440:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721139072:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126595.408472:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1e00/0xb50e82586760fea8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4baf1 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.408485:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1e00/0xb50e82586760fea8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4baf1 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.409367:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b1e00, rc 0) 00000100:00100000:0.0:1746126595.409385:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945720888448:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3798us (4154us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126595.409391:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12038 00000100:00100000:0.0:1746126595.414520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.416648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.419223:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.423112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.429041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.430886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.430914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.430930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.430953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.438105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.440675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.440710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.440737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.440773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.442520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.442556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.445912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.445956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.448041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.448094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.448111:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720891648 00000100:00100000:0.0:1746126595.448114:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720891648 00002000:00100000:0.0:1746126595.448142:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1318911) req@ffff880131d55f80 x1830945720891648/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:356/0 lens 488/0 e 0 to 0 dl 1746126606 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126595.448151:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55f80 with x1830945720891648 ext(1048576->1318911) 00010000:00010000:0.0:1746126595.448157:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092ba1200/0xb50e82586760fdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba57 expref: 27 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.448167:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092ba1200/0xb50e82586760fdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba57 expref: 27 pid: 8438 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746126595.448173:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131d55f80 00000100:00100000:0.0:1746126595.448193:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1575 00000100:00100000:0.0:1746126595.448199:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945720891648:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126595.465792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.465911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.465934:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720892288 00000100:00100000:0.0:1746126595.465941:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720892288 00010000:00010000:0.0:1746126595.465968:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec02600/0xb50e82586760fe77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bace expref: 24 pid: 4640 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.465987:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720892416 00000100:00100000:0.0:1746126595.465989:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720892416 00010000:00010000:0.0:1746126595.466000:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013489f800/0xb50e82586760fdb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba42 expref: 31 pid: 8438 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.466014:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6290 00000100:00100000:0.0:1746126595.466019:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945720892288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.466033:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.466051:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec02600/0xb50e82586760fe77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bace expref: 24 pid: 4640 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466060:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec02600/0xb50e82586760fe77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bace expref: 24 pid: 4640 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466081:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec02600/0xb50e82586760fe77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bace expref: 24 pid: 4640 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466099:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.466102:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.466106:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009360fa00/0xb50e82586760ff42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.466114:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009360fa00/0xb50e82586760ff42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.466144:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.466162:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945720892288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.466167:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6290 00000100:00100000:0.0:1746126595.466179:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6291 00000100:00100000:0.0:1746126595.466184:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945720892416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.466189:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.466199:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013489f800/0xb50e82586760fdb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba42 expref: 31 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466216:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013489f800/0xb50e82586760fdb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba42 expref: 31 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466226:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013489f800/0xb50e82586760fdb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba42 expref: 31 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466234:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.466235:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.466238:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adb1400/0xb50e82586760ff26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.466243:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb1400/0xb50e82586760ff26 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.466256:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.466269:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945720892416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.466278:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6291 00000100:00100000:0.0:1746126595.466313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.466323:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720892160 00000100:00100000:0.0:1746126595.466326:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720892160 00010000:00010000:0.0:1746126595.466336:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba1200/0xb50e82586760fdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba57 expref: 30 pid: 8438 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.466349:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6292 00000100:00100000:0.0:1746126595.466353:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945720892160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.466358:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.466366:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ba1200/0xb50e82586760fdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba57 expref: 30 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466373:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ba1200/0xb50e82586760fdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba57 expref: 30 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466382:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba1200/0xb50e82586760fdc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba57 expref: 30 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.466389:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.466390:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.466393:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec03e00/0xb50e82586760ff34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.466398:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec03e00/0xb50e82586760ff34 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.466418:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.466432:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945720892160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.466436:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6292 00000100:00100000:0.0:1746126595.467348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.473666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.478734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.484000:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6296 00000100:00100000:0.0:1746126595.484011:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945720893312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.484025:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.484032:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e82586760fd89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba18 expref: 13 pid: 14548 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.484044:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e82586760fd89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba18 expref: 13 pid: 14548 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.484166:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e82586760fd89 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba18 expref: 13 pid: 14548 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.484448:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126595.484453:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd9d400/0xb50e82586760ff49 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.484458:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.484480:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945720893312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 472us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.484498:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6296 00000100:00100000:0.0:1746126595.484665:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720893440 00000100:00100000:0.0:1746126595.484668:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720893440 00010000:00010000:0.0:1746126595.484680:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f2e00/0xb50e82586760fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba11 expref: 227 pid: 14549 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.484703:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6299 00000100:00100000:0.0:1746126595.484708:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:1965:x1830945720893440:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.484713:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.484717:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f2e00/0xb50e82586760fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba11 expref: 227 pid: 14549 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.484726:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f2e00/0xb50e82586760fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba11 expref: 227 pid: 14549 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.485629:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f2e00/0xb50e82586760fd7b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ba11 expref: 225 pid: 14549 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.485642:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126595.485646:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd9d400/0xb50e82586760ff49 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.485652:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd9d400/0xb50e82586760ff49 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.485658:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd9d400/0xb50e82586760ff49 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.485683:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.485713:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:1965:x1830945720893440:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1005us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.485719:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6299 00000001:00080000:0.0:1746126595.512684:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942719 is committed 00000001:00080000:0.0:1746126595.512697:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942718 is committed 00000001:00080000:0.0:1746126595.512703:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942723 is committed 00000004:00080000:0.0:1746126595.512707:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1812 committed 00000004:00080000:0.0:1746126595.512713:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1897 committed 00000004:00080000:0.0:1746126595.513148:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1896 committed 00000004:00080000:0.0:1746126595.513151:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1811 committed 00000004:00080000:0.0:1746126595.513152:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1895 committed 00000004:00080000:0.0:1746126595.513153:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1810 committed 00000004:00080000:0.0:1746126595.513154:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1894 committed 00000004:00080000:0.0:1746126595.513156:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1809 committed 00000004:00080000:0.0:1746126595.513157:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1893 committed 00000004:00080000:0.0:1746126595.513158:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1808 committed 00000004:00080000:0.0:1746126595.513159:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1892 committed 00000004:00080000:0.0:1746126595.513161:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1891 committed 00000004:00080000:0.0:1746126595.513162:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1807 committed 00000004:00080000:0.0:1746126595.513163:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1806 committed 00000004:00080000:0.0:1746126595.513164:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1890 committed 00000004:00080000:0.0:1746126595.513165:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1889 committed 00000004:00080000:0.0:1746126595.513167:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1805 committed 00000001:00080000:0.0:1746126595.513185:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942720 is committed 00000100:00100000:0.0:1746126595.513353:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721142528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.513449:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721143040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513465:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.513478:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746126595.513488:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721142400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513501:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.513509:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721142912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513519:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.513537:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721142528 00000100:00100000:0.0:1746126595.513543:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721142528 00000100:00100000:0.0:1746126595.513566:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721143040 00000100:00100000:0.0:1746126595.513568:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721143040 00000100:00100000:0.0:1746126595.513576:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721142400 00000100:00100000:0.0:1746126595.513578:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721142400 00000100:00100000:0.0:1746126595.513585:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721142912 00000100:00100000:0.0:1746126595.513587:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721142912 00000100:00100000:0.0:1746126595.513597:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12053 00000100:00100000:0.0:1746126595.513601:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3295:x1830945721142528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513779:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721142528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (379us total) trans 21474840047 rc 0/0 00000100:00100000:0.0:1746126595.513785:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12053 00000100:00100000:0.0:1746126595.513795:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12054 00000100:00100000:0.0:1746126595.513799:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3295:x1830945721143040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513897:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721143040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (430us total) trans 21474840048 rc 0/0 00000100:00100000:0.0:1746126595.513901:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12054 00000100:00100000:0.0:1746126595.513910:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12055 00000100:00100000:0.0:1746126595.513914:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3295:x1830945721142400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.513987:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721142400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (484us total) trans 21474840049 rc 0/0 00000100:00100000:0.0:1746126595.513992:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12055 00000100:00100000:0.0:1746126595.514004:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1746126595.514008:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3295:x1830945721142912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.514076:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721142912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (556us total) trans 21474840050 rc 0/0 00000100:00100000:0.0:1746126595.514081:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12056 00000004:00080000:0.0:1746126595.514113:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131d54000/2, rc 0, transno 21474840049 00000100:00100000:0.0:1746126595.514117:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721142400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.514124:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131d54380/2, rc 0, transno 21474840050 00000100:00100000:0.0:1746126595.514126:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721142912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.514131:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131d54e00/2, rc 0, transno 21474840047 00000100:00100000:0.0:1746126595.514133:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721142528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.514138:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131d57b80/2, rc 0, transno 21474840048 00000100:00100000:0.0:1746126595.514140:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721143040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.539335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.542227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.542783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.543695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.555360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.555803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.555873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.555907:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720894848 00000100:00100000:0.0:1746126595.555916:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720894848 00000100:00100000:0.0:1746126595.555980:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720895104 00000100:00100000:0.0:1746126595.555982:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720895104 00000100:00100000:0.0:1746126595.556131:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720895360 00000100:00100000:0.0:1746126595.556134:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720895360 00000100:00100000:0.0:1746126595.563017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.568746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.574317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.574338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.574372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.574990:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7016 00000100:00100000:0.0:1746126595.574997:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:1964:x1830945720896384:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126595.575017:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2000/0xb50e82586760ffb9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.575026:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.575028:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.575031:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2000/0xb50e82586760ffb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.575040:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2000/0xb50e82586760ffb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580439:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580453:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580460:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580466:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f1b1c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126595.580469:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580483:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580498:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.580505:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1c00/0xb50e82586760ff96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.581422:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:1964:x1830945720894848:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 25229us (26067us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126595.581433:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7010 00000100:00100000:0.0:1746126595.621413:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.625588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.628528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.632051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.635032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.638472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.640686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.644556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.646866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.649412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.652458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.655354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.658219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.660519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.662381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.662427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.662456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.662536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.662559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.662574:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720898944 00000100:00100000:0.0:1746126595.662578:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720898944 00000100:00100000:0.0:1746126595.662601:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12084 00000100:00100000:0.0:1746126595.662606:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945720899072:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126595.662715:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126595.662718:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.662719:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.662721:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.662722:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126595.662747:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945720899072:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 140us (319us total) trans 21474840056 rc 0/0 00000100:00100000:0.0:1746126595.663305:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12084 00000100:00100000:0.0:1746126595.663355:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12085 00000100:00100000:0.0:1746126595.663387:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945720898688:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126595.663564:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126595.663567:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.663569:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.663570:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126594 -> 1746126595 00002000:00010000:0.0:1746126595.663572:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126595.663595:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945720898688:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 233us (1138us total) trans 17179872876 rc 0/0 00000100:00100000:0.0:1746126595.663601:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12085 00000100:00100000:0.0:1746126595.663621:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12087 00000100:00100000:0.0:1746126595.663626:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945720898944:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126595.663692:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126595.663695:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.663696:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.663698:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.663700:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126595.663777:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945720898944:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 150us (1241us total) trans 21474840057 rc 0/0 00000100:00100000:0.0:1746126595.663782:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12087 00000100:00100000:0.0:1746126595.666257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.670581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000001:00080000:0.0:1746126595.707579:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942724 is committed 00000001:00080000:0.0:1746126595.707592:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942725 is committed 00000004:00080000:0.0:1746126595.707596:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1820 committed 00000004:00080000:0.0:1746126595.707603:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1906 committed 00000004:00080000:0.0:1746126595.707608:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1905 committed 00000004:00080000:0.0:1746126595.707609:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1819 committed 00000004:00080000:0.0:1746126595.707611:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1904 committed 00000004:00080000:0.0:1746126595.707612:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1818 committed 00000004:00080000:0.0:1746126595.707613:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1903 committed 00000004:00080000:0.0:1746126595.707615:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1817 committed 00000004:00080000:0.0:1746126595.707616:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1902 committed 00000004:00080000:0.0:1746126595.707618:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1816 committed 00000004:00080000:0.0:1746126595.707619:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1901 committed 00000004:00080000:0.0:1746126595.707620:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1900 committed 00000004:00080000:0.0:1746126595.707622:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1815 committed 00000004:00080000:0.0:1746126595.707623:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1814 committed 00000004:00080000:0.0:1746126595.707631:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1899 committed 00000004:00080000:0.0:1746126595.707633:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1898 committed 00000004:00080000:0.0:1746126595.707635:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1813 committed 00000100:00100000:0.0:1746126595.711196:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.711280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711299:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.711314:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711322:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.711333:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711341:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.711351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711361:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746126595.711365:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.711376:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711384:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.711394:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711401:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.711411:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711415:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.711424:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126595.711439:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721146240 00000100:00100000:0.0:1746126595.711441:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721146240 00000100:00100000:0.0:1746126595.711453:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721146752 00000100:00100000:0.0:1746126595.711455:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721146752 00000100:00100000:0.0:1746126595.711462:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721147264 00000100:00100000:0.0:1746126595.711463:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721147264 00000100:00100000:0.0:1746126595.711469:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721147776 00000100:00100000:0.0:1746126595.711479:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721147776 00000100:00100000:0.0:1746126595.711489:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721146112 00000100:00100000:0.0:1746126595.711491:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721146112 00000100:00100000:0.0:1746126595.711497:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721146624 00000100:00100000:0.0:1746126595.711498:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721146624 00000100:00100000:0.0:1746126595.711503:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721147136 00000100:00100000:0.0:1746126595.711505:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721147136 00000100:00100000:0.0:1746126595.711510:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721147648 00000100:00100000:0.0:1746126595.711511:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721147648 00000100:00100000:0.0:1746126595.711519:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12097 00000100:00100000:0.0:1746126595.711523:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3295:x1830945721146240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126595.711636:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126595.711639:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.711641:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.711643:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.711645:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126595.711669:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3295:x1830945721146240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (389us total) trans 21474840062 rc 0/0 00000100:00100000:0.0:1746126595.711674:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12097 00000100:00100000:0.0:1746126595.711687:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12098 00000100:00100000:0.0:1746126595.711691:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3295:x1830945721146752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.711774:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3295:x1830945721146752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (459us total) trans 21474840063 rc 0/0 00000100:00100000:0.0:1746126595.711779:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12098 00000100:00100000:0.0:1746126595.711789:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12099 00000100:00100000:0.0:1746126595.711793:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3295:x1830945721147264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126595.711895:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126595.711898:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.711900:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.711902:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.711904:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126595.711922:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3295:x1830945721147264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (587us total) trans 17179872883 rc 0/0 00000100:00100000:0.0:1746126595.711927:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12099 00000100:00100000:0.0:1746126595.711936:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12100 00000100:00100000:0.0:1746126595.711941:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3295:x1830945721147776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.712014:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3295:x1830945721147776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (662us total) trans 17179872884 rc 0/0 00000100:00100000:0.0:1746126595.712019:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12100 00000100:00100000:0.0:1746126595.712028:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12101 00000100:00100000:0.0:1746126595.712031:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3295:x1830945721146112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126595.712100:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126595.712103:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.712105:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.712107:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.712108:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126595.712126:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3295:x1830945721146112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (748us total) trans 21474840064 rc 0/0 00000100:00100000:0.0:1746126595.712131:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12101 00000100:00100000:0.0:1746126595.712140:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12102 00000100:00100000:0.0:1746126595.712144:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3295:x1830945721146624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126595.712231:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3295:x1830945721146624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (835us total) trans 21474840065 rc 0/0 00000100:00100000:0.0:1746126595.712239:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12102 00000100:00100000:0.0:1746126595.712248:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12103 00000100:00100000:0.0:1746126595.712253:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3295:x1830945721147136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126595.712318:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126595.712320:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.712322:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126594 -> 1746126594 00002000:00010000:0.0:1746126595.712324:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126595 -> 1746126595 00002000:00010000:0.0:1746126595.712326:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126595.712343:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3295:x1830945721147136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (931us total) trans 17179872885 rc 0/0 00000100:00100000:0.0:1746126595.712348:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12103 00000100:00100000:0.0:1746126595.712356:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12104 00000100:00100000:0.0:1746126595.712360:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3295:x1830945721147648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.712432:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3295:x1830945721147648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1005us total) trans 17179872886 rc 0/0 00000100:00100000:0.0:1746126595.712437:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12104 00000004:00080000:0.0:1746126595.712485:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3aa300/2, rc 0, transno 21474840064 00000100:00100000:0.0:1746126595.712488:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.712494:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a9f80/2, rc 0, transno 21474840065 00000100:00100000:0.0:1746126595.712496:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.712502:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0380/2, rc 0, transno 17179872885 00000100:00100000:0.0:1746126595.712504:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126595.712509:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0700/2, rc 0, transno 17179872886 00000100:00100000:0.0:1746126595.712512:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126595.712517:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a9500/2, rc 0, transno 21474840062 00000100:00100000:0.0:1746126595.712519:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.712525:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a8e00/2, rc 0, transno 21474840063 00000100:00100000:0.0:1746126595.712527:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721146752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126595.712532:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e1500/2, rc 0, transno 17179872883 00000100:00100000:0.0:1746126595.712535:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126595.712540:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e2680/2, rc 0, transno 17179872884 00000100:00100000:0.0:1746126595.712542:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721147776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126595.713130:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720899712 00000100:00100000:0.0:1746126595.713136:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720899712 00000100:00100000:0.0:1746126595.713718:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8606 00000100:00100000:0.0:1746126595.713725:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:30627:x1830945720899712:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126595.713743:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.713757:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb1200/0xb50e82586760ffff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bba0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.713805:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb1200/0xb50e82586760ffff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bba0 expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.713817:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb1200/0xb50e82586760ffff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bba0 expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.744898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.747735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.752772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.755743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.760445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.766650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.766683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.766708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.766739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.768899:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6309 00000100:00100000:0.0:1746126595.768907:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945720901632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.768914:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.768918:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb1200/0xb50e82586760ffff lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bba0 expref: 8 pid: 14547 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.768927:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb1200/0xb50e82586760ffff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bba0 expref: 8 pid: 14547 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.768938:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb1200/0xb50e82586760ffff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bba0 expref: 8 pid: 14547 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.768950:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126595.768953:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.768959:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.768965:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126595.768984:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.769021:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945720901632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.769028:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6309 00010000:00010000:0.0:1746126595.777786:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126595.810659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.810753:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.810790:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720901888 00000100:00100000:0.0:1746126595.810798:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720901888 00000100:00100000:0.0:1746126595.810865:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3567 00000100:00100000:0.0:1746126595.810873:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30639:x1830945720901888:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:0.0:1746126595.810986:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30639:x1830945720901888:12345-192.168.203.2@tcp:49:cat.0 Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.810993:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3567 00000100:00100000:0.0:1746126595.815035:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.817699:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902144 00000100:00100000:0.0:1746126595.817709:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902144 00000100:00100000:0.0:1746126595.817757:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902272 00000100:00100000:0.0:1746126595.817761:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902272 00000100:00100000:0.0:1746126595.817780:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902400 00000100:00100000:0.0:1746126595.817783:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902400 00000100:00100000:0.0:1746126595.817798:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902528 00000100:00100000:0.0:1746126595.817801:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902528 00000100:00100000:0.0:1746126595.817813:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902656 00000100:00100000:0.0:1746126595.817815:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902656 00000100:00100000:0.0:1746126595.817824:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902784 00000100:00100000:0.0:1746126595.817853:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902784 00000100:00100000:0.0:1746126595.817866:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720902912 00000100:00100000:0.0:1746126595.817867:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720902912 00000100:00100000:0.0:1746126595.817885:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12123 00000100:00100000:0.0:1746126595.817894:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+26:30636:x1830945720902144:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126595.817915:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.817936:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009adb0800/0xb50e825867610092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bbdf expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.817969:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0000/0xb50e82586760ffea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb92 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.817977:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126595.817979:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126595.817983:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009adb0800/0xb50e825867610092 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2179072->2281471] (req 2179072->2281471) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbdf expref: 27 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.818015:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0000/0xb50e82586760ffea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb92 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.818028:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0000/0xb50e82586760ffea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb92 expref: 15 pid: 8438 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.818041:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721150976:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126595.818096:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.818122:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12126 00000100:00100000:0.0:1746126595.818128:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945720902528:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126595.818137:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.818145:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adb1200/0xb50e8258676100a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bbf4 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.818173:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721151232:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126595.818214:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.818231:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12128 00000100:00100000:0.0:1746126595.818237:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945720902784:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126595.818244:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.818251:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec03a00/0xb50e8258676100b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bc02 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.818278:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e805180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721151616:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126595.818305:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.819143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.822670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126595.822728:0:9686:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0000/0xb50e82586760ffea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb92 expref: 15 pid: 8438 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.823470:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e805180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721151616:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126595.823497:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec03a00/0xb50e8258676100b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc02 expref: 33 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.823507:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec03a00/0xb50e8258676100b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc02 expref: 33 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.823540:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec03a00, rc 0) 00000100:00100000:0.0:1746126595.823571:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945720902784:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5333us (5951us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126595.823577:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12128 00010000:00010000:0.0:1746126595.823611:0:10890:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0c00/0xb50e82586760ffdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb84 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.823629:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721151232:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126595.823645:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adb1200/0xb50e8258676100a7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbf4 expref: 34 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.823653:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adb1200/0xb50e8258676100a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbf4 expref: 34 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.823661:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adb1200, rc 0) 00000100:00100000:0.0:1746126595.823680:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945720902528:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5553us (6108us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126595.823685:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12126 00000100:00100000:0.0:1746126595.827910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.832662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.832776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.832790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.832805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.833955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.833991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.834012:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12131 00000100:00100000:0.0:1746126595.834019:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945720903936:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126595.834027:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126595.834037:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba0600/0xb50e8258676100ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bc1e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.834076:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721151872:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126595.834486:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746126595.839549:0:10890:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0e00/0xb50e82586760ffe3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb8b expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.839568:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721151872:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126595.839584:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba0600/0xb50e8258676100ca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc1e expref: 35 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.839592:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba0600/0xb50e8258676100ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc1e expref: 35 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126595.839603:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba0600, rc 0) 00000100:00100000:0.0:1746126595.839635:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945720903936:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5618us (6859us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126595.839642:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12131 00000100:00100000:0.0:1746126595.840654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.841678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.843406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.847344:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720905216 00000100:00100000:0.0:1746126595.847352:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720905216 00010000:00010000:0.0:1746126595.847378:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013091ca00/0xb50e82586760ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb7d expref: 18 pid: 8438 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746126595.847398:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6311 00000100:00100000:0.0:1746126595.847404:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1964:x1830945720905216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126595.847416:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126595.847434:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013091ca00/0xb50e82586760ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb7d expref: 18 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.847444:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013091ca00/0xb50e82586760ffd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb7d expref: 18 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.847464:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013091ca00/0xb50e82586760ffd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bb7d expref: 18 pid: 8438 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.847490:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.847492:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126595.847499:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008faa1600/0xb50e8258676100ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc3a expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.847507:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008faa1600/0xb50e8258676100ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc3a expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126595.847536:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008faa1600/0xb50e8258676100ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc3a expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126595.847547:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721152768:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126595.847599:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126595.851730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.854791:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721152768:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126595.854814:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126595.854872:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945720905216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7466us (7634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126595.854881:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6311 00000100:00100000:0.0:1746126595.857842:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720905856 00000100:00100000:0.0:1746126595.857852:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720905856 00002000:00100000:0.0:1746126595.857895:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880134c7f480 x1830945720905856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:356/0 lens 488/0 e 0 to 0 dl 1746126606 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126595.857905:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c7f480 with x1830945720905856 ext(1048576->2097151) 00002000:00010000:0.0:1746126595.857910:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c7f480 00000100:00100000:0.0:1746126595.857929:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7022 00000100:00100000:0.0:1746126595.857935:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945720905856:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126595.870601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.872437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.874848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.878087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.878720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.890081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.896087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.899703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.911477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.922648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.930094:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.933612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.938814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.939505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.962215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.962263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.975540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.975576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126595.985274:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720909824 00000100:00100000:0.0:1746126595.985278:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720909824 00002000:00100000:0.0:1746126595.985297:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2158592->2875391) req@ffff88009ee38000 x1830945720909824/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:356/0 lens 488/0 e 0 to 0 dl 1746126606 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126595.985305:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38000 with x1830945720909824 ext(2158592->2875391) 00010000:00010000:0.0:1746126595.985309:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093416a00/0xb50e8258676100e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc33 expref: 32 pid: 20294 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126595.985318:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093416a00/0xb50e8258676100e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc33 expref: 32 pid: 20294 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746126595.985323:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee38000 00000100:00100000:0.0:1746126595.986329:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1581 00000100:00100000:0.0:1746126595.986338:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945720909824:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126595.994275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.002489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126596.003452:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126596.012881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126596.014499:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126596.020390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.022672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126596.025129:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746126596.027452:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126596.029484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.030311:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720911360 00000100:00100000:0.0:1746126596.030319:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720911360 00002000:00100000:0.0:1746126596.030371:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009eebea00 x1830945720911360/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.030381:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eebea00 with x1830945720911360 ext(3145728->4194303) 00010000:00010000:0.0:1746126596.030390:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d151200/0xb50e82586761014f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc80 expref: 32 pid: 4641 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746126596.030403:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d151200/0xb50e82586761014f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc80 expref: 32 pid: 4641 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746126596.030409:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009eebea00 00000100:00100000:0.0:1746126596.030425:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720911488 00000100:00100000:0.0:1746126596.030427:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720911488 00002000:00100000:0.0:1746126596.030438:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee38700 x1830945720911488/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.030445:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38700 with x1830945720911488 ext(3145728->4194303) 00002000:00010000:0.0:1746126596.030448:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38700 00000100:00100000:0.0:1746126596.030472:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1582 00000100:00100000:0.0:1746126596.030479:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945720911360:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126596.039764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.044452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.047655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.054810:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720912128 00000100:00100000:0.0:1746126596.054817:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720912128 00002000:00100000:0.0:1746126596.054872:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009ee3aa00 x1830945720912128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.054882:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3aa00 with x1830945720912128 ext(3145728->4194303) 00002000:00010000:0.0:1746126596.054887:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3aa00 00000100:00100000:0.0:1746126596.054904:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7034 00000100:00100000:0.0:1746126596.054910:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945720912128:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126596.068942:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945720912128:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14021us (14441us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126596.068955:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7034 00002000:00100000:0.0:1746126596.068966:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009ee3aa00 x1830945720912128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/440 e 0 to 0 dl 1746126607 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.068975:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3aa00 with x1830945720912128 ext(3145728->4194303) 00002000:00010000:0.0:1746126596.068980:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3aa00 00000100:00100000:0.0:1746126596.072265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.075760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.076607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.076649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.077330:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12152 00000100:00100000:0.0:1746126596.077337:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945720913280:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126596.077345:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.077356:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4bc7200/0xb50e825867610180 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bcb1 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.077375:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4bc7200/0xb50e825867610180 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcb1 expref: 33 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.077384:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4bc7200/0xb50e825867610180 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcb1 expref: 33 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.077406:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4bc7200, rc 0) 00000100:00100000:0.0:1746126596.077430:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945720913280:12345-192.168.203.2@tcp:101:cat.0 Request processed in 93us (779us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126596.077436:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12152 00000100:00100000:0.0:1746126596.079958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.087397:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720913664 00000100:00100000:0.0:1746126596.087406:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720913664 00002000:00100000:0.0:1746126596.087448:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3497984->3502079) req@ffff880134c7ea00 x1830945720913664/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.087458:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c7ea00 with x1830945720913664 ext(3497984->3502079) 00002000:00010000:0.0:1746126596.087464:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c7ea00 00000100:00100000:0.0:1746126596.087480:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7035 00000100:00100000:0.0:1746126596.087486:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945720913664:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126596.087639:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945720913664:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 152us (1073us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126596.087644:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7035 00002000:00100000:0.0:1746126596.087649:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3497984->3502079) req@ffff880134c7ea00 x1830945720913664/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746126607 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.087661:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c7ea00 with x1830945720913664 ext(3497984->3502079) 00002000:00010000:0.0:1746126596.087664:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c7ea00 00000100:00100000:0.0:1746126596.093782:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720914304 00000100:00100000:0.0:1746126596.093792:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720914304 00000100:00100000:0.0:1746126596.093862:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3570 00000100:00100000:0.0:1746126596.093870:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:30643:x1830945720914304:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126596.094059:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:30643:x1830945720914304:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 190us (324us total) trans 8589942734 rc 0/0 00000100:00100000:0.0:1746126596.094066:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3570 00000100:00100000:0.0:1746126596.097913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.111276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.112366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126596.114332:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126596.121660:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7038 00000100:00100000:0.0:1746126596.121673:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945720915584:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126596.122022:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7039 00000100:00100000:0.0:1746126596.122064:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945720915712:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126596.130079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.140609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.140654:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.142890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.142927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.149706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.149749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.162439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.169040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.172634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.177634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.186054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.228775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.233481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.233509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.233554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.233581:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720918272 00000100:00100000:0.0:1746126596.233588:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720918272 00010000:00010000:0.0:1746126596.234703:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761013a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc79 expref: 15 pid: 20362 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126596.234741:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6326 00000100:00100000:0.0:1746126596.234749:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945720918272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126596.234757:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126596.234762:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761013a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc79 expref: 15 pid: 20362 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.234771:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761013a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc79 expref: 15 pid: 20362 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.234784:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761013a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc79 expref: 15 pid: 20362 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.234797:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126596.234800:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa0a00/0xb50e8258676101e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.234808:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa0a00/0xb50e8258676101e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.234814:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa0a00/0xb50e8258676101e9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.234847:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126596.234867:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945720918272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.234872:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6326 00010000:00010000:0.0:1746126596.234905:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa0a00/0xb50e8258676101e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.234910:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa0a00/0xb50e8258676101e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126596.234927:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126596.235070:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa1800/0xb50e8258676101e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcf7 expref: 15 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.235086:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008faa0a00/0xb50e8258676101e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcf7 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.235091:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126596.235094:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126596.235096:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008faa0a00, rc 0) 00000100:00100000:0.0:1746126596.235125:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:30652:x1830945720918016:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4883us (6357us total) trans 8589942737 rc 0/0 00000100:00100000:0.0:1746126596.235131:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8616 00000100:00100000:0.0:1746126596.249242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.251621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.252409:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6327 00000100:00100000:0.0:1746126596.252418:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945720918656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126596.252428:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126596.252445:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d87fc00/0xb50e8258676101c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcdb expref: 33 pid: 17475 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126596.252456:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d87fc00/0xb50e8258676101c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcdb expref: 33 pid: 17475 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126596.252473:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d87fc00/0xb50e8258676101c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcdb expref: 33 pid: 17475 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126596.253737:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126596.253789:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945720918656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1369us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.253796:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6327 00000100:00100000:0.0:1746126596.258238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.265397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.273354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.291621:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720919552 00000100:00100000:0.0:1746126596.291629:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720919552 00000100:00100000:0.0:1746126596.291675:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8617 00000100:00100000:0.0:1746126596.291682:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:30657:x1830945720919552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126596.291699:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.291714:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7600/0xb50e8258676101fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bd05 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.291800:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291812:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291820:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291858:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291865:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291870:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291954:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291961:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.291966:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126596.291973:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126596.292043:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292049:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292057:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292062:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4bc7400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126596.292065:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292071:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292079:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126596.292082:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126596.292084:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292088:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7400/0xb50e825867610205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292101:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292105:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292109:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292113:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4bc7800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126596.292114:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292118:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292125:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8aa00) 00010000:00010000:0.0:1746126596.292127:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126596.292128:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292132:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7800/0xb50e82586761020c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126596.292158:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc7600/0xb50e8258676101fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 228 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.292166:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 227 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.292171:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126596.292173:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126596.292174:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4bc6000, rc 0) 00000100:00100000:0.0:1746126596.292232:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:30657:x1830945720919552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 550us (707us total) trans 8589942738 rc 0/0 00000100:00100000:0.0:1746126596.292237:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8617 00000100:00100000:0.0:1746126596.294950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.301369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.301422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.313284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.314711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.339669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.358008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.367306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.401087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.409537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.411758:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720921728 00000100:00100000:0.0:1746126596.411765:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720921728 00002000:00100000:0.0:1746126596.411798:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ee3bb80 x1830945720921728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.411806:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3bb80 with x1830945720921728 ext(2097152->3145727) 00002000:00010000:0.0:1746126596.411810:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3bb80 00000100:00100000:0.0:1746126596.413027:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7048 00000100:00100000:0.0:1746126596.413035:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945720921728:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126596.436346:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945720921728:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23310us (24630us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126596.436353:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7048 00002000:00100000:0.0:1746126596.436361:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ee3bb80 x1830945720921728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/440 e 0 to 0 dl 1746126607 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.436368:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3bb80 with x1830945720921728 ext(2097152->3145727) 00002000:00010000:0.0:1746126596.436372:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3bb80 00000100:00100000:0.0:1746126596.437092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.438063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.439773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.443139:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.445360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.445399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.450330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.450372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.453003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.459478:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721158272:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126596.459492:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126596.459517:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945720923776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7184us (7442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.459524:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6332 00000100:00100000:0.0:1746126596.470848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.472270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.473327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.473343:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720925056 00000100:00100000:0.0:1746126596.473346:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720925056 00010000:00010000:0.0:1746126596.473366:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd9de00/0xb50e82586761018e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bcbf expref: 32 pid: 17475 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126596.487630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.489477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.492403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.495582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.523235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.527946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.537613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.545674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.563599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.563716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.569340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.572581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.589991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.595992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.604964:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945720927744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 8020us (8297us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126596.604978:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7053 00002000:00100000:0.0:1746126596.604991:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88012b161880 x1830945720927744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:357/0 lens 488/440 e 0 to 0 dl 1746126607 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.605001:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161880 with x1830945720927744 ext(2097152->3145727) 00002000:00010000:0.0:1746126596.605006:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b161880 00000100:00100000:0.0:1746126596.610743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.614525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.625774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.638447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.638488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.638533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.639169:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7055 00000100:00100000:0.0:1746126596.639176:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1963:x1830945720928640:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126596.658418:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1963:x1830945720928640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19232us (19918us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126596.658433:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7055 00002000:00100000:0.0:1746126596.658441:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012b160e00 x1830945720928640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:357/0 lens 488/440 e 0 to 0 dl 1746126607 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.658449:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b160e00 with x1830945720928640 ext(3145728->4194303) 00002000:00010000:0.0:1746126596.658455:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b160e00 00000100:00100000:0.0:1746126596.676351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.681280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.687793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.689034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.691813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.691881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.691907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.691931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.691958:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720930048 00000100:00100000:0.0:1746126596.691960:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720930048 00000100:00100000:0.0:1746126596.692226:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720930304 00000100:00100000:0.0:1746126596.692228:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720930304 00000100:00100000:0.0:1746126596.692242:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12176 00000100:00100000:0.0:1746126596.692246:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945720930048:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126596.692259:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12177 00000100:00100000:0.0:1746126596.692263:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945720930176:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126596.692269:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.692278:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e770a00/0xb50e82586761030f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bd91 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.692298:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.692299:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.692306:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e770a00/0xb50e82586761030f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd91 expref: 36 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.692320:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e770a00/0xb50e82586761030f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd91 expref: 36 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.692329:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e770a00, rc 0) 00000100:00100000:0.0:1746126596.692362:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945720930176:12345-192.168.203.2@tcp:101:cat.0 Request processed in 98us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.692370:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12177 00000100:00100000:0.0:1746126596.692380:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12178 00000100:00100000:0.0:1746126596.692384:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945720930304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126596.692390:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.692396:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e770800/0xb50e825867610316 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bd98 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.692404:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.692406:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.692409:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e770800/0xb50e825867610316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd98 expref: 37 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.692418:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e770800/0xb50e825867610316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd98 expref: 37 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.692424:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e770800, rc 0) 00000100:00100000:0.0:1746126596.692436:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945720930304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.692440:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12178 00010000:00010000:0.0:1746126596.692450:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.692456:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e770c00/0xb50e82586761031d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bd8a expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.692470:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.692472:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.692476:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e770c00/0xb50e82586761031d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd8a expref: 37 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.692526:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e770c00/0xb50e82586761031d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd8a expref: 37 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.692533:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e770c00, rc 0) 00000100:00100000:0.0:1746126596.692547:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945720930048:12345-192.168.203.2@tcp:101:cat.0 Request processed in 300us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.692551:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12176 00000100:00100000:0.0:1746126596.711989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.713520:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7059 00000100:00100000:0.0:1746126596.713527:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+38:1966:x1830945720930944:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126596.716717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.721185:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720931584 00000100:00100000:0.0:1746126596.721205:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720931584 00000100:00100000:0.0:1746126596.721259:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3577 00000100:00100000:0.0:1746126596.721268:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:30672:x1830945720931584:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126596.721500:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:30672:x1830945720931584:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 232us (1920us total) trans 8589942750 rc 0/0 00000100:00100000:0.0:1746126596.721507:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3577 00000100:00100000:0.0:1746126596.735360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.741115:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945720930560:12345-192.168.203.2@tcp:3:cat.0 Request processed in 27675us (27873us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126596.741130:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7058 00002000:00100000:0.0:1746126596.741144:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009ee38a80 x1830945720930560/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/440 e 0 to 0 dl 1746126607 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.741154:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38a80 with x1830945720930560 ext(1048576->2097151) 00002000:00010000:0.0:1746126596.741161:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee38a80 00000100:00100000:0.0:1746126596.763929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.764074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.764119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.764166:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720932096 00000100:00100000:0.0:1746126596.764175:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720932096 00002000:00100000:0.0:1746126596.764236:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8801367eb100 x1830945720932096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.764247:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb100 with x1830945720932096 ext(2097152->3145727) 00002000:00010000:0.0:1746126596.764252:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb100 00000100:00100000:0.0:1746126596.764268:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720932352 00000100:00100000:0.0:1746126596.764271:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720932352 00002000:00100000:0.0:1746126596.764281:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8801367ea680 x1830945720932352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.764288:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ea680 with x1830945720932352 ext(3145728->4194303) 00002000:00010000:0.0:1746126596.764290:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367ea680 00000100:00100000:0.0:1746126596.764311:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720932608 00000100:00100000:0.0:1746126596.764313:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720932608 00002000:00100000:0.0:1746126596.764323:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e8700 x1830945720932608/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:357/0 lens 488/0 e 0 to 0 dl 1746126607 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126596.764330:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8700 with x1830945720932608 ext(2097152->3145727) 00002000:00010000:0.0:1746126596.764332:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e8700 00000100:00100000:0.0:1746126596.764343:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7060 00000100:00100000:0.0:1746126596.764349:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945720932096:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126596.808947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.823608:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720932992 00000100:00100000:0.0:1746126596.823621:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720932992 00000100:00100000:0.0:1746126596.823677:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12179 00000100:00100000:0.0:1746126596.823688:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+32:30672:x1830945720932992:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126596.823710:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.823729:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e770600/0xb50e82586761036a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bdad expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.824121:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093417c00/0xb50e825867610109 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc56 expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.824130:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 37 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.824137:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.824139:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.824143:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e770600/0xb50e82586761036a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1052672->1683455] (req 1052672->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdad expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.824179:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 37 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.824203:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 37 pid: 20294 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126596.824218:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721159936:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126596.825953:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093417c00/0xb50e825867610109 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc56 expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.825967:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093417c00/0xb50e825867610109 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc56 expref: 33 pid: 20294 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126596.825977:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721160064:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126596.832373:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720933120 00000100:00100000:0.0:1746126596.832379:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720933120 00010000:00010000:0.0:1746126596.832410:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 36 pid: 20294 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126596.832436:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6339 00000100:00100000:0.0:1746126596.832442:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945720933120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126596.832455:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126596.832478:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 36 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.832489:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 36 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.832509:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093417600/0xb50e825867610110 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bc5d expref: 36 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.832531:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126596.832567:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945720933120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 124us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.832574:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6339 00000100:00100000:0.0:1746126596.833645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.833680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.835842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.838247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.838360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.842466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.842577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.848097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.856537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.862900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.864927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.866027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.866045:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720935424 00000100:00100000:0.0:1746126596.866048:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720935424 00010000:00010000:0.0:1746126596.866064:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e431c00/0xb50e825867610308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd83 expref: 39 pid: 17475 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746126596.866085:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6341 00000100:00100000:0.0:1746126596.866092:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+39:1965:x1830945720935424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126596.866102:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126596.866123:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e431c00/0xb50e825867610308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd83 expref: 38 pid: 17475 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126596.866133:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e431c00/0xb50e825867610308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd83 expref: 38 pid: 17475 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126596.866165:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e431c00/0xb50e825867610308 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd83 expref: 38 pid: 17475 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126596.866187:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126596.866228:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945720935424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 136us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.866233:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6341 00000100:00100000:0.0:1746126596.866775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.866787:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720935552 00000100:00100000:0.0:1746126596.866790:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720935552 00010000:00010000:0.0:1746126596.866801:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676102b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd4b expref: 32 pid: 17475 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126596.866840:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6342 00000100:00100000:0.0:1746126596.866846:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945720935552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126596.866854:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126596.866862:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676102b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd4b expref: 32 pid: 17475 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.866871:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676102b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd4b expref: 32 pid: 17475 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.866883:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676102b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd4b expref: 32 pid: 17475 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126596.866900:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.866902:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.866908:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.866916:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.866943:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126596.866954:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721160832:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126596.868169:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126596.871414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.878297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.882303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.885999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.886037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.892135:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126596.893627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.897309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.902943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.902991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.922277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126596.923117:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126596.928823:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.934995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.944480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.944517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.944550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.944573:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720937984 00000100:00100000:0.0:1746126596.944583:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720937984 00000100:00100000:0.0:1746126596.945251:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720938112 00000100:00100000:0.0:1746126596.945255:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720938112 00000100:00100000:0.0:1746126596.945280:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12189 00000100:00100000:0.0:1746126596.945286:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945720937984:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126596.945303:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.945320:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4be01 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126596.945342:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.945344:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126596.945353:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be01 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.945367:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be01 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126596.945377:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e771600, rc 0) 00000100:00100000:0.0:1746126596.945412:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945720937984:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 126us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126596.945417:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12189 00000100:00100000:0.0:1746126596.945429:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12191 00000100:00100000:0.0:1746126596.945433:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945720938240:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126596.945439:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126596.945444:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e771400/0xb50e8258676103fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4be0f expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126596.945463:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721162240:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126596.945480:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126596.945501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.945548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.945580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.960438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.980592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.987179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126596.991374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.001677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.002207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.002504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.003007:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12195 00000100:00100000:0.0:1746126597.003016:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1965:x1830945720939392:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126597.003033:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.003050:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e770000/0xb50e82586761043c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4be39 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.003101:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721162752:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126597.003166:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a300 going to sleep for 11 seconds 00000100:00080000:0.0:1746126597.003181:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746126597.003184:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126597.013677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.023909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.026328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.026358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.026395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.027789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.027849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.036481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.036539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.036582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.036610:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720940800 00000100:00100000:0.0:1746126597.036618:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720940800 00010000:00010000:0.0:1746126597.036655:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be01 expref: 19 pid: 10890 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746126597.036677:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720941056 00000100:00100000:0.0:1746126597.036679:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720941056 00010000:00010000:0.0:1746126597.036690:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5932800/0xb50e825867610099 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbe6 expref: 35 pid: 4642 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746126597.036702:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720941312 00000100:00100000:0.0:1746126597.036704:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720941312 00010000:00010000:0.0:1746126597.036712:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e431000/0xb50e8258676102d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd6e expref: 32 pid: 17475 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126597.036725:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6348 00000100:00100000:0.0:1746126597.036732:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1964:x1830945720940800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.036745:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.036767:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be01 expref: 19 pid: 10890 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126597.036777:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be01 expref: 19 pid: 10890 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126597.038015:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e771600/0xb50e8258676103f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be01 expref: 18 pid: 10890 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746126597.038036:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.038052:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945720940800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1321us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.038058:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6348 00000100:00100000:0.0:1746126597.038087:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720941440 00000100:00100000:0.0:1746126597.038090:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720941440 00002000:00100000:0.0:1746126597.038116:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1495040->2097151) req@ffff88008f1e3800 x1830945720941440/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:358/0 lens 488/0 e 0 to 0 dl 1746126608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.038126:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3800 with x1830945720941440 ext(1495040->2097151) 00010000:00010000:0.0:1746126597.038132:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 37 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.038141:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 37 pid: 20294 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746126597.038147:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1e3800 00000100:00100000:0.0:1746126597.038160:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1593 00000100:00100000:0.0:1746126597.038165:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945720941440:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126597.049473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126597.050066:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050074:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050094:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050101:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050108:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050114:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e430000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126597.050117:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050124:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050135:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050141:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e430000/0xb50e825867610474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.050210:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945720940544:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 23515us (23813us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.050217:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12200 00010000:00010000:0.0:1746126597.050237:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050243:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050255:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050260:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050266:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050270:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093997800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126597.050272:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050277:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050286:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.050292:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093997800/0xb50e825867610466 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.050317:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945720940032:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 26213us (26417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.050321:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12198 00000100:00100000:0.0:1746126597.054951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.062174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.062326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.062357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.066703:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+39:1966:x1830945720941440:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 28529us (28873us total) trans 17179872902 rc 0/0 00000100:00100000:0.0:1746126597.066714:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1593 00002000:00100000:0.0:1746126597.066725:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1495040->2097151) req@ffff88008f1e3800 x1830945720941440/t17179872902(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:358/0 lens 488/448 e 0 to 0 dl 1746126608 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.066734:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3800 with x1830945720941440 ext(1495040->2097151) 00010000:00010000:0.0:1746126597.066743:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 39 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.066754:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 39 pid: 20294 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746126597.066760:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1e3800 00000100:00100000:0.0:1746126597.077383:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720942592 00000100:00100000:0.0:1746126597.077394:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720942592 00010000:00010000:0.0:1746126597.077426:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 38 pid: 20294 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126597.077454:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6359 00000100:00100000:0.0:1746126597.077461:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+38:1965:x1830945720942592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.077474:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.077493:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 38 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.077503:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 38 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.077525:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093997400/0xb50e8258676103a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdc9 expref: 38 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.077543:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.077545:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.077549:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093417600/0xb50e82586761047b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.077557:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093417600/0xb50e82586761047b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.077577:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.077612:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945720942592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 150us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.077617:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6359 00000100:00100000:0.0:1746126597.089877:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720942720 00000100:00100000:0.0:1746126597.089888:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720942720 00010000:00010000:0.0:1746126597.089925:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e770600/0xb50e82586761036a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdad expref: 32 pid: 20294 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746126597.089958:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6360 00000100:00100000:0.0:1746126597.089966:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1965:x1830945720942720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.089981:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.090004:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008e770600/0xb50e82586761036a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1052672->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdad expref: 32 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.090017:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e770600/0xb50e82586761036a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1052672->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdad expref: 32 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.090042:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e770600/0xb50e82586761036a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1052672->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bdad expref: 32 pid: 20294 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746126597.090061:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.090063:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.090067:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090075:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090095:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.090141:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945720942720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 175us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.090151:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6360 00010000:00010000:0.0:1746126597.090177:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090185:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090219:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090227:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090235:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090241:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093997c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126597.090244:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090251:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090261:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.090266:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093997c00/0xb50e825867610482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.090308:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945720940416:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 62357us (62520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.090315:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12202 00000100:00100000:0.0:1746126597.094110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.094141:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720942976 00000100:00100000:0.0:1746126597.094150:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720942976 00000100:00100000:0.0:1746126597.094202:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8629 00000100:00100000:0.0:1746126597.094209:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:30682:x1830945720942976:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1746126597.094259:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.094288:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e431400/0xb50e825867610435 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be32 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094303:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.094307:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126597.094337:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.094349:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbbc expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094356:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da9f600/0xb50e825867610076 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbca expref: 22 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094363:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e82586761008b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbd8 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094369:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 233 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094376:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 22 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094382:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.094410:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 22 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.094421:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 22 pid: 14547 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.094434:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721164800:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.096217:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 233 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.096228:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 233 pid: 20362 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.096238:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721164928:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.096280:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e82586761008b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbd8 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.096287:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e82586761008b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbd8 expref: 233 pid: 14549 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.096294:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721165056:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.096317:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da9f600/0xb50e825867610076 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbca expref: 22 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.096323:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da9f600/0xb50e825867610076 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbca expref: 22 pid: 20362 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.096330:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721165184:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.096354:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbbc expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.096361:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbbc expref: 22 pid: 14549 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.096369:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721165312:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126597.096386:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126597.099433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.099449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.099545:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721164800:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126597.099556:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721164928:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126597.099562:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099252d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721165056:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126597.099570:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721165184:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126597.100058:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720943232 00000100:00100000:0.0:1746126597.100066:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720943232 00000100:00100000:0.0:1746126597.100080:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720943104 00000100:00100000:0.0:1746126597.100082:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720943104 00010000:00010000:0.0:1746126597.100113:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 234 pid: 20362 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.100597:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6361 00000100:00100000:0.0:1746126597.100605:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+234:1964:x1830945720943104:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.100618:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.100624:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 234 pid: 20362 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.100635:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 234 pid: 20362 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.100656:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4bc6000/0xb50e825867610213 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd05 expref: 234 pid: 20362 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.100668:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.100672:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.100680:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.100720:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+233:1964:x1830945720943104:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 116us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.100726:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6361 00010000:00010000:0.0:1746126597.100749:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 23 pid: 14547 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.100761:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6362 00000100:00100000:0.0:1746126597.100766:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945720943232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.100772:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.100776:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 23 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.100783:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 23 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.100794:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f73b800/0xb50e825867610267 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bd21 expref: 23 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.100802:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.100805:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.100809:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.100822:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945720943232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 56us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.100845:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6362 00000100:00100000:0.0:1746126597.102348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.102374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.102432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126597.104380:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417800/0xb50e82586761005a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbbc expref: 20 pid: 14549 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.104398:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721165312:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.104433:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.104448:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.104456:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec29e00/0xb50e825867610490 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000040:00080000:0.0:1746126597.105040:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2442, 88 off206736 00000004:00080000:0.0:1746126597.105048:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019219979ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105098:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2532, 88 off214752 00000004:00080000:0.0:1746126597.105103:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019275624ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105114:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2533, 88 off214840 00000004:00080000:0.0:1746126597.105117:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019289265ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105123:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2443, 88 off206824 00000004:00080000:0.0:1746126597.105125:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019297629ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105130:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2444, 88 off206912 00000004:00080000:0.0:1746126597.105133:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019305356ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105138:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2534, 88 off214928 00000004:00080000:0.0:1746126597.105141:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019313340ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105147:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2535, 88 off215016 00000004:00080000:0.0:1746126597.105150:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019322268ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105155:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2445, 88 off207000 00000004:00080000:0.0:1746126597.105158:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019330334ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105164:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2536, 88 off215104 00000004:00080000:0.0:1746126597.105166:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019338426ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105171:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2446, 88 off207088 00000004:00080000:0.0:1746126597.105174:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019346213ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105179:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2537, 88 off215192 00000004:00080000:0.0:1746126597.105182:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019354870ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105188:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2447, 88 off207176 00000004:00080000:0.0:1746126597.105202:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019374739ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105210:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2538, 88 off215280 00000004:00080000:0.0:1746126597.105212:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019384540ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105218:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2448, 88 off207264 00000004:00080000:0.0:1746126597.105222:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019394738ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.105228:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2539, 88 off215368 00000004:00080000:0.0:1746126597.105230:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019402764ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105235:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2540, 88 off215456 00000004:00080000:0.0:1746126597.105238:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719019410093ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.105244:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2449, 88 off207352 00000004:00080000:0.0:1746126597.105246:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719019418913ns, next at 687927188999ns, rc = 0 00000100:00100000:0.0:1746126597.151884:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721165696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.151908:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.151921:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721166208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.151935:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.151944:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721166720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.151956:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.151965:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721167232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.151976:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.151986:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746126597.151990:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721165568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.152023:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.152034:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721166080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.152048:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.152055:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721166592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.152067:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.152072:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721167104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.152083:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.152098:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721166592 00000100:00100000:0.0:1746126597.152100:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721166592 00000100:00100000:0.0:1746126597.152655:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12205 00000100:00100000:0.0:1746126597.152661:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3297:x1830945721165696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.153509:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830945721165696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 848us (1600us total) trans 21474840081 rc 0/0 00000100:00100000:0.0:1746126597.153514:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12205 00000100:00100000:0.0:1746126597.153524:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12209 00000100:00100000:0.0:1746126597.153528:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3297:x1830945721166720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.153638:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3297:x1830945721166720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1680us total) trans 17179872903 rc 0/0 00000100:00100000:0.0:1746126597.153643:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12209 00000100:00100000:0.0:1746126597.153653:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12210 00000100:00100000:0.0:1746126597.153658:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3295:x1830945721166976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126597.153738:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126597.153741:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126597.153743:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126597.153745:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126597.153747:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126597.153771:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3295:x1830945721166976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (1806us total) trans 17179872904 rc 0/0 00000100:00100000:0.0:1746126597.153777:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12210 00000100:00100000:0.0:1746126597.153786:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12211 00000100:00100000:0.0:1746126597.153791:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3297:x1830945721167232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.153974:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3297:x1830945721167232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (1996us total) trans 17179872905 rc 0/0 00000100:00100000:0.0:1746126597.153979:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12211 00000100:00100000:0.0:1746126597.153989:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12212 00000100:00100000:0.0:1746126597.153993:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3297:x1830945721165568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.154077:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830945721165568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (2052us total) trans 21474840082 rc 0/0 00000100:00100000:0.0:1746126597.154082:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12212 00000100:00100000:0.0:1746126597.154092:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12213 00000100:00100000:0.0:1746126597.154096:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3297:x1830945721166080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.154166:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830945721166080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (2116us total) trans 21474840083 rc 0/0 00000100:00100000:0.0:1746126597.154171:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12213 00000100:00100000:0.0:1746126597.154180:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12214 00000100:00100000:0.0:1746126597.154185:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3297:x1830945721167104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.154273:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3297:x1830945721167104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (2188us total) trans 17179872906 rc 0/0 00000100:00100000:0.0:1746126597.154278:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12214 00000100:00100000:0.0:1746126597.154287:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12215 00000100:00100000:0.0:1746126597.154291:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3297:x1830945721166592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.154376:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3297:x1830945721166592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (2307us total) trans 17179872907 rc 0/0 00000100:00100000:0.0:1746126597.154384:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12215 00000100:00100000:0.0:1746126597.154394:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12216 00000100:00100000:0.0:1746126597.154398:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3294:x1830945721165824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.154481:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3294:x1830945721165824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1790us total) trans 21474840084 rc 0/0 00000100:00100000:0.0:1746126597.154486:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12216 00000100:00100000:0.0:1746126597.154496:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12217 00000100:00100000:0.0:1746126597.154500:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3294:x1830945721166336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126597.154571:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3294:x1830945721166336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1844us total) trans 21474840085 rc 0/0 00000100:00100000:0.0:1746126597.154576:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12217 00000100:00100000:0.0:1746126597.154585:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12218 00000100:00100000:0.0:1746126597.154589:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3294:x1830945721166848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.154680:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3294:x1830945721166848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1936us total) trans 17179872908 rc 0/0 00000100:00100000:0.0:1746126597.154685:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12218 00000100:00100000:0.0:1746126597.154694:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12219 00000100:00100000:0.0:1746126597.154698:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3294:x1830945721167360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.154773:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+95:3294:x1830945721167360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (2011us total) trans 17179872909 rc 0/0 00000100:00100000:0.0:1746126597.154778:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12219 00000100:00100000:0.0:1746126597.157091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.166570:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12225 00000100:00100000:0.0:1746126597.166578:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945720944256:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126597.166591:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.166599:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800933f3600/0xb50e8258676104c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4be71 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126597.166611:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c704, atime: 0x6813c704, ctime: 0x6813c704, blocks: 0x821 00010000:00010000:0.0:1746126597.166619:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.166620:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.166625:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800933f3600/0xb50e8258676104c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be71 expref: 19 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126597.166634:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800933f3600/0xb50e8258676104c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be71 expref: 19 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126597.166640:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933f3600, rc 0) 00000100:00100000:0.0:1746126597.167164:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1963:x1830945720944256:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 586us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.167170:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12225 00000100:00100000:0.0:1746126597.167447:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720944512 00000100:00100000:0.0:1746126597.167451:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720944512 00000100:00100000:0.0:1746126597.167472:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12226 00000100:00100000:0.0:1746126597.167477:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945720944512:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126597.167484:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.167494:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4be7f expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126597.167508:0:9686:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c704, atime: 0x6813c703, ctime: 0x6813c704, blocks: 0x1641 00010000:00010000:0.0:1746126597.167518:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.167520:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.167524:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be7f expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126597.167533:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be7f expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126597.167540:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d151200, rc 0) 00000100:00100000:0.0:1746126597.167571:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945720944512:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.167576:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12226 00000100:00100000:0.0:1746126597.182663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.182700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.182711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.182975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.182990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.183004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.183092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.190771:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7076 00000100:00100000:0.0:1746126597.190782:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+21:1964:x1830945720945920:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126597.190809:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.190818:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.190819:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.190822:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.191047:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.192538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126597.200026:0:21198:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.200042:0:21198:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.200049:0:21198:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.200056:0:21198:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adb1200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126597.200060:0:21198:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.200068:0:21198:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.200086:0:21198:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.200091:0:21198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009adb1200/0xb50e8258676104dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.200164:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+23:1964:x1830945720945280:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 16761us (17458us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126597.200175:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7071 00010000:00010000:0.0:1746126597.227743:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.227756:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.227765:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.227771:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d150000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126597.227775:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.227782:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.227801:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.227807:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d150000/0xb50e825867610500 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.227900:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945720945920:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 37114us (44859us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126597.227911:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7076 00000100:00100000:0.0:1746126597.239339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.248712:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12229 00000100:00100000:0.0:1746126597.248725:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:1963:x1830945720947200:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126597.248808:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126597.248810:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.248812:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126595 -> 1746126596 00002000:00010000:0.0:1746126597.248813:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.248815:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126597.249726:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+21:1963:x1830945720947200:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 1003us (1483us total) trans 21474840088 rc 0/0 00000100:00100000:0.0:1746126597.251757:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12229 00000100:00100000:0.0:1746126597.273899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.273933:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720947712 00000100:00100000:0.0:1746126597.273940:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720947712 00010000:00010000:0.0:1746126597.273971:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932c00/0xb50e825867610497 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be55 expref: 10 pid: 14547 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.273998:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6366 00000100:00100000:0.0:1746126597.274005:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945720947712:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.274018:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.274024:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932c00/0xb50e825867610497 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be55 expref: 10 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.274035:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932c00/0xb50e825867610497 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be55 expref: 10 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.274055:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932c00/0xb50e825867610497 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be55 expref: 10 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.274074:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.274079:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68a00/0xb50e825867610515 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31004 initiator: MDT0 00010000:00010000:0.0:1746126597.274087:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68a00/0xb50e825867610515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 31004 initiator: MDT0 00010000:00010000:0.0:1746126597.274093:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68a00/0xb50e825867610515 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 31004 initiator: MDT0 00010000:00010000:0.0:1746126597.274112:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.274162:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945720947712:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 157us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.274168:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6366 00010000:00010000:0.0:1746126597.274233:0:31004:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68a00/0xb50e825867610515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31004 initiator: MDT0 00010000:00010000:0.0:1746126597.274239:0:31004:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68a00/0xb50e825867610515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31004 initiator: MDT0 00000040:00080000:0.0:1746126597.277024:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2450, 88 off207440 00000004:00080000:0.0:1746126597.277034:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191206205ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277074:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2541, 88 off215544 00000004:00080000:0.0:1746126597.277077:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191249810ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277088:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2542, 88 off215632 00000004:00080000:0.0:1746126597.277090:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191263010ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277096:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2451, 88 off207528 00000004:00080000:0.0:1746126597.277098:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191270847ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277104:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2452, 88 off207616 00000004:00080000:0.0:1746126597.277107:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191279205ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277112:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2543, 88 off215720 00000004:00080000:0.0:1746126597.277114:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191286980ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277120:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2544, 88 off215808 00000004:00080000:0.0:1746126597.277122:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191294698ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277128:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2453, 88 off207704 00000004:00080000:0.0:1746126597.277130:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191302710ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277136:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2545, 88 off215896 00000004:00080000:0.0:1746126597.277138:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191310312ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277143:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2454, 88 off207792 00000004:00080000:0.0:1746126597.277145:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191317857ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277151:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2546, 88 off215984 00000004:00080000:0.0:1746126597.277153:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191325717ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277159:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2455, 88 off207880 00000004:00080000:0.0:1746126597.277161:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191333985ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277167:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2547, 88 off216072 00000004:00080000:0.0:1746126597.277170:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191342708ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277176:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2456, 88 off207968 00000004:00080000:0.0:1746126597.277178:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191350597ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126597.277184:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2548, 88 off216160 00000004:00080000:0.0:1746126597.277186:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191358535ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277220:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2549, 88 off216248 00000004:00080000:0.0:1746126597.277224:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 719191395910ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126597.277231:0:31004:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2457, 88 off208056 00000004:00080000:0.0:1746126597.277233:0:31004:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719191405892ns, next at 687927188999ns, rc = 0 00000004:00010000:0.0:1746126597.311002:0:31004:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a553e050 reply state ffff88008f02c000 transno 8589942759 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68a00/0xb50e825867610515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31004 initiator: MDT0 00000100:00100000:0.0:1746126597.311016:0:31004:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746126597.311024:0:31004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.311026:0:31004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126597.311034:0:31004:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e431e00/0xb50e825867610458 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be4e expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746126597.311111:0:31004:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746126597.311120:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a553e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:30682:x1830945720947584:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 49774us (49932us total) trans 8589942759 rc 0/0 00000100:00100000:0.0:1746126597.311127:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3581 00000100:00100000:0.0:1746126597.311341:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721169152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311362:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.311378:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721169664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311390:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.311399:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746126597.311402:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721169024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311416:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.311423:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721169536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311433:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126597.311447:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169152 00000100:00100000:0.0:1746126597.311449:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169152 00000100:00100000:0.0:1746126597.311468:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169664 00000100:00100000:0.0:1746126597.311469:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169664 00000100:00100000:0.0:1746126597.311479:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169024 00000100:00100000:0.0:1746126597.311480:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169024 00000100:00100000:0.0:1746126597.311485:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169536 00000100:00100000:0.0:1746126597.311487:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169536 00000100:00100000:0.0:1746126597.311493:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12241 00000100:00100000:0.0:1746126597.311497:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3295:x1830945721169152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311625:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3295:x1830945721169152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (262us total) trans 17179872915 rc 0/0 00000100:00100000:0.0:1746126597.311630:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12241 00000100:00100000:0.0:1746126597.311639:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12242 00000100:00100000:0.0:1746126597.311643:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3295:x1830945721169664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311726:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3295:x1830945721169664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (334us total) trans 17179872916 rc 0/0 00000100:00100000:0.0:1746126597.311731:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12242 00000100:00100000:0.0:1746126597.311739:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12243 00000100:00100000:0.0:1746126597.311743:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3295:x1830945721169024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.311821:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872895 gen 2 00000004:00080000:0.0:1746126597.311840:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3fb80, transno 17179872800 00000004:00080000:0.0:1746126597.311845:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3e300, transno 17179872801 00000004:00080000:0.0:1746126597.311847:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3c000, transno 17179872802 00000004:00080000:0.0:1746126597.311850:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3f800, transno 17179872803 00000004:00080000:0.0:1746126597.311852:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3df80, transno 17179872804 00000004:00080000:0.0:1746126597.311854:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3ca80, transno 17179872805 00000004:00080000:0.0:1746126597.311857:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fdc00, transno 17179872806 00000004:00080000:0.0:1746126597.311859:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3ed80, transno 17179872807 00000004:00080000:0.0:1746126597.311861:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2ff100, transno 17179872808 00000004:00080000:0.0:1746126597.311863:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2a00, transno 17179872812 00000004:00080000:0.0:1746126597.312199:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2300, transno 17179872813 00000004:00080000:0.0:1746126597.312203:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d919880, transno 17179872814 00000004:00080000:0.0:1746126597.312205:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d91aa00, transno 17179872815 00000004:00080000:0.0:1746126597.312207:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d918380, transno 17179872816 00000004:00080000:0.0:1746126597.312210:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d918a80, transno 17179872817 00000004:00080000:0.0:1746126597.312212:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1f80, transno 17179872818 00000004:00080000:0.0:1746126597.312215:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d91bb80, transno 17179872819 00000004:00080000:0.0:1746126597.312217:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d919c00, transno 17179872820 00000004:00080000:0.0:1746126597.312220:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a448d500, transno 17179872821 00000004:00080000:0.0:1746126597.312222:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a448fb80, transno 17179872822 00000004:00080000:0.0:1746126597.312225:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5967480, transno 17179872823 00000004:00080000:0.0:1746126597.312228:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d7480, transno 17179872824 00000004:00080000:0.0:1746126597.312230:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b1a4000, transno 17179872825 00000004:00080000:0.0:1746126597.312232:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a448d880, transno 17179872826 00000004:00080000:0.0:1746126597.312234:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5967b80, transno 17179872827 00000004:00080000:0.0:1746126597.312236:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a448dc00, transno 17179872828 00000004:00080000:0.0:1746126597.312239:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad1180, transno 17179872829 00000004:00080000:0.0:1746126597.312242:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b2680, transno 17179872832 00000004:00080000:0.0:1746126597.312244:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b2d80, transno 17179872833 00000004:00080000:0.0:1746126597.312246:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b3480, transno 17179872834 00000004:00080000:0.0:1746126597.312248:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b3b80, transno 17179872835 00000004:00080000:0.0:1746126597.312250:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b2a00, transno 17179872836 00000004:00080000:0.0:1746126597.312252:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b3800, transno 17179872837 00000004:00080000:0.0:1746126597.312255:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e582a00, transno 17179872838 00000004:00080000:0.0:1746126597.312257:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099250a80, transno 17179872839 00000004:00080000:0.0:1746126597.312260:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b3100, transno 17179872840 00000004:00080000:0.0:1746126597.312262:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad3100, transno 17179872844 00000004:00080000:0.0:1746126597.312264:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad3b80, transno 17179872845 00000004:00080000:0.0:1746126597.312265:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad1880, transno 17179872846 00000004:00080000:0.0:1746126597.312267:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad2a00, transno 17179872847 00000004:00080000:0.0:1746126597.312269:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad2680, transno 17179872848 00000004:00080000:0.0:1746126597.312271:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099251880, transno 17179872849 00000004:00080000:0.0:1746126597.312274:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad1f80, transno 17179872850 00000004:00080000:0.0:1746126597.312276:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad1c00, transno 17179872851 00000004:00080000:0.0:1746126597.312278:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad0700, transno 17179872852 00000004:00080000:0.0:1746126597.312280:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e581880, transno 17179872853 00000004:00080000:0.0:1746126597.312283:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e582300, transno 17179872854 00000004:00080000:0.0:1746126597.312285:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e580700, transno 17179872855 00000004:00080000:0.0:1746126597.312288:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e581c00, transno 17179872856 00000004:00080000:0.0:1746126597.312290:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e583100, transno 17179872857 00000004:00080000:0.0:1746126597.312292:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e581500, transno 17179872858 00000004:00080000:0.0:1746126597.312295:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e583480, transno 17179872859 00000004:00080000:0.0:1746126597.312297:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e580a80, transno 17179872860 00000004:00080000:0.0:1746126597.312299:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17b80, transno 17179872861 00000004:00080000:0.0:1746126597.312302:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14000, transno 17179872866 00000004:00080000:0.0:1746126597.312304:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15880, transno 17179872867 00000004:00080000:0.0:1746126597.312496:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14700, transno 17179872868 00000004:00080000:0.0:1746126597.312500:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14e00, transno 17179872869 00000004:00080000:0.0:1746126597.312502:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e3abb80, transno 17179872870 00000004:00080000:0.0:1746126597.312505:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14a80, transno 17179872871 00000004:00080000:0.0:1746126597.312507:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b16680, transno 17179872872 00000004:00080000:0.0:1746126597.312509:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15500, transno 17179872873 00000004:00080000:0.0:1746126597.312512:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17100, transno 17179872874 00000004:00080000:0.0:1746126597.312514:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e3a8a80, transno 17179872878 00000004:00080000:0.0:1746126597.312516:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0000, transno 17179872879 00000004:00080000:0.0:1746126597.312518:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e3b80, transno 17179872880 00000004:00080000:0.0:1746126597.312520:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1180, transno 17179872881 00000004:00080000:0.0:1746126597.312522:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e723800, transno 17179872882 00000004:00080000:0.0:1746126597.312524:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1500, transno 17179872883 00000004:00080000:0.0:1746126597.312526:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2680, transno 17179872884 00000004:00080000:0.0:1746126597.312528:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0380, transno 17179872885 00000004:00080000:0.0:1746126597.312530:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0700, transno 17179872886 00000004:00080000:0.0:1746126597.312532:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcf480, transno 17179872887 00000004:00080000:0.0:1746126597.312535:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcdc00, transno 17179872888 00000004:00080000:0.0:1746126597.312538:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcea00, transno 17179872889 00000004:00080000:0.0:1746126597.312540:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcfb80, transno 17179872890 00000004:00080000:0.0:1746126597.312543:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcc380, transno 17179872891 00000004:00080000:0.0:1746126597.312545:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c9c00, transno 17179872892 00000004:00080000:0.0:1746126597.312612:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcd500, transno 17179872893 00000004:00080000:0.0:1746126597.312615:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcca80, transno 17179872894 00000004:00080000:0.0:1746126597.312618:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee3ad80, transno 17179872895 00000100:00100000:0.0:1746126597.312625:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008e722680 x1830945721166720/t17179872903(17179872903) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126613 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746126597.312635:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134c7ca80/2, rc 0, transno 17179872915 00000100:00100000:0.0:1746126597.312640:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721169152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126597.312909:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099250380/2, rc 0, transno 17179872916 00000100:00100000:0.0:1746126597.312913:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721169664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126597.314711:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 17 in progress, 6 in flight, 81 done 00000100:00100000:0.0:1746126597.316196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.318412:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721168896 00000100:00100000:0.0:1746126597.318417:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721168896 00000100:00100000:0.0:1746126597.318440:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169408 00000100:00100000:0.0:1746126597.318442:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169408 00000100:00100000:0.0:1746126597.318454:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12248 00000100:00100000:0.0:1746126597.318459:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721168896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126597.318576:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126597.318579:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.318581:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.318582:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.318584:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126597.318613:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3297:x1830945721168896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (578us total) trans 17179872922 rc 0/0 00000100:00100000:0.0:1746126597.318620:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12248 00000100:00100000:0.0:1746126597.318632:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12249 00000100:00100000:0.0:1746126597.318638:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721169408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126597.318717:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3297:x1830945721169408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (610us total) trans 17179872923 rc 0/0 00000100:00100000:0.0:1746126597.318722:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12249 00000100:00100000:0.0:1746126597.331301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.331335:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720948096 00000100:00100000:0.0:1746126597.331345:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720948096 00000100:00100000:0.0:1746126597.331404:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3582 00000100:00100000:0.0:1746126597.331412:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:30682:x1830945720948096:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1746126597.331659:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30682:x1830945720948096:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 247us (367us total) trans 8589942760 rc 0/0 00000100:00100000:0.0:1746126597.331666:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3582 00000100:00100000:0.0:1746126597.360528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.364881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.365966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.372869:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.382803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.382864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.382881:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720949888 00000100:00100000:0.0:1746126597.382884:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720949888 00010000:00010000:0.0:1746126597.382901:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098e41200/0xb50e825867610538 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be94 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.382917:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6368 00000100:00100000:0.0:1746126597.382923:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:1964:x1830945720949888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.382931:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.382935:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098e41200/0xb50e825867610538 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be94 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.382944:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098e41200/0xb50e825867610538 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be94 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.383092:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098e41200/0xb50e825867610538 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be94 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.383111:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.383116:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68c00/0xb50e825867610577 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.383125:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68c00/0xb50e825867610577 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.383137:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad68c00/0xb50e825867610577 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126597.383152:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.383243:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+222:1964:x1830945720949888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 319us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.383249:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6368 00000100:00100000:0.0:1746126597.393609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.408329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.408444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.418567:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720950528 00000100:00100000:0.0:1746126597.418577:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720950528 00000100:00100000:0.0:1746126597.418630:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8638 00000100:00100000:0.0:1746126597.418638:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+222:30696:x1830945720950528:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126597.418660:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.418678:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bec5 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.418731:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bec5 expref: 223 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.418742:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bec5 expref: 223 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.418757:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.418760:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126597.418763:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed55c00, rc 0) 00000100:00100000:0.0:1746126597.418814:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:30696:x1830945720950528:12345-192.168.203.2@tcp:101:cat.0 Request processed in 176us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.418819:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8638 00000100:00100000:0.0:1746126597.421916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.432996:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720950912 00000100:00100000:0.0:1746126597.433010:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720950912 00000100:00100000:0.0:1746126597.433081:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12253 00000100:00100000:0.0:1746126597.433090:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+5:30694:x1830945720950912:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126597.433111:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.433132:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed55000/0xb50e8258676105a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4becc expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.433158:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.433161:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.433168:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed55000/0xb50e8258676105a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4becc expref: 6 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.433182:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed55000/0xb50e8258676105a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4becc expref: 6 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.433202:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed55000, rc 0) 00000100:00100000:0.0:1746126597.433254:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+6:30694:x1830945720950912:12345-192.168.203.2@tcp:101:cat.0 Request processed in 165us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.433260:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12253 00000100:00100000:0.0:1746126597.434444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.441041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.442683:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.442701:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720951424 00000100:00100000:0.0:1746126597.444069:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720951424 00010000:00010000:0.0:1746126597.444099:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bec5 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.444132:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6369 00000100:00100000:0.0:1746126597.444139:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:1966:x1830945720951424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.444150:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.444156:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bec5 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.444165:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bec5 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.444203:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e82586761059a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bec5 expref: 223 pid: 14547 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.444221:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.444225:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5c00/0xb50e8258676105af lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126597.444233:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5c00/0xb50e8258676105af lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126597.444238:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.445028:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+222:1966:x1830945720951424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 886us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.445036:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6369 00000100:00100000:0.0:1746126597.445779:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720951552 00000100:00100000:0.0:1746126597.445786:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720951552 00010000:00010000:0.0:1746126597.445814:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95200/0xb50e82586761051c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be8d expref: 8 pid: 20362 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.445903:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6370 00000100:00100000:0.0:1746126597.445913:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945720951552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.445927:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.445934:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95200/0xb50e82586761051c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be8d expref: 8 pid: 20362 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.445944:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95200/0xb50e82586761051c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be8d expref: 8 pid: 20362 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.445971:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95200/0xb50e82586761051c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be8d expref: 8 pid: 20362 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.445984:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126597.445989:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5c00/0xb50e8258676105af lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126597.445998:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5c00/0xb50e8258676105af lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126597.446005:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5c00/0xb50e8258676105af lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126597.446029:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126597.446068:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945720951552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 156us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.446075:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6370 00000100:00100000:0.0:1746126597.453957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.490114:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721171968 00000100:00100000:0.0:1746126597.490122:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721171968 00000100:00100000:0.0:1746126597.490163:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12268 00000100:00100000:0.0:1746126597.490168:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721171968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126597.490352:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126597.490355:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.490358:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.490359:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126597.490361:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746126597.490387:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830945721171968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (1971us total) trans 17179872929 rc 0/0 00000100:00100000:0.0:1746126597.490394:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12268 00000100:00100000:0.0:1746126597.492208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.492226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.492958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.500259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.500518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.501054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.501113:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720952704 00000100:00100000:0.0:1746126597.501116:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720952704 00000100:00100000:0.0:1746126597.501142:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12272 00000100:00100000:0.0:1746126597.501146:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+19:30690:x1830945720952704:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126597.501160:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.501173:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bef6 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.501208:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 11 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126597.501215:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.501217:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.501220:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 20 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.501247:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 11 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126597.501258:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 11 pid: 23766 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746126597.501271:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721172864:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126597.501324:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126597.502373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.502405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.508918:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720953344 00000100:00100000:0.0:1746126597.508927:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720953344 00000100:00100000:0.0:1746126597.508975:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12273 00000100:00100000:0.0:1746126597.508983:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:30692:x1830945720953344:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126597.509000:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126597.509017:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676105d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4befd expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.509041:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.509047:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.509053:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126597.509055:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676105d9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2748416->3145727] (req 2748416->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4befd expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.509090:0:4641:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.509103:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676105d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2748416->3145727] (req 2748416->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4befd expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.509118:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b732800, rc 0) 00000100:00100000:0.0:1746126597.509150:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30692:x1830945720953344:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 168us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.509157:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12273 00000100:00100000:0.0:1746126597.509282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.509302:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720953472 00000100:00100000:0.0:1746126597.509305:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720953472 00010000:00010000:0.0:1746126597.509320:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 12 pid: 23766 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746126597.513818:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6371 00000100:00100000:0.0:1746126597.513862:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945720953472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.513901:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.513947:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 12 pid: 23766 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746126597.513967:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 12 pid: 23766 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746126597.513999:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.514001:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.514009:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60080000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.514017:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60080000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.514061:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.514074:0:9817:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x70000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.514087:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721173120:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126597.514216:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084540 going to sleep for 11 seconds 00010000:00010000:0.0:1746126597.514263:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676104c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be86 expref: 12 pid: 23766 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746126597.514276:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721172864:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.514302:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.514309:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.514318:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927e0600, rc 0) 00000100:00100000:0.0:1746126597.514342:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+22:30690:x1830945720952704:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 13193us (13286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126597.514349:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12272 00000100:00100000:0.0:1746126597.530760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.536487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.543572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.543609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.543647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.543680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.544743:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720955008 00000100:00100000:0.0:1746126597.544748:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720955008 00010000:00010000:0.0:1746126597.544775:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be7f expref: 11 pid: 9686 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746126597.544806:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720955136 00000100:00100000:0.0:1746126597.544808:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720955136 00010000:00010000:0.0:1746126597.544820:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e8258676105d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bef6 expref: 22 pid: 20294 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.544851:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6372 00000100:00100000:0.0:1746126597.544857:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945720955008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.544867:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.544884:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be7f expref: 11 pid: 9686 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746126597.544894:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be7f expref: 11 pid: 9686 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746126597.544914:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d151200/0xb50e8258676104cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4be7f expref: 11 pid: 9686 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746126597.544946:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.544949:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.544956:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dc1ba00/0xb50e8258676105e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3731455) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf04 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.544964:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dc1ba00/0xb50e8258676105e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3731455) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf04 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.544996:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dc1ba00/0xb50e8258676105e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf04 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.545008:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721173376:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126597.545087:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126597.556359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.558604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.564939:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.571064:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.571109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.571150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.575800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.577250:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7087 00000100:00100000:0.0:1746126597.577263:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945720956672:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126597.595029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.603333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.614519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.617898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.617941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.623261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.623317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.656503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.656950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.656982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.657017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.664312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.664344:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720959360 00000100:00100000:0.0:1746126597.664352:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720959360 00002000:00100000:0.0:1746126597.664396:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3297279) req@ffff880135bcdf80 x1830945720959360/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:358/0 lens 488/0 e 0 to 0 dl 1746126608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.664406:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcdf80 with x1830945720959360 ext(3145728->3297279) 00010000:00010000:0.0:1746126597.664415:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0600/0xb50e8258676105fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf20 expref: 10 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.664429:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0600/0xb50e8258676105fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf20 expref: 10 pid: 8438 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746126597.664436:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135bcdf80 00000100:00100000:0.0:1746126597.664463:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1601 00000100:00100000:0.0:1746126597.664470:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945720959360:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126597.692068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.692654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.696865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.700267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.700316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.700357:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720960384 00000100:00100000:0.0:1746126597.700366:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720960384 00002000:00100000:0.0:1746126597.700412:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880135bcc700 x1830945720960384/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:358/0 lens 488/0 e 0 to 0 dl 1746126608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.700421:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc700 with x1830945720960384 ext(3145728->4194303) 00002000:00010000:0.0:1746126597.700427:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcc700 00000100:00100000:0.0:1746126597.700454:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720960256 00000100:00100000:0.0:1746126597.700457:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720960256 00002000:00100000:0.0:1746126597.700470:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135bcf480 x1830945720960256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:358/0 lens 488/0 e 0 to 0 dl 1746126608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.700475:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf480 with x1830945720960256 ext(3145728->4194303) 00002000:00010000:0.0:1746126597.700478:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcf480 00000100:00100000:0.0:1746126597.700490:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7096 00000100:00100000:0.0:1746126597.700495:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945720960384:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126597.720340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.720390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.766618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.777403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.792678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.805355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.819457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.832684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.836662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.838319:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721175168:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126597.838344:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867610673 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3235840->3629055] (req 3235840->3629055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf5f expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.838356:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18c00, rc 0) 00000100:00100000:0.0:1746126597.840964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.841030:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720962816 00000100:00100000:0.0:1746126597.841037:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720962816 00010000:00010000:0.0:1746126597.841063:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef29c00/0xb50e825867610603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf27 expref: 22 pid: 8438 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126597.841098:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6381 00000100:00100000:0.0:1746126597.841104:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945720962816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126597.841116:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126597.841136:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef29c00/0xb50e825867610603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf27 expref: 22 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.841147:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef29c00/0xb50e825867610603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf27 expref: 22 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.841167:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef29c00/0xb50e825867610603 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf27 expref: 22 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126597.841195:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.841197:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126597.841203:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867610673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3629055) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf5f expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.841210:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867610673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3629055) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf5f expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126597.841237:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867610673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3629055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf5f expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126597.841252:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721175296:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126597.841315:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126597.845484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.864056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.864680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.869959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.870011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.878446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.888317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.888362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.888607:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7103 00000100:00100000:0.0:1746126597.888618:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945720964736:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126597.911908:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945720964736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23284us (23590us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126597.911921:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7103 00002000:00100000:0.0:1746126597.911932:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093df5500 x1830945720964736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:358/0 lens 488/440 e 0 to 0 dl 1746126608 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.911941:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5500 with x1830945720964736 ext(0->1048575) 00002000:00010000:0.0:1746126597.911947:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df5500 00000100:00100000:0.0:1746126597.921946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.924886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.932116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.937217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.966699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.966755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126597.967548:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7107 00000100:00100000:0.0:1746126597.967558:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945720966016:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126597.991197:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945720966016:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23628us (24427us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126597.991209:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7107 00002000:00100000:0.0:1746126597.991221:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009204ca80 x1830945720966016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:358/0 lens 488/440 e 0 to 0 dl 1746126608 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126597.991230:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ca80 with x1830945720966016 ext(2097152->3145727) 00002000:00010000:0.0:1746126597.991236:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204ca80 00000100:00100000:0.0:1746126598.004705:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.004760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126598.005562:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126598.026089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.029648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.034677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.046105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.046669:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945720967680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16236us (17026us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126598.046680:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7110 00002000:00100000:0.0:1746126598.046691:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009204df80 x1830945720967680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:359/0 lens 488/440 e 0 to 0 dl 1746126609 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.046700:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204df80 with x1830945720967680 ext(1048576->2097151) 00002000:00010000:0.0:1746126598.046705:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204df80 00000100:00100000:0.0:1746126598.059258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.059300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.059326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.059635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.059744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.060059:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720968832 00000100:00100000:0.0:1746126598.060062:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720968832 00010000:00010000:0.0:1746126598.060079:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c066800/0xb50e8258676105ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf12 expref: 17 pid: 23766 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126598.060091:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6384 00000100:00100000:0.0:1746126598.060096:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945720968576:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126598.060102:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126598.060121:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c067400/0xb50e8258676105f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf19 expref: 11 pid: 8437 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126598.060130:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c067400/0xb50e8258676105f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf19 expref: 11 pid: 8437 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126598.060150:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c067400/0xb50e8258676105f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf19 expref: 11 pid: 8437 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126598.060168:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126598.060193:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945720968576:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.060569:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6384 00000100:00100000:0.0:1746126598.060583:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 647 00000100:00100000:0.0:1746126598.060588:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945720968960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126598.060596:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126598.062499:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb3a600/0xb50e82586761071b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf97 expref: 18 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.062521:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126598.062525:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126598.062574:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945720968960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1983us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.062582:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 647 00000100:00100000:0.0:1746126598.066423:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720969344 00000100:00100000:0.0:1746126598.066434:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720969344 00000100:00100000:0.0:1746126598.071677:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720969728 00000100:00100000:0.0:1746126598.071684:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720969728 00000100:00100000:0.0:1746126598.071713:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12292 00000100:00100000:0.0:1746126598.071720:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:30718:x1830945720969728:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126598.071731:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.071744:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec07c00/0xb50e825867610730 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bfac expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.071765:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126598.071769:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a200/0xb50e825867610729 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfa5 expref: 13 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.071774:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126598.071777:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec07c00/0xb50e825867610730 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [2068480->2097151] (req 2068480->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfac expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.071803:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a200/0xb50e825867610729 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfa5 expref: 13 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.071814:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec07c00/0xb50e825867610730 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [2068480->2097151] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfac expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.071820:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec07c00, rc 0) 00000100:00100000:0.0:1746126598.071850:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:30718:x1830945720969728:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 131us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.071854:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12292 00000100:00100000:0.0:1746126598.079532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.079595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.086740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.086797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.086859:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720970368 00000100:00100000:0.0:1746126598.086867:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720970368 00010000:00010000:0.0:1746126598.086904:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e87c00/0xb50e82586761061f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf43 expref: 12 pid: 8438 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126598.086935:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720970240 00000100:00100000:0.0:1746126598.086937:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720970240 00010000:00010000:0.0:1746126598.086947:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e86e00/0xb50e82586761060a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf2e expref: 13 pid: 8438 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746126598.087852:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6386 00000100:00100000:0.0:1746126598.087861:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945720970368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126598.087874:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126598.087897:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880130e87c00/0xb50e82586761061f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf43 expref: 13 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126598.087910:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e87c00/0xb50e82586761061f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf43 expref: 13 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126598.087933:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e87c00/0xb50e82586761061f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bf43 expref: 13 pid: 8438 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746126598.088036:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126598.088057:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945720970368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 198us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.088248:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6386 00000100:00100000:0.0:1746126598.091902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.093954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.094544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.098721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.099342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.121742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.121914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.121935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.121950:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720971776 00000100:00100000:0.0:1746126598.121952:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720971776 00000100:00100000:0.0:1746126598.122227:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12295 00000100:00100000:0.0:1746126598.122232:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945720971648:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126598.122273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126598.122492:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.122500:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093997000/0xb50e82586761074c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bfc1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.122531:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721177472:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126598.122563:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.122576:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720971904 00000100:00100000:0.0:1746126598.122579:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720971904 00010000:00010000:0.0:1746126598.122597:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a200/0xb50e825867610729 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfa5 expref: 12 pid: 4641 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746126598.122624:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6390 00000100:00100000:0.0:1746126598.122629:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945720971904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126598.122637:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126598.122659:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a200/0xb50e825867610729 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfa5 expref: 12 pid: 4641 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746126598.122668:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a200/0xb50e825867610729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfa5 expref: 12 pid: 4641 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746126598.122685:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a200/0xb50e825867610729 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfa5 expref: 12 pid: 4641 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746126598.122705:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.122706:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.122713:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec07c00/0xb50e825867610730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfac expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.122724:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec07c00/0xb50e825867610730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfac expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.122747:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec07c00/0xb50e825867610730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfac expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.122756:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721177600:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126598.122773:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.124380:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721177600:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126598.124401:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126598.124423:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945720971904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1794us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.124430:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6390 00000100:00100000:0.0:1746126598.124506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.124553:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720972160 00000100:00100000:0.0:1746126598.124558:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720972160 00002000:00100000:0.0:1746126598.124588:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (2068480->2072575) req@ffff8800937b9c00 x1830945720972160/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.124597:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9c00 with x1830945720972160 ext(2068480->2072575) 00002000:00010000:0.0:1746126598.124601:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9c00 00000100:00100000:0.0:1746126598.124624:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7112 00000100:00100000:0.0:1746126598.124629:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945720972160:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126598.124757:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945720972160:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 128us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126598.124762:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7112 00002000:00100000:0.0:1746126598.124767:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (2068480->2072575) req@ffff8800937b9c00 x1830945720972160/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746126609 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.124774:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9c00 with x1830945720972160 ext(2068480->2072575) 00002000:00010000:0.0:1746126598.124776:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9c00 00000100:00100000:0.0:1746126598.126875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.126910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.132532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.138460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.143878:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.161275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.163397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.163455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.169718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.169767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.169876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.175639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.175680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.175701:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720974336 00000100:00100000:0.0:1746126598.175710:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720974336 00000100:00100000:0.0:1746126598.177373:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720974464 00000100:00100000:0.0:1746126598.177378:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720974464 00000100:00100000:0.0:1746126598.177403:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720974592 00000100:00100000:0.0:1746126598.177405:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720974592 00000100:00100000:0.0:1746126598.179676:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12300 00000100:00100000:0.0:1746126598.179687:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945720974336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.179703:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.179717:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093996000/0xb50e82586761078b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4bfeb expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.179770:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721178368:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126598.179820:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.179880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126598.182161:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126596 -> 1746126597 00000100:00100000:0.0:1746126598.182176:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721178368:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126598.182215:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093996000/0xb50e82586761078b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfeb expref: 21 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.182226:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093996000/0xb50e82586761078b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bfeb expref: 21 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.182249:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093996000, rc 0) 00000100:00100000:0.0:1746126598.184076:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945720974336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4384us (8438us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126598.184086:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12300 00000100:00100000:0.0:1746126598.184329:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721178624:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126598.184355:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a400/0xb50e825867610799 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bff2 expref: 19 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.184368:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb3a400/0xb50e825867610799 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bff2 expref: 19 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.184378:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb3a400, rc 0) 00000100:00100000:0.0:1746126598.184402:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945720974464:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4171us (8721us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126598.184409:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12301 00000100:00100000:0.0:1746126598.191146:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720974848 00000100:00100000:0.0:1746126598.191150:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720974848 00000100:00100000:0.0:1746126598.191173:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720975104 00000100:00100000:0.0:1746126598.191175:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720975104 00000100:00100000:0.0:1746126598.191202:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720974976 00000100:00100000:0.0:1746126598.191205:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720974976 00000100:00100000:0.0:1746126598.191219:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12303 00000100:00100000:0.0:1746126598.191224:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945720974848:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.191237:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.191251:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093997a00/0xb50e8258676107a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c000 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.191281:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721178880:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126598.191536:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.191553:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12304 00000100:00100000:0.0:1746126598.191559:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945720975104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.191565:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.191573:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093996a00/0xb50e8258676107a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c00e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.191583:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.191584:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.191589:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093996a00/0xb50e8258676107a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c00e expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.191600:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093996a00/0xb50e8258676107a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c00e expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.191609:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093996a00, rc 0) 00000100:00100000:0.0:1746126598.191629:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945720975104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 70us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.191634:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12304 00000100:00100000:0.0:1746126598.191649:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12305 00000100:00100000:0.0:1746126598.191654:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945720974976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.191660:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.191666:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093997200/0xb50e8258676107ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c007 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.191689:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721179008:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126598.191707:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.202205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.202821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.205587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.205607:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720975872 00000100:00100000:0.0:1746126598.205613:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720975872 00002000:00100000:0.0:1746126598.205644:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880092208000 x1830945720975872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.205653:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208000 with x1830945720975872 ext(3145728->4194303) 00002000:00010000:0.0:1746126598.205658:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092208000 00000100:00100000:0.0:1746126598.205678:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7116 00000100:00100000:0.0:1746126598.205683:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945720975872:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126598.208596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.226405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.238443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.244163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.244272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.245719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.248616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.250235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.250263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.262389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.265179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.268688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.270759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.271380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.273298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.281463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.290362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.290400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.290487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.290562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.313312:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945720979456:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21781us (22949us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126598.313323:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7121 00002000:00100000:0.0:1746126598.313333:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dabaa00 x1830945720979456/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:359/0 lens 488/440 e 0 to 0 dl 1746126609 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.313342:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabaa00 with x1830945720979456 ext(2097152->3145727) 00002000:00010000:0.0:1746126598.313348:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabaa00 00000100:00100000:0.0:1746126598.315357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.321659:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945720979968:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25445us (31165us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126598.321668:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7123 00002000:00100000:0.0:1746126598.321674:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008dab8e00 x1830945720979968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:359/0 lens 488/440 e 0 to 0 dl 1746126609 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.321682:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8e00 with x1830945720979968 ext(3145728->4194303) 00002000:00010000:0.0:1746126598.321686:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab8e00 00000100:00100000:0.0:1746126598.324705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.324760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.324848:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3596 00000100:00100000:0.0:1746126598.324858:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:30729:x1830945720980608:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126598.325125:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:30729:x1830945720980608:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 269us (429us total) trans 8589942784 rc 0/0 00000100:00100000:0.0:1746126598.325131:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3596 00000100:00100000:0.0:1746126598.326594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.329395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.339733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.345563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.350993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.361063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.369004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.375334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.390677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126598.390911:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126598.396936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.401938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.405204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.405541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.405578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.405609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.405645:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720983296 00000100:00100000:0.0:1746126598.405652:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720983296 00000100:00100000:0.0:1746126598.405684:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720983552 00000100:00100000:0.0:1746126598.405685:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720983552 00000100:00100000:0.0:1746126598.405695:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720983680 00000100:00100000:0.0:1746126598.405697:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720983680 00000100:00100000:0.0:1746126598.405708:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12315 00000100:00100000:0.0:1746126598.405714:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945720983296:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126598.405727:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.405741:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f1f8000/0xb50e825867610856 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c069 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.405782:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721180928:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126598.405868:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.405884:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12318 00000100:00100000:0.0:1746126598.405891:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945720983424:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126598.405898:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.405907:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c070 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.405919:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.405921:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.405928:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.406358:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.406371:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a98c00, rc 0) 00000100:00100000:0.0:1746126598.406406:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945720983424:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 515us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.406411:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12318 00000100:00100000:0.0:1746126598.415880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.423166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.426669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.430310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.436943:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720984960 00000100:00100000:0.0:1746126598.436947:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720984960 00000100:00100000:0.0:1746126598.436966:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720985216 00000100:00100000:0.0:1746126598.436968:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720985216 00000100:00100000:0.0:1746126598.436978:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720984576 00000100:00100000:0.0:1746126598.436980:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720984576 00000100:00100000:0.0:1746126598.436988:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720984832 00000100:00100000:0.0:1746126598.436990:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720984832 00000100:00100000:0.0:1746126598.436998:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720985088 00000100:00100000:0.0:1746126598.436999:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720985088 00000100:00100000:0.0:1746126598.437008:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12320 00000100:00100000:0.0:1746126598.437012:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945720984960:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126598.437031:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98400/0xb50e8258676108aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.437042:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c59200/0xb50e8258676107ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c023 expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.437048:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 13 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.437055:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57e3200/0xb50e8258676107b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c015 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.437061:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.437062:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.437064:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98400/0xb50e8258676108aa lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.437079:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57e3200/0xb50e8258676107b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c015 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.437088:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57e3200/0xb50e8258676107b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c015 expref: 19 pid: 8438 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746126598.437097:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721181312:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.437174:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 13 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.437195:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 13 pid: 4641 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.437203:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721181440:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.438451:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c59200/0xb50e8258676107ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c023 expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.438460:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c59200/0xb50e8258676107ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c023 expref: 14 pid: 8438 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.438469:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721181952:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126598.438488:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.438521:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12323 00000100:00100000:0.0:1746126598.438530:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945720984832:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126598.438552:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.438562:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c59c00/0xb50e8258676107e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c02a expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.438567:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126598.438568:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126598.438570:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.440361:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c59c00/0xb50e8258676107e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->1863679) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c02a expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.440370:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c59c00/0xb50e8258676107e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->1863679) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c02a expref: 23 pid: 8437 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746126598.440380:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721182336:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126598.440576:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.454233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.454310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.454323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.454335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.454358:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720985344 00000100:00100000:0.0:1746126598.454367:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720985344 00010000:00010000:0.0:1746126598.454403:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 14 pid: 4641 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.454427:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720985600 00000100:00100000:0.0:1746126598.454429:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720985600 00010000:00010000:0.0:1746126598.454439:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed55000/0xb50e8258676105a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4becc expref: 11 pid: 20294 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746126598.454451:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720985856 00000100:00100000:0.0:1746126598.454453:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720985856 00010000:00010000:0.0:1746126598.454463:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c59200/0xb50e8258676107ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c023 expref: 15 pid: 8438 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.454475:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720985472 00000100:00100000:0.0:1746126598.454477:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720985472 00010000:00010000:0.0:1746126598.454485:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57e3200/0xb50e8258676107b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c015 expref: 20 pid: 8438 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746126598.454495:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6402 00000100:00100000:0.0:1746126598.454500:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945720985344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126598.454513:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126598.454536:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 14 pid: 4641 timeout: 820 lvb_type: 1 00010000:00010000:0.0:1746126598.454546:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a98c00/0xb50e82586761086b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c070 expref: 14 pid: 4641 timeout: 820 lvb_type: 1 00010000:00010000:0.0:1746126598.454574:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126598.457500:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945720985344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2994us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.457509:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6402 00000100:00100000:0.0:1746126598.457572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.457630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.457667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.457799:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721182336:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.459018:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.460655:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720987008 00000100:00100000:0.0:1746126598.460658:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720987008 00010000:00010000:0.0:1746126598.460672:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5752000/0xb50e82586761057e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bea9 expref: 14 pid: 8438 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746126598.463040:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6415 00000100:00100000:0.0:1746126598.463049:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945720987008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126598.463057:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126598.463066:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5752000/0xb50e82586761057e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bea9 expref: 14 pid: 8438 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746126598.463074:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5752000/0xb50e82586761057e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bea9 expref: 14 pid: 8438 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746126598.463085:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5752000/0xb50e82586761057e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bea9 expref: 14 pid: 8438 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746126598.463094:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.463096:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.463098:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136896600/0xb50e8258676108b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.463104:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136896600/0xb50e8258676108b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.463121:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126598.463154:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945720987008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 108us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.463159:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6415 00000100:00100000:0.0:1746126598.472267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126598.473326:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473335:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473363:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473370:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473377:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473384:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0c8c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126598.473388:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473394:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473404:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.473414:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8c00/0xb50e8258676108bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126598.473921:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945720984832:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 35392us (37023us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.473930:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12323 00000100:00100000:0.0:1746126598.477525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.484111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.484148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.484175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.484199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.485071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000004:00010000:0.0:1746126598.512984:0:14547:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136a82a00 reply state ffff880093db9400 transno 8589942788 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126598.513000:0:14547:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746126598.513113:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:30732:x1830945720987520:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 35441us (35594us total) trans 8589942788 rc 0/0 00000100:00100000:0.0:1746126598.513123:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8656 00010000:00010000:0.0:1746126598.516287:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126598.516297:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126598.516303:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126598.516308:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f1f9200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126598.516313:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126598.516319:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126598.516333:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126598.516336:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126598.516339:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126598.516344:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f1f9200/0xb50e8258676108cd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126598.516616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.516635:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.516660:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.516686:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.516699:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.516710:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746126598.516714:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.516726:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.516735:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.516746:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.516764:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185152 00000100:00100000:0.0:1746126598.516768:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185152 00000100:00100000:0.0:1746126598.516789:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185664 00000100:00100000:0.0:1746126598.516791:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185664 00000100:00100000:0.0:1746126598.516801:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185024 00000100:00100000:0.0:1746126598.516802:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185024 00000100:00100000:0.0:1746126598.516811:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185536 00000100:00100000:0.0:1746126598.516812:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185536 00000100:00100000:0.0:1746126598.516820:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12334 00000100:00100000:0.0:1746126598.516843:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3297:x1830945721185152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.516981:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3297:x1830945721185152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (320us total) trans 21474840113 rc 0/0 00000100:00100000:0.0:1746126598.516986:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12334 00000100:00100000:0.0:1746126598.516996:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12335 00000100:00100000:0.0:1746126598.517000:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3297:x1830945721185664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.517075:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3297:x1830945721185664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (374us total) trans 21474840114 rc 0/0 00000100:00100000:0.0:1746126598.517080:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12335 00000100:00100000:0.0:1746126598.517090:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12336 00000100:00100000:0.0:1746126598.517094:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3297:x1830945721185024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.517167:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3297:x1830945721185024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (440us total) trans 21474840115 rc 0/0 00000100:00100000:0.0:1746126598.517172:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12336 00000100:00100000:0.0:1746126598.517191:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12337 00000100:00100000:0.0:1746126598.517196:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3297:x1830945721185536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.517271:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3297:x1830945721185536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (523us total) trans 21474840116 rc 0/0 00000100:00100000:0.0:1746126598.517276:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12337 00000100:00100000:0.0:1746126598.517295:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720988288 00000100:00100000:0.0:1746126598.517297:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720988288 00000100:00100000:0.0:1746126598.517318:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8657 00000100:00100000:0.0:1746126598.517323:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:30732:x1830945720988288:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126598.517338:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.517350:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b499b800/0xb50e8258676108d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c09a expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.517392:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b499b800/0xb50e8258676108d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c09a expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.517403:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b499b800/0xb50e8258676108d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c09a expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.517419:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126598.517421:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126598.517423:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b499b800, rc 0) 00000100:00100000:0.0:1746126598.517450:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30732:x1830945720988288:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 127us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.517455:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8657 00000004:00080000:0.0:1746126598.517525:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a83800/2, rc 0, transno 21474840115 00000100:00100000:0.0:1746126598.517530:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.517536:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a80e00/2, rc 0, transno 21474840116 00000100:00100000:0.0:1746126598.517539:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.517546:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a83100/2, rc 0, transno 21474840113 00000100:00100000:0.0:1746126598.517548:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.517554:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a82300/2, rc 0, transno 21474840114 00000100:00100000:0.0:1746126598.517556:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721185664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.526495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.532416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.558471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.564288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.564343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.568625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.568695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.568715:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720989824 00000100:00100000:0.0:1746126598.568718:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720989824 00000100:00100000:0.0:1746126598.568741:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720989952 00000100:00100000:0.0:1746126598.568744:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720989952 00000100:00100000:0.0:1746126598.568758:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12342 00000100:00100000:0.0:1746126598.568764:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945720989824:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.568772:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.568784:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b499ba00/0xb50e825867610905 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c0af expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126598.568803:0:23766:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c704, atime: 0x6813c704, ctime: 0x6813c704, blocks: 0x737 00010000:00010000:0.0:1746126598.568817:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.568819:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.568843:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b499ba00/0xb50e825867610905 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0af expref: 14 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.568856:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b499ba00/0xb50e825867610905 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0af expref: 14 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.568867:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b499ba00, rc 0) 00000100:00100000:0.0:1746126598.568904:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945720989824:12345-192.168.203.2@tcp:101:cat.0 Request processed in 140us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.568909:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12342 00000100:00100000:0.0:1746126598.568926:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12343 00000100:00100000:0.0:1746126598.568931:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945720989952:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.568939:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.568950:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b499a000/0xb50e82586761091a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c0b6 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126598.568965:0:23766:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c704, atime: 0x6813c704, ctime: 0x6813c704, blocks: 0x821 00010000:00010000:0.0:1746126598.568973:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.568975:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.568978:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b499a000/0xb50e82586761091a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0b6 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.568987:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b499a000/0xb50e82586761091a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0b6 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.568994:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b499a000, rc 0) 00000100:00100000:0.0:1746126598.569009:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945720989952:12345-192.168.203.2@tcp:101:cat.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.569013:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12343 00000100:00100000:0.0:1746126598.570408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.570896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.573857:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12347 00000100:00100000:0.0:1746126598.573869:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945720990336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.573878:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.573891:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009311c600/0xb50e825867610944 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c0cb expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126598.573912:0:17475:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c706, atime: 0x6813c705, ctime: 0x6813c706, blocks: 0x163f 00010000:00010000:0.0:1746126598.573922:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.573924:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.573929:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009311c600/0xb50e825867610944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0cb expref: 16 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.573939:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009311c600/0xb50e825867610944 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0cb expref: 16 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.573956:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009311c600, rc 0) 00000100:00100000:0.0:1746126598.574578:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945720990336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 713us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.574584:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12347 00000100:00100000:0.0:1746126598.592680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.592729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.593330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.593362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.593398:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720991232 00000100:00100000:0.0:1746126598.593402:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720991232 00002000:00100000:0.0:1746126598.593627:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092ad0380 x1830945720991232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.593635:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0380 with x1830945720991232 ext(0->1048575) 00002000:00010000:0.0:1746126598.593639:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad0380 00000100:00100000:0.0:1746126598.593654:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7127 00000100:00100000:0.0:1746126598.593659:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945720991232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126598.604322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.622278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.624938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.629288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.639553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.639606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.646438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.646467:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720993408 00000100:00100000:0.0:1746126598.646476:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720993408 00000100:00100000:0.0:1746126598.646519:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8665 00000100:00100000:0.0:1746126598.646527:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30742:x1830945720993408:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126598.646551:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.646569:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e8258676109a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c0fc expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.646626:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e8258676109a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0fc expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.646637:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e8258676109a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0fc expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.646650:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126598.646652:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126598.646655:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e8258676109a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0fc expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.646661:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d941000, rc 0) 00000100:00100000:0.0:1746126598.646703:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:30742:x1830945720993408:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 176us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.646710:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8665 00000100:00100000:0.0:1746126598.649143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000001:00080000:0.0:1746126598.675656:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942797 is committed 00000004:00080000:0.0:1746126598.675662:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:0.0:1746126598.675669:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1960 committed 00000004:00080000:0.0:1746126598.675674:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1959 committed 00000004:00080000:0.0:1746126598.675675:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:0.0:1746126598.675676:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1958 committed 00000004:00080000:0.0:1746126598.675678:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:0.0:1746126598.675679:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1957 committed 00000004:00080000:0.0:1746126598.675680:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:0.0:1746126598.675682:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1956 committed 00000004:00080000:0.0:1746126598.675683:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000004:00080000:0.0:1746126598.675684:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1955 committed 00000004:00080000:0.0:1746126598.675685:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1954 committed 00000004:00080000:0.0:1746126598.675687:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000004:00080000:0.0:1746126598.675688:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:0.0:1746126598.675690:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1953 committed 00000004:00080000:0.0:1746126598.675691:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1952 committed 00000004:00080000:0.0:1746126598.675692:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000001:00080000:0.0:1746126598.675700:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942794 is committed 00000001:00080000:0.0:1746126598.675710:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942790 is committed 00000100:00100000:0.0:1746126598.675889:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721186944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.675929:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.675949:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.675963:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.675973:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.675986:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.675997:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721188480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.676009:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.676025:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746126598.676029:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721186816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.676041:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.676052:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.676063:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.676072:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.676084:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.676095:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721188352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.676108:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126598.676130:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186944 00000100:00100000:0.0:1746126598.676136:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186944 00000100:00100000:0.0:1746126598.676167:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187456 00000100:00100000:0.0:1746126598.676169:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187456 00000100:00100000:0.0:1746126598.676192:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187968 00000100:00100000:0.0:1746126598.676194:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187968 00000100:00100000:0.0:1746126598.676207:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721188480 00000100:00100000:0.0:1746126598.676208:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721188480 00000100:00100000:0.0:1746126598.676215:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186816 00000100:00100000:0.0:1746126598.676216:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186816 00000100:00100000:0.0:1746126598.676222:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187328 00000100:00100000:0.0:1746126598.676224:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187328 00000100:00100000:0.0:1746126598.676229:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187840 00000100:00100000:0.0:1746126598.676231:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187840 00000100:00100000:0.0:1746126598.676237:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721188352 00000100:00100000:0.0:1746126598.676239:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721188352 00000100:00100000:0.0:1746126598.676248:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12348 00000100:00100000:0.0:1746126598.676254:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721186944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126598.676427:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126598.676430:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126598 -> 1746126598 00002000:00010000:0.0:1746126598.676432:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.676434:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126598 -> 1746126598 00002000:00010000:0.0:1746126598.676436:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:0.0:1746126598.676459:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3297:x1830945721186944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (531us total) trans 21474840121 rc 0/0 00000100:00100000:0.0:1746126598.676467:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12348 00000100:00100000:0.0:1746126598.676480:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12349 00000100:00100000:0.0:1746126598.676485:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721187456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.676570:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3297:x1830945721187456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (605us total) trans 21474840122 rc 0/0 00000100:00100000:0.0:1746126598.676575:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12349 00000100:00100000:0.0:1746126598.676584:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12350 00000100:00100000:0.0:1746126598.676588:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830945721187968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126598.676685:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126598.676688:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.676690:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.676692:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.676694:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746126598.676712:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721187968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (724us total) trans 17179872947 rc 0/0 00000100:00100000:0.0:1746126598.676717:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12350 00000100:00100000:0.0:1746126598.676727:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12351 00000100:00100000:0.0:1746126598.676731:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830945721188480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.676805:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721188480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (794us total) trans 17179872948 rc 0/0 00000100:00100000:0.0:1746126598.676810:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12351 00000100:00100000:0.0:1746126598.676819:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12352 00000100:00100000:0.0:1746126598.676824:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721186816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126598.676910:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126598.676913:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.676915:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126596 -> 1746126596 00002000:00010000:0.0:1746126598.676917:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.676919:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126598.676937:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3297:x1830945721186816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (894us total) trans 21474840123 rc 0/0 00000100:00100000:0.0:1746126598.676942:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12352 00000100:00100000:0.0:1746126598.676951:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12353 00000100:00100000:0.0:1746126598.676955:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721187328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126598.677028:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3297:x1830945721187328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (963us total) trans 21474840124 rc 0/0 00000100:00100000:0.0:1746126598.677033:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12353 00000100:00100000:0.0:1746126598.677042:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12354 00000100:00100000:0.0:1746126598.677046:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830945721187840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126598.677113:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126598.677115:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126598 -> 1746126598 00002000:00010000:0.0:1746126598.677117:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.677118:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126597 -> 1746126597 00002000:00010000:0.0:1746126598.677121:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126598.677137:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721187840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1052us total) trans 17179872949 rc 0/0 00000100:00100000:0.0:1746126598.677143:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12354 00000100:00100000:0.0:1746126598.677152:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12355 00000100:00100000:0.0:1746126598.677156:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830945721188352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.677245:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721188352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1136us total) trans 17179872950 rc 0/0 00000100:00100000:0.0:1746126598.677250:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12355 00000004:00080000:0.0:1746126598.677300:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5955180/2, rc 0, transno 21474840123 00000100:00100000:0.0:1746126598.677305:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721186816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.677319:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135ed2a00/2, rc 0, transno 21474840124 00000100:00100000:0.0:1746126598.677322:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.677331:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54000/2, rc 0, transno 17179872949 00000100:00100000:0.0:1746126598.677337:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126598.677344:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56a00/2, rc 0, transno 17179872950 00000100:00100000:0.0:1746126598.677347:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721188352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126598.677353:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5957100/2, rc 0, transno 21474840121 00000100:00100000:0.0:1746126598.677355:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721186944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.677361:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135ed1c00/2, rc 0, transno 21474840122 00000100:00100000:0.0:1746126598.677363:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126598.677370:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54380/2, rc 0, transno 17179872947 00000100:00100000:0.0:1746126598.677373:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721187968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126598.677378:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56680/2, rc 0, transno 17179872948 00000100:00100000:0.0:1746126598.677381:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721188480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126598.680890:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721186560:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126598.680924:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c066a00/0xb50e82586761098a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0ee expref: 224 pid: 20362 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746126598.680941:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac14600/0xb50e825867610991 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0ee expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.681196:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac14600, rc 0) 00000100:00100000:0.0:1746126598.681216:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:30738:x1830945720992640:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 58709us (58949us total) trans 8589942797 rc 0/0 00000100:00100000:0.0:1746126598.681222:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8663 00000100:00100000:0.0:1746126598.681499:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8667 00000100:00100000:0.0:1746126598.681507:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:30745:x1830945720993920:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.681516:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.681522:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d2f200/0xb50e8258676109b4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c10a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.681545:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d2f200/0xb50e8258676109b4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c10a expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.681554:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d2f200/0xb50e8258676109b4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c10a expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.681564:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126598.681566:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126598.681569:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d2f200, rc 0) 00000100:00100000:0.0:1746126598.681841:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:30745:x1830945720993920:12345-192.168.203.2@tcp:101:cat.0 Request processed in 319us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.681846:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8667 00000100:00100000:0.0:1746126598.684541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.684735:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994176 00000100:00100000:0.0:1746126598.684744:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994176 00000100:00100000:0.0:1746126598.684781:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994304 00000100:00100000:0.0:1746126598.684782:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994304 00000100:00100000:0.0:1746126598.684793:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994560 00000100:00100000:0.0:1746126598.684795:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994560 00000100:00100000:0.0:1746126598.684802:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994432 00000100:00100000:0.0:1746126598.684803:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994432 00000100:00100000:0.0:1746126598.684810:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994688 00000100:00100000:0.0:1746126598.684811:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994688 00000100:00100000:0.0:1746126598.684816:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994816 00000100:00100000:0.0:1746126598.684817:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994816 00000100:00100000:0.0:1746126598.684823:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720994944 00000100:00100000:0.0:1746126598.684824:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720994944 00000100:00100000:0.0:1746126598.684868:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12365 00000100:00100000:0.0:1746126598.684875:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:30738:x1830945720994176:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126598.684893:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.684908:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676109bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c111 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.684936:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136896400/0xb50e82586761092f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0bd expref: 11 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.684942:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.684944:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.684948:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676109bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c111 expref: 27 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.684974:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136896400/0xb50e82586761092f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0bd expref: 11 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.684985:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136896400/0xb50e82586761092f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0bd expref: 11 pid: 17475 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.684996:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5964e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721188864:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126598.685065:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126598.685084:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12366 00000100:00100000:0.0:1746126598.685090:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945720994304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.685097:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.685108:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b391200/0xb50e8258676109c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c118 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.685118:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685119:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685125:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b391200/0xb50e8258676109c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c118 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685142:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b391200/0xb50e8258676109c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c118 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685151:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b391200, rc 0) 00000100:00100000:0.0:1746126598.685170:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945720994304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 80us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.685176:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12366 00000100:00100000:0.0:1746126598.685202:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12367 00000100:00100000:0.0:1746126598.685206:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945720994560:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.685211:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.685216:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b390000/0xb50e8258676109c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c126 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.685225:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685233:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b390000/0xb50e8258676109c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c126 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685240:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b390000/0xb50e8258676109c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c126 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685249:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b390000, rc 0) 00000100:00100000:0.0:1746126598.685263:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945720994560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 56us (624us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126598.685267:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12367 00000100:00100000:0.0:1746126598.685275:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12368 00000100:00100000:0.0:1746126598.685280:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945720994432:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.685285:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.685291:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b391800/0xb50e8258676109d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c11f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.685302:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685303:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685307:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b391800/0xb50e8258676109d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c11f expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685315:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b391800/0xb50e8258676109d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c11f expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685321:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b391800, rc 0) 00000100:00100000:0.0:1746126598.685333:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945720994432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 52us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.685337:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12368 00000100:00100000:0.0:1746126598.685345:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12369 00000100:00100000:0.0:1746126598.685349:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945720994688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.685353:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.685358:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d2fe00/0xb50e8258676109d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c12d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.685366:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685367:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685370:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d2fe00/0xb50e8258676109d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c12d expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685383:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d2fe00/0xb50e8258676109d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c12d expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685389:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d2fe00, rc 0) 00000100:00100000:0.0:1746126598.685400:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945720994688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.685404:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12369 00000100:00100000:0.0:1746126598.685410:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12370 00000100:00100000:0.0:1746126598.685414:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945720994816:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.685417:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.685422:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d2e000/0xb50e8258676109de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c134 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.685431:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685432:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685436:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d2e000/0xb50e8258676109de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c134 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685443:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d2e000/0xb50e8258676109de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c134 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685448:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d2e000, rc 0) 00000100:00100000:0.0:1746126598.685458:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945720994816:12345-192.168.203.2@tcp:101:cat.0 Request processed in 44us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.685462:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12370 00000100:00100000:0.0:1746126598.685470:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12371 00000100:00100000:0.0:1746126598.685474:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945720994944:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126598.685479:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126598.685484:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d2e200/0xb50e8258676109e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c13b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.685492:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685493:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126598.685497:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d2e200/0xb50e8258676109e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c13b expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685504:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d2e200/0xb50e8258676109e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c13b expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126598.685510:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d2e200, rc 0) 00000100:00100000:0.0:1746126598.685522:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945720994944:12345-192.168.203.2@tcp:101:cat.0 Request processed in 47us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.685526:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12371 00000100:00100000:0.0:1746126598.689300:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5964e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721188864:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.689336:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d2e400/0xb50e8258676109bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c111 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.689355:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d2e400, rc 0) 00000100:00100000:0.0:1746126598.689411:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:30738:x1830945720994176:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4536us (4823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.689420:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12365 00000100:00100000:0.0:1746126598.690612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.696197:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721189248:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.696219:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1f9000/0xb50e8258676109ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [65536->409599] (req 65536->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c142 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.696235:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1f9000, rc 0) 00000100:00100000:0.0:1746126598.696257:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:30742:x1830945720995200:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5551us (5647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.696263:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12372 00000100:00100000:0.0:1746126598.698775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.698817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.699346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.699368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.699388:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720996480 00000100:00100000:0.0:1746126598.699393:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720996480 00002000:00100000:0.0:1746126598.699427:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1949695) req@ffff8800a5967b80 x1830945720996480/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.699435:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967b80 with x1830945720996480 ext(1048576->1949695) 00002000:00010000:0.0:1746126598.699440:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967b80 00000100:00100000:0.0:1746126598.699450:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720996352 00000100:00100000:0.0:1746126598.699452:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720996352 00002000:00100000:0.0:1746126598.699458:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5965f80 x1830945720996352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.699463:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965f80 with x1830945720996352 ext(1048576->2097151) 00002000:00010000:0.0:1746126598.699466:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5965f80 00000100:00100000:0.0:1746126598.699471:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945720996736 00000100:00100000:0.0:1746126598.699474:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945720996736 00002000:00100000:0.0:1746126598.699482:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800a5965180 x1830945720996736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.699488:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965180 with x1830945720996736 ext(0->1048575) 00010000:00010000:0.0:1746126598.699493:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b391200/0xb50e8258676109c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c118 expref: 20 pid: 8436 timeout: 820 lvb_type: 1 00010000:00010000:0.0:1746126598.699505:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b391200/0xb50e8258676109c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c118 expref: 20 pid: 8436 timeout: 820 lvb_type: 1 00002000:00010000:0.0:1746126598.699510:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5965180 00000100:00100000:0.0:1746126598.700628:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1616 00000100:00100000:0.0:1746126598.700640:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945720996736:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126598.711594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.712102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126598.712959:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d2fe00/0xb50e8258676109d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c12d expref: 23 pid: 8436 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.712979:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721189376:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.712988:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136897e00/0xb50e825867610936 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0c4 expref: 16 pid: 17475 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746126598.712995:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721189504:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126598.713013:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8800/0xb50e8258676109f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c149 expref: 22 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126598.713025:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8800, rc 0) 00000100:00100000:0.0:1746126598.713048:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+22:30738:x1830945720996224:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8444us (14279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126598.713053:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12373 00000100:00100000:0.0:1746126598.724918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.728752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.729860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.738929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.744814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.744872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.749567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.752405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.756971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.763529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.766664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.773388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.782900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.782927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.783039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.783160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:0.0:1746126598.784366:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880092209f80 x1830945721000960/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:359/0 lens 488/0 e 0 to 0 dl 1746126609 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126598.784375:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209f80 with x1830945721000960 ext(3145728->4194303) 00002000:00010000:0.0:1746126598.784378:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209f80 00000100:00100000:0.0:1746126598.784398:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7143 00000100:00100000:0.0:1746126598.784404:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721000960:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126598.790047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.804268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.815516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.815632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.828127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.828162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.828205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.828218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.828254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.828608:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7148 00000100:00100000:0.0:1746126598.828616:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721002880:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126598.864128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.870968:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.875305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.889873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.897536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.900304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.900346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.906687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.912249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.918814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.943936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.943975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.946806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.951435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126598.956424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.005352:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.024236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.024289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.030446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126599.031815:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126597 -> 1746126598 00002000:00010000:0.0:1746126599.031818:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126597 -> 1746126598 00002000:00010000:0.0:1746126599.031820:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126597 -> 1746126598 00000100:00100000:0.0:1746126599.042963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.051734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.059164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.073980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.075925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.089203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.116458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.118365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.125501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.129856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.157426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.159009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.159669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.166667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.166725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.166764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.184185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.184222:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721010432 00000100:00100000:0.0:1746126599.184230:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721010432 00010000:00010000:0.0:1746126599.184262:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b69800/0xb50e82586761099f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0f5 expref: 229 pid: 14547 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.184292:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6442 00000100:00100000:0.0:1746126599.184299:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721010432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.184311:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.184316:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b69800/0xb50e82586761099f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0f5 expref: 229 pid: 14547 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.184327:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b69800/0xb50e82586761099f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0f5 expref: 229 pid: 14547 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.184348:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b69800/0xb50e82586761099f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0f5 expref: 229 pid: 14547 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.184372:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126599.184376:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a26400/0xb50e825867610ab7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126599.184384:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a26400/0xb50e825867610ab7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126599.184390:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a26400/0xb50e825867610ab7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126599.184408:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.184438:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+228:1963:x1830945721010432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 140us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.184443:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6442 00000100:00100000:0.0:1746126599.186941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.188304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.202057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.202359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.203094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.203291:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6445 00000100:00100000:0.0:1746126599.203298:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721011328:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.203305:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.203321:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e42c00/0xb50e825867610a78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c196 expref: 15 pid: 9686 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.203328:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e42c00/0xb50e825867610a78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c196 expref: 15 pid: 9686 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.203348:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e42c00/0xb50e825867610a78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3526656->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c196 expref: 15 pid: 9686 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.203366:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.203368:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.203375:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.203381:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.203387:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.203388:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.203391:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.203401:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.203426:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.203436:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721193472:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126599.203768:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.203777:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721193728:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126599.203793:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126599.211101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.213041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.219773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.219812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.219893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.235445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.235469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.235520:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721012736 00000100:00100000:0.0:1746126599.235527:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721012736 00000100:00100000:0.0:1746126599.235563:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12392 00000100:00100000:0.0:1746126599.235570:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721012736:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126599.235585:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.235600:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba2200/0xb50e825867610af6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c1ea expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.235618:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.235620:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.235626:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba2200/0xb50e825867610af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1ea expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.235639:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba2200/0xb50e825867610af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1ea expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.235648:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2200, rc 0) 00000100:00100000:0.0:1746126599.235683:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721012736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 114us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.235689:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12392 00000100:00100000:0.0:1746126599.247190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.247289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.255263:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721013376 00000100:00100000:0.0:1746126599.255270:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721013376 00002000:00100000:0.0:1746126599.255304:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3878912->3891199) req@ffff880092ad3800 x1830945721013376/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 12776/0 e 0 to 0 dl 1746126610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.255312:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3800 with x1830945721013376 ext(3878912->3891199) 00010000:00010000:0.0:1746126599.255318:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a9a600/0xb50e825867610aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1e3 expref: 24 pid: 8438 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.255329:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a9a600/0xb50e825867610aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1e3 expref: 24 pid: 8438 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746126599.255340:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad3800 00000100:00100000:0.0:1746126599.255361:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1624 00000100:00100000:0.0:1746126599.255367:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721013376:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126599.255723:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721013376:12345-192.168.203.2@tcp:4:cat.0 Request processed in 356us (628us total) trans 21474840131 rc 0/0 00000100:00100000:0.0:1746126599.255728:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1624 00002000:00100000:0.0:1746126599.255733:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3878912->3891199) req@ffff880092ad3800 x1830945721013376/t21474840131(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 12776/448 e 0 to 0 dl 1746126610 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.255740:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3800 with x1830945721013376 ext(3878912->3891199) 00010000:00010000:0.0:1746126599.255744:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a9a600/0xb50e825867610aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1e3 expref: 26 pid: 8438 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.255757:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a9a600/0xb50e825867610aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1e3 expref: 26 pid: 8438 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746126599.255763:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad3800 00000100:00100000:0.0:1746126599.274327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.275740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.282236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.297134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.310522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.319567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.323800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.326765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.327854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.331955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.333894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.365075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.369379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.448322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.448437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.458452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.459355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.467544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.479635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.479660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.479676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.479693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.479706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.479754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.481928:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12400 00000100:00100000:0.0:1746126599.481942:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721018752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126599.481953:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.481967:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867610bba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c237 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.482003:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721195264:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126599.489031:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746126599.490090:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126598 -> 1746126599 00002000:00010000:0.0:1746126599.490094:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126598 -> 1746126599 00002000:00010000:0.0:1746126599.490096:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126598 -> 1746126599 00000100:00100000:0.0:1746126599.490112:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721195136:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126599.490142:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ace45800/0xb50e825867610bb3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c23e expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.490155:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ace45800/0xb50e825867610bb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c23e expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.490170:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace45800, rc 0) 00000100:00100000:0.0:1746126599.490214:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721018880:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10307us (10519us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126599.490222:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12399 00000100:00100000:0.0:1746126599.499343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126599.508358:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126596 -> 1746126599 00002000:00010000:0.0:1746126599.508367:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126596 -> 1746126599 00002000:00010000:0.0:1746126599.508369:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126596 -> 1746126599 00000100:00100000:0.0:1746126599.508392:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721195264:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126599.508430:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867610bba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c237 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.508443:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867610bba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c237 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.508471:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2800, rc 0) 00000100:00100000:0.0:1746126599.509090:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721018752:12345-192.168.203.2@tcp:101:cat.0 Request processed in 27152us (29381us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126599.509103:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12400 00000100:00100000:0.0:1746126599.512016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.517943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.518076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.522373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.522426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.534267:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721020416:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 10514us (10579us total) trans 0 rc 593920/593920 00000100:00100000:0.0:1746126599.534275:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7176 00002000:00100000:0.0:1746126599.534282:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1642495) req@ffff88012d91b480 x1830945721020416/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:360/0 lens 488/440 e 0 to 0 dl 1746126610 ref 1 fl Complete:/200/0 rc 593920/593920 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.534289:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b480 with x1830945721020416 ext(1048576->1642495) 00002000:00010000:0.0:1746126599.534293:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91b480 00000100:00100000:0.0:1746126599.538945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.539378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.547466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.547955:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721021568 00000100:00100000:0.0:1746126599.547962:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721021568 00002000:00100000:0.0:1746126599.547996:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8801367ead80 x1830945721021568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 488/0 e 0 to 0 dl 1746126610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.548005:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ead80 with x1830945721021568 ext(1048576->2097151) 00002000:00010000:0.0:1746126599.548009:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ead80 00000100:00100000:0.0:1746126599.548036:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7178 00000100:00100000:0.0:1746126599.548042:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721021568:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126599.553635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.553677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.553715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.556381:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721021568:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 8336us (8913us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126599.556390:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7178 00002000:00100000:0.0:1746126599.556397:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8801367ead80 x1830945721021568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 488/440 e 0 to 0 dl 1746126610 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.556404:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ead80 with x1830945721021568 ext(1048576->2097151) 00002000:00010000:0.0:1746126599.556408:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ead80 00000100:00100000:0.0:1746126599.561350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.567529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.582404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.582594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.584144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.584554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.584816:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12406 00000100:00100000:0.0:1746126599.584846:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:30771:x1830945721023360:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126599.584858:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.584870:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867610be4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c268 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.584891:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e2000/0xb50e825867610bc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c245 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.584897:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126599.584899:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126599.584901:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867610be4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c268 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.584925:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e6e2000/0xb50e825867610bc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1986559) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c245 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.584936:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e2000/0xb50e825867610bc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1986559) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c245 expref: 17 pid: 4640 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.584945:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721196416:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126599.584982:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126599.587222:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721196416:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126599.587247:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867610be4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c268 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.587260:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009367ee00, rc 0) 00000100:00100000:0.0:1746126599.587289:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:30771:x1830945721023360:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2466us (3146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.587296:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12406 00000100:00100000:0.0:1746126599.587541:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721023872 00000100:00100000:0.0:1746126599.587546:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721023872 00000100:00100000:0.0:1746126599.587569:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721023744 00000100:00100000:0.0:1746126599.587572:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721023744 00000100:00100000:0.0:1746126599.587591:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12408 00000100:00100000:0.0:1746126599.587596:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721023872:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126599.587608:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.587619:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800933e6000/0xb50e825867610bf2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c27d expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.587656:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721196672:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126599.587706:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746126599.589770:0:9686:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126598 -> 1746126599 00002000:00010000:0.0:1746126599.589775:0:9686:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126596 -> 1746126599 00002000:00010000:0.0:1746126599.589776:0:9686:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126598 -> 1746126599 00000100:00100000:0.0:1746126599.589793:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721196672:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126599.589820:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800933e6000/0xb50e825867610bf2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c27d expref: 21 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.589869:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800933e6000/0xb50e825867610bf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c27d expref: 21 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.589883:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933e6000, rc 0) 00000100:00100000:0.0:1746126599.589909:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721023872:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2312us (2539us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126599.589915:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12408 00000100:00100000:0.0:1746126599.592803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.593557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.595248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.597678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.601818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.602232:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1629 00000100:00100000:0.0:1746126599.602247:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721024768:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126599.602618:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721024768:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 378us (808us total) trans 21474840133 rc 0/0 00000100:00100000:0.0:1746126599.602625:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1629 00002000:00100000:0.0:1746126599.602631:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1056767) req@ffff880091da2d80 x1830945721024768/t21474840133(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 8680/448 e 0 to 0 dl 1746126610 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.602638:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da2d80 with x1830945721024768 ext(1048576->1056767) 00010000:00010000:0.0:1746126599.602643:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867610be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c268 expref: 27 pid: 9686 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.602652:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867610be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c268 expref: 27 pid: 9686 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746126599.602658:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da2d80 00000100:00100000:0.0:1746126599.604171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.609642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.639403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.645807:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721025664 00000100:00100000:0.0:1746126599.645817:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721025664 00002000:00100000:0.0:1746126599.645881:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5954000 x1830945721025664/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 488/0 e 0 to 0 dl 1746126610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.645890:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954000 with x1830945721025664 ext(3145728->4194303) 00002000:00010000:0.0:1746126599.645895:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5954000 00000100:00100000:0.0:1746126599.645929:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7186 00000100:00100000:0.0:1746126599.645938:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721025664:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126599.667325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.706261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.714496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.716538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.721406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.721452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.721481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.721506:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721026560 00000100:00100000:0.0:1746126599.721515:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721026560 00000100:00100000:0.0:1746126599.721559:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721026816 00000100:00100000:0.0:1746126599.721562:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721026816 00000100:00100000:0.0:1746126599.721592:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721027072 00000100:00100000:0.0:1746126599.721594:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721027072 00000100:00100000:0.0:1746126599.721612:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12412 00000100:00100000:0.0:1746126599.721620:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721026560:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126599.721637:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.721655:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace45800/0xb50e825867610c2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c299 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.721677:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.721679:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.721687:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace45800/0xb50e825867610c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c299 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.721703:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace45800/0xb50e825867610c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c299 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.721714:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace45800, rc 0) 00000100:00100000:0.0:1746126599.721754:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721026560:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 135us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.721760:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12412 00000100:00100000:0.0:1746126599.721777:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12413 00000100:00100000:0.0:1746126599.721782:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721026816:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126599.721789:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.721798:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867610c31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c2a7 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.721868:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721197568:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126599.721927:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746126599.721943:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126599.721946:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126599.721967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.722008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.722077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.722091:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721026688 00000100:00100000:0.0:1746126599.722094:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721026688 00000100:00100000:0.0:1746126599.722107:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721026944 00000100:00100000:0.0:1746126599.722109:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721026944 00000100:00100000:0.0:1746126599.722118:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721027200 00000100:00100000:0.0:1746126599.722119:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721027200 00000100:00100000:0.0:1746126599.722128:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12414 00000100:00100000:0.0:1746126599.722133:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721027072:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126599.722139:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.722147:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867610c38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c2b5 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.722156:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722158:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722163:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867610c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2b5 expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722188:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867610c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2b5 expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722196:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2aec00, rc 0) 00000100:00100000:0.0:1746126599.722214:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721027072:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 81us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.722220:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12414 00000100:00100000:0.0:1746126599.722229:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12415 00000100:00100000:0.0:1746126599.722234:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721026688:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126599.722239:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.722245:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2af000/0xb50e825867610c3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c2a0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.722254:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722255:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722260:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2af000/0xb50e825867610c3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2a0 expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722269:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a2af000/0xb50e825867610c3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2a0 expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722276:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2af000, rc 0) 00000100:00100000:0.0:1746126599.722290:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721026688:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 55us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.722295:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12415 00000100:00100000:0.0:1746126599.722305:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12416 00000100:00100000:0.0:1746126599.722310:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721026944:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126599.722315:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.722321:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2af200/0xb50e825867610c46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c2ae expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.722330:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722331:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722335:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2af200/0xb50e825867610c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ae expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722343:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2af200/0xb50e825867610c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ae expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722350:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2af200, rc 0) 00000100:00100000:0.0:1746126599.722364:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721026944:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.722369:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12416 00000100:00100000:0.0:1746126599.722378:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12417 00000100:00100000:0.0:1746126599.722383:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721027200:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126599.722388:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.722395:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c2bc expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.722404:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722405:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.722409:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722418:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.722425:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2ae600, rc 0) 00000100:00100000:0.0:1746126599.722438:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721027200:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 55us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.722442:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12417 00000100:00100000:0.0:1746126599.729624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.733771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.751206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.751596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.754010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.754232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.754246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.754264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.754888:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12423 00000100:00100000:0.0:1746126599.754896:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721028736:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126599.754910:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.754920:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.754927:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.754938:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.754943:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.754944:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.754946:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.754959:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.754966:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 16 pid: 8437 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.754972:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721199232:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126599.754993:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126599.755000:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 13 pid: 20294 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746126599.755006:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721199488:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126599.755033:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.755044:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 29 pid: 8437 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.755050:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721199616:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126599.755061:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126599.757428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.760474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.760710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.762564:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721197952:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126599.762582:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.762603:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6461 00000100:00100000:0.0:1746126599.762610:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721029120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.762617:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.762626:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3600/0xb50e825867610a94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1b2 expref: 26 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.762633:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3600/0xb50e825867610a94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1b2 expref: 26 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.762644:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3600/0xb50e825867610a94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1b2 expref: 26 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.763611:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.763723:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721199232:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126599.763749:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721199488:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126599.763782:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721199616:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126599.763796:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.764587:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721029248 00000100:00100000:0.0:1746126599.764591:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721029248 00002000:00100000:0.0:1746126599.764612:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1269760->2097151) req@ffff88009ee3ad80 x1830945721029248/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:360/0 lens 488/0 e 0 to 0 dl 1746126610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126599.764620:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3ad80 with x1830945721029248 ext(1269760->2097151) 00010000:00010000:0.0:1746126599.764629:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867610bcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c253 expref: 30 pid: 4640 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.764637:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867610bcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c253 expref: 30 pid: 4640 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746126599.764642:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee3ad80 00000100:00100000:0.0:1746126599.768419:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6465 00000100:00100000:0.0:1746126599.768426:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721029376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.768433:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.768441:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867610c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2b5 expref: 13 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.768449:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867610c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2b5 expref: 13 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.768459:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867610c38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2b5 expref: 13 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.768466:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.768481:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721029376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 57us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.768486:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6465 00000100:00100000:0.0:1746126599.768496:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6466 00000100:00100000:0.0:1746126599.768500:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721029760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.768506:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.768514:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a2af200/0xb50e825867610c46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ae expref: 11 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.768521:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a2af200/0xb50e825867610c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ae expref: 11 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.768530:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2af200/0xb50e825867610c46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ae expref: 11 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.768538:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.768549:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721029760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 49us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.768557:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6466 00000100:00100000:0.0:1746126599.768564:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6467 00000100:00100000:0.0:1746126599.768568:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721030016:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.768573:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.768581:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 16 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768588:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 16 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768598:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ea4de00/0xb50e825867610abe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1d5 expref: 16 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768606:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.768617:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721030016:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 49us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.768622:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6467 00000100:00100000:0.0:1746126599.768629:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6468 00000100:00100000:0.0:1746126599.768634:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721030528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.768639:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.768645:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867610beb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c26f expref: 24 pid: 8438 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768652:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867610beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c26f expref: 24 pid: 8438 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768666:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867610beb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c26f expref: 24 pid: 8438 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768672:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.768674:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.768678:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768684:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768702:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.768714:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721030528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 80us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.768718:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6468 00010000:00010000:0.0:1746126599.768739:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768746:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768761:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768767:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768778:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768783:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e86c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126599.768787:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768793:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768801:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768807:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e86c00/0xb50e825867610ca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.768854:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721028480:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 13999us (14608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.768860:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12422 00000100:00100000:0.0:1746126599.768891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.768901:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721029632 00000100:00100000:0.0:1746126599.768903:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721029632 00010000:00010000:0.0:1746126599.768914:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099211400/0xb50e825867610bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c24c expref: 32 pid: 4640 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.768924:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6469 00000100:00100000:0.0:1746126599.768928:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721029632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.768933:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.768940:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099211400/0xb50e825867610bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c24c expref: 32 pid: 4640 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768947:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099211400/0xb50e825867610bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c24c expref: 32 pid: 4640 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768956:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099211400/0xb50e825867610bc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c24c expref: 32 pid: 4640 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.768964:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.768965:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.768968:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867610c9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768974:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867610c9a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.768985:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.768997:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721029632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 68us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.769002:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6469 00000100:00100000:0.0:1746126599.769034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.769044:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721029888 00000100:00100000:0.0:1746126599.769047:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721029888 00010000:00010000:0.0:1746126599.769056:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e825867610b04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1f8 expref: 18 pid: 8437 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.769070:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6470 00000100:00100000:0.0:1746126599.769074:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721029888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.769079:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.769085:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e825867610b04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1f8 expref: 18 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.769092:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e825867610b04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1f8 expref: 18 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.769101:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e825867610b04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1f8 expref: 18 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.769109:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.769111:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.769113:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769119:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769130:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.769143:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721029888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.769148:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6470 00010000:00010000:0.0:1746126599.769160:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769182:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769194:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769200:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769206:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769211:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009379aa00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126599.769213:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769219:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769227:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769233:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867610c93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.769259:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721028608:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 14853us (15255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.769265:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12420 00000100:00100000:0.0:1746126599.769294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.769303:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721030144 00000100:00100000:0.0:1746126599.769306:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721030144 00010000:00010000:0.0:1746126599.769315:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 14 pid: 20294 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746126599.769325:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6471 00000100:00100000:0.0:1746126599.769329:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721030144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.769335:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.769348:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 14 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.769355:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 14 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.769364:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2ae600/0xb50e825867610c4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2bc expref: 14 pid: 20294 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126599.769371:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.769383:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721030144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 54us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.769387:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6471 00000100:00100000:0.0:1746126599.769453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.769464:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721030656 00000100:00100000:0.0:1746126599.769466:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721030656 00010000:00010000:0.0:1746126599.769476:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 31 pid: 8437 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.769490:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6472 00000100:00100000:0.0:1746126599.769494:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721030656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.769499:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.769505:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 31 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.769513:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 31 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.769522:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867610aa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c1c7 expref: 31 pid: 8437 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.769530:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.769531:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126599.769533:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769539:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769550:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.769561:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721030656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 67us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.769566:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6472 00010000:00010000:0.0:1746126599.769591:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769598:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769608:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769614:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769619:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769624:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec07c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126599.769626:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769631:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769638:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.769644:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867610ca8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.769666:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721028736:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 14772us (15401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.769671:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12423 00010000:00010000:0.0:1746126599.786669:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786676:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786692:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786698:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786703:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786708:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e86600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126599.786711:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786717:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786725:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.786729:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e86600/0xb50e825867610c8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126599.786793:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721028352:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 35113us (35197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.786800:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12419 00000100:00100000:0.0:1746126599.788823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126599.788987:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126599.792976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.793005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.793028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.793045:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721031552 00000100:00100000:0.0:1746126599.793050:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721031552 00010000:00010000:0.0:1746126599.793076:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e8258676109a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c0fc expref: 19 pid: 14549 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746126599.794523:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6476 00000100:00100000:0.0:1746126599.794612:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:1964:x1830945721031168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126599.794619:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126599.794624:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65400/0xb50e825867610b3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c21b expref: 233 pid: 14547 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.796243:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65400/0xb50e825867610b3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c21b expref: 233 pid: 14547 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.796517:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65400/0xb50e825867610b3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c21b expref: 233 pid: 14547 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746126599.796529:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126599.796533:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.796537:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126599.796556:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:1964:x1830945721031168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1948us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126599.796561:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6476 00000001:00080000:0.0:1746126599.829926:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942818 is committed 00000004:00080000:0.0:1746126599.829935:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1876 committed 00000004:00080000:0.0:1746126599.829942:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000004:00080000:0.0:1746126599.830047:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1968 committed 00000004:00080000:0.0:1746126599.830050:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1875 committed 00000004:00080000:0.0:1746126599.830051:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1967 committed 00000004:00080000:0.0:1746126599.830053:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1874 committed 00000004:00080000:0.0:1746126599.830054:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746126599.830056:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1873 committed 00000004:00080000:0.0:1746126599.830057:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1965 committed 00000004:00080000:0.0:1746126599.830059:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1872 committed 00000004:00080000:0.0:1746126599.830060:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1964 committed 00000004:00080000:0.0:1746126599.830061:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1963 committed 00000004:00080000:0.0:1746126599.830063:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1871 committed 00000004:00080000:0.0:1746126599.830064:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1870 committed 00000004:00080000:0.0:1746126599.830065:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1962 committed 00000004:00080000:0.0:1746126599.830067:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1961 committed 00000004:00080000:0.0:1746126599.830068:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1869 committed 00000001:00080000:0.0:1746126599.830077:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942812 is committed 00000001:00080000:0.0:1746126599.830080:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942811 is committed 00000001:00080000:0.0:1746126599.830089:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942815 is committed 00000001:00080000:0.0:1746126599.830092:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942814 is committed 00000100:00100000:0.0:1746126599.830638:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721200384 00000100:00100000:0.0:1746126599.830645:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721200384 00000100:00100000:0.0:1746126599.830678:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721200896 00000100:00100000:0.0:1746126599.830680:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721200896 00000100:00100000:0.0:1746126599.830688:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721200512 00000100:00100000:0.0:1746126599.830690:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721200512 00000100:00100000:0.0:1746126599.830697:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721201024 00000100:00100000:0.0:1746126599.830699:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721201024 00000100:00100000:0.0:1746126599.830704:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721200768 00000100:00100000:0.0:1746126599.830705:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721200768 00000100:00100000:0.0:1746126599.830711:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721201280 00000100:00100000:0.0:1746126599.830712:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721201280 00000100:00100000:0.0:1746126599.830718:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721200640 00000100:00100000:0.0:1746126599.830719:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721200640 00000100:00100000:0.0:1746126599.830724:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721201152 00000100:00100000:0.0:1746126599.830726:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721201152 00000100:00100000:0.0:1746126599.830733:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12424 00000100:00100000:0.0:1746126599.830739:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3296:x1830945721200384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.830923:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721200384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (599us total) trans 17179872962 rc 0/0 00000100:00100000:0.0:1746126599.830929:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12424 00000100:00100000:0.0:1746126599.830942:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12425 00000100:00100000:0.0:1746126599.830946:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3296:x1830945721200896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126599.831016:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126599.831019:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126599.831021:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126599.831022:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126599.831024:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126599.831043:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721200896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (672us total) trans 17179872963 rc 0/0 00000100:00100000:0.0:1746126599.831048:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12425 00000100:00100000:0.0:1746126599.831058:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12426 00000100:00100000:0.0:1746126599.831063:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3296:x1830945721200512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.831141:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721200512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (734us total) trans 17179872964 rc 0/0 00000100:00100000:0.0:1746126599.831145:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12426 00000100:00100000:0.0:1746126599.831156:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12427 00000100:00100000:0.0:1746126599.831160:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3296:x1830945721201024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.831244:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721201024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (813us total) trans 17179872965 rc 0/0 00000100:00100000:0.0:1746126599.831249:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12427 00000100:00100000:0.0:1746126599.831258:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12428 00000100:00100000:0.0:1746126599.831263:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721200768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.831342:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3295:x1830945721200768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (880us total) trans 17179872966 rc 0/0 00000100:00100000:0.0:1746126599.831347:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12428 00000100:00100000:0.0:1746126599.831356:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12429 00000100:00100000:0.0:1746126599.831360:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721201280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.831434:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3295:x1830945721201280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (949us total) trans 17179872967 rc 0/0 00000100:00100000:0.0:1746126599.831438:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12429 00000100:00100000:0.0:1746126599.831447:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12430 00000100:00100000:0.0:1746126599.831451:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721200640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.831523:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3295:x1830945721200640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1011us total) trans 17179872968 rc 0/0 00000100:00100000:0.0:1746126599.831530:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12430 00000100:00100000:0.0:1746126599.831538:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12431 00000100:00100000:0.0:1746126599.831543:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721201152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126599.831612:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3295:x1830945721201152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1082us total) trans 17179872969 rc 0/0 00000100:00100000:0.0:1746126599.831617:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12431 00000100:00080000:0.0:1746126599.831633:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00010000:0.0:1746126599.831656:0:14548:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008dad3b80 reply state ffff88009ee8dc00 transno 8589942818 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126599.831664:0:14548:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746126599.831720:0:14548:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746126599.831730:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30785:x1830945721031040:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 42714us (42908us total) trans 8589942818 rc 0/0 00000100:00100000:0.0:1746126599.831736:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8680 00010000:00010000:0.0:1746126599.831851:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.831858:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.831864:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.831868:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e86e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126599.831871:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.831877:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.831892:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126599.831895:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126599.831898:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.831902:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e86e00/0xb50e825867610caf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00080000:0.0:1746126599.834660:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126599.836289:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721031808 00000100:00100000:0.0:1746126599.836297:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721031808 00000100:00100000:0.0:1746126599.844918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.847727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.885110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.916226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.939670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.949156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.961728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.994164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.994212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126599.994233:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721034624 00000100:00100000:0.0:1746126599.994240:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721034624 00000100:00100000:0.0:1746126599.994266:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721034752 00000100:00100000:0.0:1746126599.994267:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721034752 00000100:00100000:0.0:1746126599.994281:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8687 00000100:00100000:0.0:1746126599.994288:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:30795:x1830945721034624:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126599.994303:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.994319:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b68400/0xb50e825867610d57 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c302 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.994379:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126599.994408:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d995400/0xb50e825867610d0a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.994413:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126599.994427:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d995400/0xb50e825867610d0a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126599.994436:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126599.994452:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8688 00000100:00100000:0.0:1746126599.994457:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:30798:x1830945721034752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126599.994466:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126599.994471:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45200/0xb50e825867610d65 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c309 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126599.994497:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126599.994503:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126599.994508:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.014603:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d995400/0xb50e825867610d0a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ed expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.014617:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.014620:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746126600.014623:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126600.014631:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126600.014637:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126600.014642:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.014647:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.014651:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.014701:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d994600/0xb50e825867610d03 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ed expref: 15 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746126600.015000:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d995400/0xb50e825867610d0a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ed expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.015029:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d995400, rc 0) 00000100:00100000:0.0:1746126600.015071:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:30794:x1830945721033216:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 75213us (75406us total) trans 8589942824 rc 0/0 00000100:00100000:0.0:1746126600.015079:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8684 00000001:00080000:0.0:1746126600.015113:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942824 is committed 00000004:00080000:0.0:1746126600.015118:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1884 committed 00000004:00080000:0.0:1746126600.015125:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1978 committed 00000004:00080000:0.0:1746126600.015132:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1977 committed 00000004:00080000:0.0:1746126600.015134:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1883 committed 00000004:00080000:0.0:1746126600.015136:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746126600.015138:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1882 committed 00000004:00080000:0.0:1746126600.015139:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746126600.015140:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1881 committed 00000004:00080000:0.0:1746126600.015142:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:0.0:1746126600.015155:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1880 committed 00000004:00080000:0.0:1746126600.015157:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:0.0:1746126600.015158:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:0.0:1746126600.015160:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1879 committed 00000004:00080000:0.0:1746126600.015161:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1878 committed 00000004:00080000:0.0:1746126600.015163:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:0.0:1746126600.015165:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:0.0:1746126600.015166:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1877 committed 00000001:00080000:0.0:1746126600.015182:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942822 is committed 00000001:00080000:0.0:1746126600.015189:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942820 is committed 00010000:00010000:0.0:1746126600.015214:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126600.015221:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746126600.015244:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126600.015247:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126600.015259:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126600.015281:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b68400/0xb50e825867610d57 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.015294:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.015300:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.015302:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746126600.015304:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44e00, rc 0) 00000100:00100000:0.0:1746126600.015329:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:30795:x1830945721034624:12345-192.168.203.2@tcp:101:cat.0 Request processed in 21042us (21170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.015334:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8687 00000100:00100000:0.0:1746126600.015622:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721202944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.015664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126600.015702:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721202816 00000100:00100000:0.0:1746126600.015709:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721202816 00000100:00100000:0.0:1746126600.015736:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721202944 00000100:00100000:0.0:1746126600.015738:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721202944 00000100:00100000:0.0:1746126600.015765:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12442 00000100:00100000:0.0:1746126600.015771:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3294:x1830945721202944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.015977:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3294:x1830945721202944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (312us total) trans 21474840143 rc 0/0 00000100:00100000:0.0:1746126600.015983:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12442 00000004:00080000:0.0:1746126600.016012:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e582a00/2, rc 0, transno 21474840143 00000100:00100000:0.0:1746126600.016017:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721202944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.016087:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746126600.016095:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721203456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.016437:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126600.016471:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721203072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.016824:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203456 00000100:00100000:0.0:1746126600.016846:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203456 00000100:00100000:0.0:1746126600.016865:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203200 00000100:00100000:0.0:1746126600.016867:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203200 00000100:00100000:0.0:1746126600.016878:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203712 00000100:00100000:0.0:1746126600.016880:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203712 00000100:00100000:0.0:1746126600.016891:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12443 00000100:00100000:0.0:1746126600.016897:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3294:x1830945721203456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.018513:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3294:x1830945721203456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1613us (2072us total) trans 21474840147 rc 0/0 00000100:00100000:0.0:1746126600.018521:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12443 00000100:00100000:0.0:1746126600.018726:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203328 00000100:00100000:0.0:1746126600.018732:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203328 00000100:00100000:0.0:1746126600.018753:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203840 00000100:00100000:0.0:1746126600.018755:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203840 00000100:00100000:0.0:1746126600.018766:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721204352 00000100:00100000:0.0:1746126600.018768:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721204352 00000100:00100000:0.0:1746126600.018781:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12456 00000100:00100000:0.0:1746126600.018786:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3297:x1830945721203840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.018924:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3297:x1830945721203840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (187us total) trans 17179872978 rc 0/0 00000100:00100000:0.0:1746126600.018930:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12456 00000100:00100000:0.0:1746126600.018940:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12457 00000100:00100000:0.0:1746126600.018944:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3297:x1830945721204352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126600.019020:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126600.019023:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126600.019026:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126600.019028:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126600.019030:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126600.019054:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3297:x1830945721204352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (299us total) trans 17179872979 rc 0/0 00000100:00100000:0.0:1746126600.019060:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12457 00000100:00100000:0.0:1746126600.022713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126600.023299:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126600.028506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.028619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.028658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.028986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.029041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.031375:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721035520 00000100:00100000:0.0:1746126600.031383:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721035520 00000100:00100000:0.0:1746126600.031411:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721035776 00000100:00100000:0.0:1746126600.031413:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721035776 00000100:00100000:0.0:1746126600.031425:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721036032 00000100:00100000:0.0:1746126600.031427:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721036032 00000100:00100000:0.0:1746126600.031441:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721036288 00000100:00100000:0.0:1746126600.031443:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721036288 00000100:00100000:0.0:1746126600.031452:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721036544 00000100:00100000:0.0:1746126600.031454:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721036544 00000100:00100000:0.0:1746126600.031612:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12464 00000100:00100000:0.0:1746126600.031620:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721035776:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126600.031632:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.031649:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e23ee00/0xb50e825867610d9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c341 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126600.031667:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c706, atime: 0x6813c705, ctime: 0x6813c706, blocks: 0x102b 00010000:00010000:0.0:1746126600.031682:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.031684:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.031691:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e23ee00/0xb50e825867610d9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c341 expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.031703:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e23ee00/0xb50e825867610d9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c341 expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.031712:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e23ee00, rc 0) 00000100:00100000:0.0:1746126600.031742:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721035776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 123us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.031748:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12464 00000100:00100000:0.0:1746126600.031762:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12467 00000100:00100000:0.0:1746126600.031768:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721036160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126600.031775:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.031781:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ace44200/0xb50e825867610db2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c356 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.031818:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721205120:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126600.031881:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.032081:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721204992:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126600.032102:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f16f400/0xb50e825867610d8f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c32c expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.032111:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f400/0xb50e825867610d8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c32c expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.032128:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f16f400, rc 0) 00000100:00100000:0.0:1746126600.032149:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721035392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3113us (3473us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126600.032155:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12461 00000100:00100000:0.0:1746126600.043819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.046105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.046196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.049481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.050956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.051677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.051725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.051757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.059007:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6484 00000100:00100000:0.0:1746126600.059014:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721038592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.059021:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.059028:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e825867610d96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c33a expref: 24 pid: 4642 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126600.059102:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e825867610d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c33a expref: 24 pid: 4642 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126600.059126:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f16ee00/0xb50e825867610d96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c33a expref: 24 pid: 4642 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746126600.059719:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.059721:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.059728:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.059735:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.059764:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.059774:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721205888:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126600.059859:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.065450:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721205888:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126600.065481:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.065522:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721038592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6507us (6735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.065531:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6484 00000100:00100000:0.0:1746126600.071913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.087302:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721206400 00000100:00100000:0.0:1746126600.087313:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721206400 00000100:00100000:0.0:1746126600.087352:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1746126600.087360:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3297:x1830945721206400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126600.087417:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3297:x1830945721206400:12345-0@lo:400:kworker.0 Request processed in 59us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.087423:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1746126600.087455:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126600.102078:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721206912 00000100:00100000:0.0:1746126600.102085:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721206912 00000100:00100000:0.0:1746126600.102120:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1746126600.102126:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721206912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746126600.102156:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 487653376 pending 18743296 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746126600.102217:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721206912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.102223:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1746126600.113977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.114021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.116918:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12473 00000100:00100000:0.0:1746126600.116931:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:30792:x1830945721039744:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126600.116946:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.116961:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867610de3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c380 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.116987:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e23ee00/0xb50e825867610d9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c341 expref: 17 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.116993:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b68400/0xb50e825867610dc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c36b expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.116999:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.117000:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.117003:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867610de3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->3661823] (req 3145728->3661823) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c380 expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.117030:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4b68400/0xb50e825867610dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c36b expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.117040:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b68400/0xb50e825867610dc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c36b expref: 32 pid: 8436 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.117051:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721207040:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.124358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.133373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.133448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.133470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.133495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.133532:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721040384 00000100:00100000:0.0:1746126600.133542:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721040384 00002000:00100000:0.0:1746126600.133580:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3956736->4194303) req@ffff88009ee38380 x1830945721040384/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.133589:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38380 with x1830945721040384 ext(3956736->4194303) 00010000:00010000:0.0:1746126600.133602:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 25 pid: 8438 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.133615:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 25 pid: 8438 timeout: 822 lvb_type: 0 00002000:00010000:0.0:1746126600.133621:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee38380 00000100:00100000:0.0:1746126600.133637:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1631 00000100:00100000:0.0:1746126600.133644:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721040384:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126600.145397:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721040384:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 11746us (11893us total) trans 21474840150 rc 0/0 00000100:00100000:0.0:1746126600.145409:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1631 00002000:00100000:0.0:1746126600.145420:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3956736->4194303) req@ffff88009ee38380 x1830945721040384/t21474840150(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/448 e 0 to 0 dl 1746126611 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.145429:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38380 with x1830945721040384 ext(3956736->4194303) 00010000:00010000:0.0:1746126600.145439:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 27 pid: 8438 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.145450:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 27 pid: 8438 timeout: 822 lvb_type: 0 00002000:00010000:0.0:1746126600.145457:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee38380 00000100:00100000:0.0:1746126600.151364:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721040896 00000100:00100000:0.0:1746126600.151374:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721040896 00010000:00010000:0.0:1746126600.151413:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867610ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3956736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c379 expref: 27 pid: 8438 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.157255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.160497:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721207680:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126600.160516:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.160545:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721040896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5497us (9336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.160553:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6487 00000100:00100000:0.0:1746126600.165473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.171502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.193161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.196868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.206901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.210973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.211023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.220096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.220426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.220458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.220491:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721042944 00000100:00100000:0.0:1746126600.220497:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721042944 00002000:00100000:0.0:1746126600.220528:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a5b6ad80 x1830945721042944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.220534:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6ad80 with x1830945721042944 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.220538:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6ad80 00000100:00100000:0.0:1746126600.220548:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721043200 00000100:00100000:0.0:1746126600.220549:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721043200 00002000:00100000:0.0:1746126600.220555:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5b69500 x1830945721043200/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.220559:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69500 with x1830945721043200 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.220561:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b69500 00000100:00100000:0.0:1746126600.220569:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7200 00000100:00100000:0.0:1746126600.220573:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721042944:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126600.221466:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7201 00000100:00100000:0.0:1746126600.221473:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721043200:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126600.230435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.238942:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721208320:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126600.238969:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.239007:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721043328:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8405us (8582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.239017:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6490 00000100:00100000:0.0:1746126600.242847:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721043584 00000100:00100000:0.0:1746126600.242856:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721043584 00002000:00100000:0.0:1746126600.242901:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e580e00 x1830945721043584/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.242912:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e580e00 with x1830945721043584 ext(1048576->2097151) 00002000:00010000:0.0:1746126600.242918:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e580e00 00000100:00100000:0.0:1746126600.242948:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7202 00000100:00100000:0.0:1746126600.242956:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721043584:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126600.252872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.252910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.266167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.268128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.293557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.293611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.293754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.293794:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721044864 00000100:00100000:0.0:1746126600.293803:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721044864 00002000:00100000:0.0:1746126600.293871:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d918a80 x1830945721044864/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.293881:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918a80 with x1830945721044864 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.293886:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d918a80 00000100:00100000:0.0:1746126600.293901:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721044736 00000100:00100000:0.0:1746126600.293904:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721044736 00002000:00100000:0.0:1746126600.293914:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008e3a9c00 x1830945721044736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.293919:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9c00 with x1830945721044736 ext(2097152->3145727) 00002000:00010000:0.0:1746126600.293921:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9c00 00000100:00100000:0.0:1746126600.293928:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721045248 00000100:00100000:0.0:1746126600.293930:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721045248 00002000:00100000:0.0:1746126600.293939:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008e3ab480 x1830945721045248/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.293944:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3ab480 with x1830945721045248 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.293947:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3ab480 00000100:00100000:0.0:1746126600.294880:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7204 00000100:00100000:0.0:1746126600.294892:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721044864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126600.336937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.366409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.372276:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721046016 00000100:00100000:0.0:1746126600.372287:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721046016 00000100:00100000:0.0:1746126600.372359:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8691 00000100:00100000:0.0:1746126600.372367:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:30805:x1830945721046016:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126600.372391:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.372408:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340e00/0xb50e825867610e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c3c6 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.372534:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372545:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372556:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372569:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372574:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372580:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372688:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372696:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372703:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126600.372732:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126600.372736:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126600.372749:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372757:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372763:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372767:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372776:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372782:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f341000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126600.372785:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372791:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372800:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126600.372803:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126600.372806:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372810:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372860:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372865:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372870:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372874:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f340c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126600.372876:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372880:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372889:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a593b500) 00010000:00010000:0.0:1746126600.372891:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126600.372893:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372897:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340c00/0xb50e825867610e53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.372921:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340e00/0xb50e825867610e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.372932:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.372938:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.372940:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126600.372942:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f340a00, rc 0) 00000100:00100000:0.0:1746126600.372986:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:30805:x1830945721046016:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 619us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.372992:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8691 00000100:00100000:0.0:1746126600.379740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.379788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.381979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.382004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.389768:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721047040 00000100:00100000:0.0:1746126600.389772:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721047040 00010000:00010000:0.0:1746126600.389790:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44600/0xb50e825867610e1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3b8 expref: 34 pid: 9686 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.389809:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721047168 00000100:00100000:0.0:1746126600.389811:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721047168 00010000:00010000:0.0:1746126600.389818:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d2f200/0xb50e825867610df8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c395 expref: 21 pid: 10890 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.389857:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6491 00000100:00100000:0.0:1746126600.389863:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721047040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.389871:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.389887:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ace44600/0xb50e825867610e1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3b8 expref: 34 pid: 9686 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.389895:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ace44600/0xb50e825867610e1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3b8 expref: 34 pid: 9686 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.389909:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ace44600/0xb50e825867610e1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3b8 expref: 34 pid: 9686 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.389928:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.389946:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721047040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.389950:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6491 00000100:00100000:0.0:1746126600.389962:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6492 00000100:00100000:0.0:1746126600.389966:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721047168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.389972:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.389978:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d2f200/0xb50e825867610df8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c395 expref: 21 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.389986:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d2f200/0xb50e825867610df8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c395 expref: 21 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.389995:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d2f200/0xb50e825867610df8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c395 expref: 21 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.390002:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.390003:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.390008:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.390016:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.390038:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.390048:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721208704:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126600.390092:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.394791:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721047424 00000100:00100000:0.0:1746126600.394798:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721047424 00000100:00100000:0.0:1746126600.394864:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8692 00000100:00100000:0.0:1746126600.394872:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:30805:x1830945721047424:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126600.394887:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.394903:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341600/0xb50e825867610e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c3fe expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.394978:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.394989:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.394996:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395001:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395007:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395012:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.395037:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395047:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 8 pid: 20362 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.395059:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721208832:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126600.395146:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395157:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 12 pid: 20362 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.395164:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721208960:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126600.395200:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395206:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 225 pid: 20362 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.395212:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721209088:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126600.395231:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.395242:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 12 pid: 14549 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.395248:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721209216:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.395262:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.407630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.407662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.407708:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721208832:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.407743:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721208960:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.407762:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721209088:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.407778:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721209216:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126600.407799:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126600.407824:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.407868:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.407878:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.407897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.407912:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721047808 00000100:00100000:0.0:1746126600.407916:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721047808 00010000:00010000:0.0:1746126600.407937:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 9 pid: 20362 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.407956:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721048064 00000100:00100000:0.0:1746126600.407958:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721048064 00010000:00010000:0.0:1746126600.407965:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 226 pid: 20362 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.407974:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721047936 00000100:00100000:0.0:1746126600.407975:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721047936 00010000:00010000:0.0:1746126600.407981:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 13 pid: 20362 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.407986:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721048192 00000100:00100000:0.0:1746126600.407987:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721048192 00010000:00010000:0.0:1746126600.407992:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 14 pid: 14549 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.407999:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6493 00000100:00100000:0.0:1746126600.408004:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721047808:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.408014:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.408018:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 9 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408025:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 9 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408039:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340a00/0xb50e825867610e5a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3c6 expref: 9 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408052:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.408056:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408063:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408067:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.408101:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721047808:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.408106:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6493 00000100:00100000:0.0:1746126600.408117:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6494 00000100:00100000:0.0:1746126600.408120:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:1966:x1830945721048064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.408126:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.408132:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 226 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408138:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 226 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408147:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e825867610d6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c309 expref: 226 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408155:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.408157:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408162:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408165:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.408185:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:1966:x1830945721048064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 64us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.408189:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6494 00000100:00100000:0.0:1746126600.408196:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6495 00000100:00100000:0.0:1746126600.408199:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721047936:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.408204:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.408207:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 14 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408213:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 14 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408221:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83e00/0xb50e825867610e37 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3bf expref: 14 pid: 20362 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408227:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.408230:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408235:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408238:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.408246:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721047936:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 47us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.408255:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6495 00000100:00100000:0.0:1746126600.408262:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6496 00000100:00100000:0.0:1746126600.408269:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721048192:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.408276:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.408279:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 12 pid: 14549 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408286:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 12 pid: 14549 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408296:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44e00/0xb50e825867610d5e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c302 expref: 12 pid: 14549 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.408302:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.408304:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408309:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408314:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408328:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.408341:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721048192:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 75us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.408346:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6496 00010000:00010000:0.0:1746126600.408370:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408375:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126600.408387:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126600.408490:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341600/0xb50e825867610e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3fe expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.408501:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341800/0xb50e825867610e99 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3fe expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.408506:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.408508:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126600.408509:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f341800, rc 0) 00000100:00100000:0.0:1746126600.408526:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30805:x1830945721047424:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13656us (14207us total) trans 8589942831 rc 0/0 00000100:00100000:0.0:1746126600.408532:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8692 00000100:00100000:0.0:1746126600.408541:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721048448 00000100:00100000:0.0:1746126600.408544:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721048448 00000100:00100000:0.0:1746126600.408559:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8693 00000100:00100000:0.0:1746126600.408564:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:30807:x1830945721048448:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126600.408575:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.408583:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341e00/0xb50e825867610ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c405 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.408643:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408651:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408656:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408664:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408668:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408672:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408740:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341200/0xb50e825867610ebc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408746:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341200/0xb50e825867610ebc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408752:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341200/0xb50e825867610ebc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126600.408757:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126600.408786:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408791:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408797:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408801:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f341000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126600.408803:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408808:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408814:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126600.408815:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126600.408818:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408822:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341000/0xb50e825867610eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408853:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408858:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408862:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408865:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f340000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126600.408867:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408871:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408880:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135bcbc00) 00010000:00010000:0.0:1746126600.408882:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126600.408884:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408888:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f340000/0xb50e825867610eb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126600.408910:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341e00/0xb50e825867610ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c405 expref: 228 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.408919:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f341200/0xb50e825867610ebc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c405 expref: 227 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.408924:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.408926:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126600.408927:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f341200, rc 0) 00000100:00100000:0.0:1746126600.408944:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:30807:x1830945721048448:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 380us (1320us total) trans 8589942832 rc 0/0 00000100:00100000:0.0:1746126600.408949:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8693 00000100:00100000:0.0:1746126600.409070:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721047680 00000100:00100000:0.0:1746126600.409074:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721047680 00002000:00100000:0.0:1746126600.409097:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3371008->3375103) req@ffff88008e3a9180 x1830945721047680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.409106:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9180 with x1830945721047680 ext(3371008->3375103) 00002000:00010000:0.0:1746126600.409110:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9180 00000100:00100000:0.0:1746126600.409123:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7209 00000100:00100000:0.0:1746126600.409128:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721047680:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126600.409243:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721047680:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 114us (1579us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126600.409248:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7209 00002000:00100000:0.0:1746126600.409253:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3371008->3375103) req@ffff88008e3a9180 x1830945721047680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:361/0 lens 488/4536 e 0 to 0 dl 1746126611 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.409260:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9180 with x1830945721047680 ext(3371008->3375103) 00002000:00010000:0.0:1746126600.409262:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9180 00000100:00100000:0.0:1746126600.415541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.420158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.420865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126600.422698:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c5c00/0xb50e825867610ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126600.422705:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c5c00/0xb50e825867610ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126600.422735:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126600.422739:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126600.422750:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c5c00/0xb50e825867610ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126600.422775:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c5a00/0xb50e825867610eca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c40c expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.423252:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c5c00/0xb50e825867610ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c40c expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.423257:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.423261:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126600.423263:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45c5c00, rc 0) 00000100:00100000:0.0:1746126600.423290:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30805:x1830945721048576:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7215us (7756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.423295:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8694 00000100:00100000:0.0:1746126600.428330:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721049728 00000100:00100000:0.0:1746126600.428335:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721049728 00000100:00100000:0.0:1746126600.428368:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721049856 00000100:00100000:0.0:1746126600.428370:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721049856 00000100:00100000:0.0:1746126600.428383:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12490 00000100:00100000:0.0:1746126600.428389:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721049728:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126600.428400:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.428411:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f341000/0xb50e825867610edf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c41a expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.428424:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.428432:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f341000/0xb50e825867610edf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c41a expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.428438:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f341000/0xb50e825867610edf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c41a expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.428446:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f341000, rc 0) 00000100:00100000:0.0:1746126600.428477:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721049728:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 89us (534us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126600.428482:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12490 00000100:00100000:0.0:1746126600.428495:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12491 00000100:00100000:0.0:1746126600.428500:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721049856:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126600.428506:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.428514:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f341e00/0xb50e825867610ee6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c421 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.428545:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eebd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721209856:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126600.428587:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.431456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126600.433372:0:23766:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126599 -> 1746126600 00002000:00010000:0.0:1746126600.433377:0:23766:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126597 -> 1746126600 00002000:00010000:0.0:1746126600.433379:0:23766:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126599 -> 1746126600 00000100:00100000:0.0:1746126600.433399:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eebd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721209856:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126600.433429:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f341e00/0xb50e825867610ee6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c421 expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.433441:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f341e00/0xb50e825867610ee6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c421 expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.433451:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f341e00, rc 0) 00000100:00100000:0.0:1746126600.433502:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721049856:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5000us (5528us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126600.433509:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12491 00000100:00100000:0.0:1746126600.438265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.443822:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.448193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.449200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.451409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.485779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.492943:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721051776 00000100:00100000:0.0:1746126600.492955:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721051776 00000100:00100000:0.0:1746126600.492997:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3622 00000100:00100000:0.0:1746126600.493008:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5353850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+230:30813:x1830945721051776:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126600.493262:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5353850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:30813:x1830945721051776:12345-192.168.203.2@tcp:35:cat.0 Request processed in 257us (478us total) trans 8589942837 rc 0/0 00000100:00100000:0.0:1746126600.493268:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3622 00000100:00100000:0.0:1746126600.499042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.520439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.544144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.545906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.551562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.562049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.562075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.562120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.562149:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721053312 00000100:00100000:0.0:1746126600.562157:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721053312 00010000:00010000:0.0:1746126600.562211:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 22 pid: 10890 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.562242:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6501 00000100:00100000:0.0:1746126600.562249:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721053312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.562264:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.562290:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 22 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.562307:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 22 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.562329:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4532a00/0xb50e825867610e61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3371008->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3cd expref: 22 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.562346:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.562348:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.562355:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f82c00/0xb50e825867610f25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c444 expref: 33 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.562362:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f82c00/0xb50e825867610f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c444 expref: 33 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.562395:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092f82c00/0xb50e825867610f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c444 expref: 33 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.562406:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721210368:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126600.562465:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.584326:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721053824 00000100:00100000:0.0:1746126600.584336:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721053824 00002000:00100000:0.0:1746126600.584381:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f254380 x1830945721053824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.584391:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254380 with x1830945721053824 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.584396:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f254380 00000100:00100000:0.0:1746126600.584430:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7215 00000100:00100000:0.0:1746126600.584437:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721053824:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126600.598272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.598289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.598303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.598569:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6503 00000100:00100000:0.0:1746126600.598577:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721054464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.598585:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.598590:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83800/0xb50e825867610f41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c43d expref: 15 pid: 15560 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.598599:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83800/0xb50e825867610f41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c43d expref: 15 pid: 15560 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.598692:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f83800/0xb50e825867610f41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c43d expref: 15 pid: 15560 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.598727:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.598730:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82a00/0xb50e825867610f64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.598735:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82a00/0xb50e825867610f64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.598738:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.598756:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721054464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 181us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.598760:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6503 00010000:00010000:0.0:1746126600.603648:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82a00/0xb50e825867610f64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.603655:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82a00/0xb50e825867610f64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126600.603678:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126600.604961:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82200/0xb50e825867610f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c459 expref: 233 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.604979:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82a00/0xb50e825867610f64 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c459 expref: 232 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.604986:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.604989:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126600.604991:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f82a00, rc 0) 00000100:00100000:0.0:1746126600.605036:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:30818:x1830945721054080:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 14888us (17601us total) trans 8589942840 rc 0/0 00000100:00100000:0.0:1746126600.605044:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8698 00000100:00100000:0.0:1746126600.622865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.628421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.643875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.654785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.654849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.667119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.672122:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721211648:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126600.672140:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.672959:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721056000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6131us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.672973:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6508 00000100:00100000:0.0:1746126600.677737:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.678538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.681751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.695354:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721057280 00000100:00100000:0.0:1746126600.695361:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721057280 00010000:00010000:0.0:1746126600.695389:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4533c00/0xb50e825867610e6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3db expref: 11 pid: 8438 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.695417:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721057664 00000100:00100000:0.0:1746126600.695420:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721057664 00010000:00010000:0.0:1746126600.695430:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009379a800/0xb50e825867610d88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c325 expref: 23 pid: 23766 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.695443:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721057408 00000100:00100000:0.0:1746126600.695445:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721057408 00010000:00010000:0.0:1746126600.695452:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb1400/0xb50e825867610dab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c34f expref: 35 pid: 8436 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.695464:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6511 00000100:00100000:0.0:1746126600.695470:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721057280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.695481:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.695498:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4533c00/0xb50e825867610e6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3db expref: 11 pid: 8438 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.695507:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4533c00/0xb50e825867610e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3db expref: 11 pid: 8438 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.696287:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.696318:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721057280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 847us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.696325:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6511 00000100:00100000:0.0:1746126600.696423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.697959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.700714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.711079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.711432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.715725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.728691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.736609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.738140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.745966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.764334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.766977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.773640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.780739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.781133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.785382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.785407:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721060864 00000100:00100000:0.0:1746126600.785418:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721060864 00002000:00100000:0.0:1746126600.785450:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ed49f80 x1830945721060864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:361/0 lens 488/0 e 0 to 0 dl 1746126611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.785459:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49f80 with x1830945721060864 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.785462:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed49f80 00000100:00100000:0.0:1746126600.785479:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7224 00000100:00100000:0.0:1746126600.785488:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721060864:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126600.804949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.804991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.805022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.805052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.805072:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721061120 00000100:00100000:0.0:1746126600.805085:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721061120 00000100:00100000:0.0:1746126600.805206:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12503 00000100:00100000:0.0:1746126600.805216:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721061376:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126600.805233:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.805249:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867610fe9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c4b4 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.805271:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.805273:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.805282:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867610fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c4b4 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.805296:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867610fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c4b4 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.805307:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f82a00, rc 0) 00000100:00100000:0.0:1746126600.805342:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721061376:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.805347:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12503 00000100:00100000:0.0:1746126600.805361:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12505 00000100:00100000:0.0:1746126600.805367:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721060992:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126600.805372:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.805380:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f82e00/0xb50e825867610ff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c49f expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.805403:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721213952:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126600.805424:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.805776:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721060864:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 20288us (20395us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126600.805784:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7224 00002000:00100000:0.0:1746126600.805792:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ed49f80 x1830945721060864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:361/0 lens 488/440 e 0 to 0 dl 1746126611 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126600.805801:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49f80 with x1830945721060864 ext(3145728->4194303) 00002000:00010000:0.0:1746126600.805805:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed49f80 00000100:00100000:0.0:1746126600.821937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.844315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.847993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.848036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.848110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.848310:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12510 00000100:00100000:0.0:1746126600.848319:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721063296:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126600.848335:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5400/0xb50e825867611044 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848345:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848353:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136569800/0xb50e825867610ff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c4bb expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.848358:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.848360:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.848362:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5400/0xb50e825867611044 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848378:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136569800/0xb50e825867610ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c4bb expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126600.848386:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136569800/0xb50e825867610ff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c4bb expref: 11 pid: 4641 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.848395:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721214336:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126600.848424:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848432:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 21 pid: 10890 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.848439:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721214464:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.848452:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.848474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.848489:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721062912 00000100:00100000:0.0:1746126600.848491:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721062912 00000100:00100000:0.0:1746126600.848510:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12512 00000100:00100000:0.0:1746126600.848515:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721062912:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126600.848528:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5a00/0xb50e825867611052 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848536:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d521000/0xb50e825867610fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c48a expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848541:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126600.848542:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126600.848544:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5a00/0xb50e825867611052 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848557:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d521000/0xb50e825867610fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c48a expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.848564:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d521000/0xb50e825867610fb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c48a expref: 21 pid: 10890 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.848570:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721215104:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126600.848588:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.848614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.851013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.851046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.851073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.851089:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721063424 00000100:00100000:0.0:1746126600.851095:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721063424 00000100:00100000:0.0:1746126600.851129:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721063680 00000100:00100000:0.0:1746126600.851132:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721063680 00000100:00100000:0.0:1746126600.851147:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12514 00000100:00100000:0.0:1746126600.851152:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721063424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126600.851163:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.851182:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a45c4400/0xb50e825867611060 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c4d7 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.851221:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721215616:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126600.851263:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.851277:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12516 00000100:00100000:0.0:1746126600.851282:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721063552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126600.851287:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.851293:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f82e00/0xb50e82586761106e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c4de expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.851310:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721215744:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126600.851324:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126600.851341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.851372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.854158:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721215104:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126600.854185:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5a00/0xb50e825867611052 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.854225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.854529:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.854559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.859931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.859949:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721064576 00000100:00100000:0.0:1746126600.859952:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721064576 00010000:00010000:0.0:1746126600.859967:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f83c00/0xb50e825867610e68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3d4 expref: 14 pid: 9686 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746126600.859981:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6524 00000100:00100000:0.0:1746126600.859987:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721064576:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.859993:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.860003:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f83c00/0xb50e825867610e68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3d4 expref: 14 pid: 9686 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.860010:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f83c00/0xb50e825867610e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3d4 expref: 14 pid: 9686 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.860020:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f83c00/0xb50e825867610e68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c3d4 expref: 14 pid: 9686 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746126600.860034:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.860070:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721064576:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.860076:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6524 00000100:00100000:0.0:1746126600.860110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.860128:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721065088 00000100:00100000:0.0:1746126600.860131:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721065088 00010000:00010000:0.0:1746126600.860143:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 24 pid: 10890 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.860179:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6525 00000100:00100000:0.0:1746126600.861408:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721065088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.861428:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.861450:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 26 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.861460:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 26 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.861475:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f43fc00/0xb50e825867610fbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c491 expref: 26 pid: 10890 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.861486:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.861487:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.861490:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5400/0xb50e825867611044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.861495:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45c5400/0xb50e825867611044 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.861514:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.861636:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721065088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1449us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.861644:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6525 00000100:00100000:0.0:1746126600.863747:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721065344 00000100:00100000:0.0:1746126600.863754:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721065344 00010000:00010000:0.0:1746126600.863780:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520400/0xb50e825867610fa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c475 expref: 20 pid: 17475 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.863800:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6529 00000100:00100000:0.0:1746126600.863805:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721065344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.863816:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.863860:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d520400/0xb50e825867610fa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c475 expref: 20 pid: 17475 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.863871:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d520400/0xb50e825867610fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c475 expref: 20 pid: 17475 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.863888:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520400/0xb50e825867610fa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c475 expref: 20 pid: 17475 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.863900:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.863901:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126600.863905:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.863913:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.863930:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.863953:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721065344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 148us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.863958:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6529 00010000:00010000:0.0:1746126600.864010:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864017:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864033:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864039:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864046:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864052:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f341800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126600.864056:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864062:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864070:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.864076:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f341800/0xb50e825867611059 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126600.864116:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721063168:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 14968us (15502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.864122:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12513 00000100:00100000:0.0:1746126600.866250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.866277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.873497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.874106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.884130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.884151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.884185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.884211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.884278:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721066752 00000100:00100000:0.0:1746126600.884281:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721066752 00010000:00010000:0.0:1746126600.884295:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d995400/0xb50e825867610d0a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c2ed expref: 18 pid: 14548 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746126600.884308:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6533 00000100:00100000:0.0:1746126600.884312:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+233:1963:x1830945721066624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126600.884318:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126600.884322:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f600/0xb50e825867610d73 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c310 expref: 233 pid: 14549 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.884335:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f600/0xb50e825867610d73 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c310 expref: 233 pid: 14549 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746126600.884373:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.884377:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761108a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126600.884382:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126600.884399:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+233:1963:x1830945721066624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126600.884405:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6533 00000001:00080000:0.0:1746126600.915285:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942840 is committed 00000001:00080000:0.0:1746126600.915300:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942831 is committed 00000001:00080000:0.0:1746126600.915305:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942841 is committed 00000001:00080000:0.0:1746126600.915315:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942842 is committed 00000001:00080000:0.0:1746126600.915325:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942834 is committed 00000001:00080000:0.0:1746126600.915338:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942846 is committed 00000004:00080000:0.0:1746126600.915341:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:0.0:1746126600.915347:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746126600.915352:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1986 committed 00000004:00080000:0.0:1746126600.915353:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00080000:0.0:1746126600.915355:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746126600.915356:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000004:00080000:0.0:1746126600.915357:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746126600.915359:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:0.0:1746126600.915360:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746126600.915361:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:0.0:1746126600.915362:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746126600.915363:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746126600.915364:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000004:00080000:0.0:1746126600.915365:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1886 committed 00000004:00080000:0.0:1746126600.915366:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746126600.915367:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746126600.915368:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1885 committed 00000001:00080000:0.0:1746126600.915375:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942843 is committed 00000100:00100000:0.0:1746126600.915668:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721216512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.915700:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126600.916001:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721216384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.916899:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126600.916916:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721217024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.916930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126600.916937:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721217536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.916947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126600.916952:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721218048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.916963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126600.916980:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5b2680/2, rc 0, transno 21474840154 00000100:00100000:0.0:1746126600.916984:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721216512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.917000:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1746126600.917009:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3294:x1830945721216384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126600.917097:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126600.917099:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126600 -> 1746126600 00002000:00010000:0.0:1746126600.917101:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126599 -> 1746126599 00002000:00010000:0.0:1746126600.917103:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126600 -> 1746126600 00002000:00010000:0.0:1746126600.917105:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126600.917128:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3294:x1830945721216384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (227us total) trans 17179872991 rc 0/0 00000100:00100000:0.0:1746126600.917133:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1746126600.917145:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12534 00000100:00100000:0.0:1746126600.917150:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3294:x1830945721217024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126600.917253:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3294:x1830945721217024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (321us total) trans 21474840160 rc 0/0 00000100:00100000:0.0:1746126600.917258:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12534 00000100:00100000:0.0:1746126600.917267:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12536 00000100:00100000:0.0:1746126600.917272:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3294:x1830945721218048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.917349:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3294:x1830945721218048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (383us total) trans 17179872993 rc 0/0 00000100:00100000:0.0:1746126600.917355:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12536 00000004:00080000:0.0:1746126600.917376:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b17100/2, rc 0, transno 17179872991 00000100:00100000:0.0:1746126600.917379:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721216384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126600.917385:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5b0e00/2, rc 0, transno 21474840160 00000100:00100000:0.0:1746126600.917388:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721217024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126600.917395:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b16300/2, rc 0, transno 17179872992 00000100:00100000:0.0:1746126600.917398:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721217536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126600.917403:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15c00/2, rc 0, transno 17179872993 00000100:00100000:0.0:1746126600.917405:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721218048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.917896:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721218560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.917918:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126600.918173:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad1c00/2, rc 0, transno 17179872994 00000100:00100000:0.0:1746126600.918176:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721218560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126600.918856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.919532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.922101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.929276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.931232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.931602:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721068416 00000100:00100000:0.0:1746126600.931610:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721068416 00000100:00100000:0.0:1746126600.931654:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8707 00000100:00100000:0.0:1746126600.931662:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:30830:x1830945721068416:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126600.931680:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126600.931703:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523000/0xb50e8258676110a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c516 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.932082:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932096:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932106:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932116:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932120:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932125:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932228:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522800/0xb50e8258676110bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932233:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522800/0xb50e8258676110bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932242:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522800/0xb50e8258676110bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126600.932250:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126600.932338:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932344:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932350:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932355:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d523600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126600.932359:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932364:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932373:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126600.932376:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126600.932380:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932385:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e8258676110ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932398:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932403:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932412:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932416:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d523e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126600.932418:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.932423:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.934460:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1000) 00010000:00010000:0.0:1746126600.934463:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126600.934468:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.934474:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523e00/0xb50e8258676110b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126600.934537:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523000/0xb50e8258676110a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c516 expref: 225 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.934550:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522800/0xb50e8258676110bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c516 expref: 224 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126600.934556:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126600.934558:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126600.934560:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d522800, rc 0) 00000100:00100000:0.0:1746126600.934956:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:30830:x1830945721068416:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3294us (3726us total) trans 8589942848 rc 0/0 00000100:00100000:0.0:1746126600.934964:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8707 00000100:00100000:0.0:1746126600.957050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.966059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.983684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126600.994456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.007823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.011423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.016633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.016677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.017484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.019884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.019905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.019920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.020005:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721070464 00000100:00100000:0.0:1746126601.020012:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721070464 00000100:00100000:0.0:1746126601.020046:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8709 00000100:00100000:0.0:1746126601.020052:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:30830:x1830945721070464:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126601.020069:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.020072:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746126601.020093:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522800/0xb50e8258676110bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c516 expref: 224 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.020112:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5c00/0xb50e825867611098 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c508 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.020120:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.020123:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126601.020132:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e82586761110f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c55c expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126601.029926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.030508:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721070720 00000100:00100000:0.0:1746126601.030511:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721070720 00000100:00100000:0.0:1746126601.036074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126601.037509:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465000/0xb50e82586761112b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126601.037515:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465000/0xb50e82586761112b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126601.045428:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7231 00000100:00100000:0.0:1746126601.045438:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721071488:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126601.046461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.046487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.046584:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721071744 00000100:00100000:0.0:1746126601.046588:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721071744 00002000:00100000:0.0:1746126601.046611:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009204f480 x1830945721071744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.046621:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f480 with x1830945721071744 ext(1048576->2097151) 00002000:00010000:0.0:1746126601.046626:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204f480 00000100:00100000:0.0:1746126601.046637:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721072000 00000100:00100000:0.0:1746126601.046640:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721072000 00002000:00100000:0.0:1746126601.046649:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880135bcf100 x1830945721072000/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.046656:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf100 with x1830945721072000 ext(1048576->2097151) 00002000:00010000:0.0:1746126601.046660:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcf100 00000100:00100000:0.0:1746126601.046668:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7232 00000100:00100000:0.0:1746126601.046673:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721071744:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126601.047598:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721070976 00000100:00100000:0.0:1746126601.047602:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721070976 00000100:00100000:0.0:1746126601.047620:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8711 00000100:00100000:0.0:1746126601.047624:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:30834:x1830945721070976:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126601.047636:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.047648:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c56a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.047682:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.047691:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.047700:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.047702:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126601.047705:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464c00/0xb50e825867611132 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c563 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.047710:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d523600, rc 0) 00000100:00100000:0.0:1746126601.047730:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30834:x1830945721070976:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 106us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.047735:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8711 00000100:00100000:0.0:1746126601.092265:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721071744:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 45581us (45795us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126601.092280:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7232 00002000:00100000:0.0:1746126601.092291:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009204f480 x1830945721071744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:362/0 lens 488/440 e 0 to 0 dl 1746126612 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.092300:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f480 with x1830945721071744 ext(1048576->2097151) 00002000:00010000:0.0:1746126601.092305:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204f480 00000001:00080000:0.0:1746126601.101041:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942848 is committed 00000001:00080000:0.0:1746126601.101056:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942851 is committed 00000004:00080000:0.0:1746126601.101060:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1900 committed 00000004:00080000:0.0:1746126601.101066:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1996 committed 00000004:00080000:0.0:1746126601.101072:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1995 committed 00000004:00080000:0.0:1746126601.101074:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1899 committed 00000004:00080000:0.0:1746126601.101075:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746126601.101078:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:0.0:1746126601.101080:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746126601.101082:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:0.0:1746126601.101083:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746126601.101084:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000004:00080000:0.0:1746126601.101086:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746126601.101087:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746126601.101088:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:0.0:1746126601.101090:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:0.0:1746126601.101091:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1989 committed 00000004:00080000:0.0:1746126601.101093:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746126601.101094:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000001:00080000:0.0:1746126601.102532:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942850 is committed 00000001:00080000:0.0:1746126601.102539:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942849 is committed 00000100:00100000:0.0:1746126601.102645:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721220224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.102671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102685:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721220736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.102698:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102718:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126601.102735:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102749:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.102763:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102773:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721221120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.102786:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102796:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746126601.102799:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.102812:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102822:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.102849:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126601.102864:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721220992 00000100:00100000:0.0:1746126601.102867:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721220992 00000100:00100000:0.0:1746126601.102883:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12553 00000100:00100000:0.0:1746126601.102887:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3294:x1830945721220736:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126601.105474:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcd880/2, rc 0, transno 17179872995 00000100:00100000:0.0:1746126601.105480:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721220224:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126601.105527:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126601.105530:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126601.105532:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126601.105533:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126601.105535:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126601.105560:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3294:x1830945721220736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2672us (2860us total) trans 17179873003 rc 0/0 00000100:00100000:0.0:1746126601.105566:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12553 00000100:00100000:0.0:1746126601.105576:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721219712 00000100:00100000:0.0:1746126601.105578:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721219712 00000004:00080000:0.0:1746126601.106017:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcc380/2, rc 0, transno 17179873000 00000100:00100000:0.0:1746126601.106021:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126601.106028:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df7100/2, rc 0, transno 17179873001 00000100:00100000:0.0:1746126601.106031:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126601.106038:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab8700/2, rc 0, transno 21474840168 00000100:00100000:0.0:1746126601.106041:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126601.106047:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df5880/2, rc 0, transno 17179872998 00000100:00100000:0.0:1746126601.106049:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721220608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126601.106055:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df6300/2, rc 0, transno 17179872999 00000100:00100000:0.0:1746126601.106057:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721221120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126601.106067:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df6680/2, rc 0, transno 17179873003 00000100:00100000:0.0:1746126601.106070:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721220736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126601.113973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.119902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.121210:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721072768 00000100:00100000:0.0:1746126601.121213:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721072768 00000100:00100000:0.0:1746126601.121243:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12564 00000100:00100000:0.0:1746126601.121249:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+31:30828:x1830945721072768:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126601.121256:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.121265:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761114e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c57f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.123055:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.123060:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.123070:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761114e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c57f expref: 32 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.123086:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761114e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c57f expref: 32 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.123094:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b600, rc 0) 00000100:00100000:0.0:1746126601.123150:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:30828:x1830945721072768:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1900us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.123156:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12564 00000100:00100000:0.0:1746126601.123910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.123938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.131997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.133954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.133972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.134283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.136977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.145705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.158012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.158099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.166192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.182418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.182462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.208290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.213623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.221797:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7247 00000100:00100000:0.0:1746126601.221805:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721078272:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126601.242186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.278900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.286471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.303487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.335968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.370420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.373717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.374453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.375267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.375291:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721080064 00000100:00100000:0.0:1746126601.375294:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721080064 00000100:00100000:0.0:1746126601.379417:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12576 00000100:00100000:0.0:1746126601.379425:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721080064:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126601.379436:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.379449:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931c4600/0xb50e8258676111e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c5da expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126601.379492:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ada5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721223296:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126601.379554:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126601.379623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.379660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.379680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.380066:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12579 00000100:00100000:0.0:1746126601.380073:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721080576:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126601.380081:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.380089:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931c5000/0xb50e8258676111f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c5f6 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.380100:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.380102:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.380108:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931c5000/0xb50e8258676111f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5f6 expref: 12 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.380120:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931c5000/0xb50e8258676111f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5f6 expref: 12 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.380128:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931c5000, rc 0) 00000100:00100000:0.0:1746126601.380146:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1966:x1830945721080576:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 74us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.380152:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12579 00000100:00100000:0.0:1746126601.380197:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721223040:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126601.380206:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721223168:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126601.380224:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e8258676111d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3403776->3932159] (req 3403776->3932159) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5e1 expref: 37 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.380233:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878c00, rc 0) 00000100:00100000:0.0:1746126601.380250:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+37:30843:x1830945721080192:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5659us (5799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.380256:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12574 00000100:00100000:0.0:1746126601.380675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.382191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.382230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.393338:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721081216 00000100:00100000:0.0:1746126601.393347:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721081216 00002000:00100000:0.0:1746126601.393392:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3403776->3407871) req@ffff880092b14700 x1830945721081216/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.393401:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14700 with x1830945721081216 ext(3403776->3407871) 00002000:00010000:0.0:1746126601.393406:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b14700 00000100:00100000:0.0:1746126601.393423:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7250 00000100:00100000:0.0:1746126601.393429:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721081216:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126601.393590:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721081216:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 161us (331us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126601.393596:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7250 00002000:00100000:0.0:1746126601.393601:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3403776->3407871) req@ffff880092b14700 x1830945721081216/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:362/0 lens 488/4536 e 0 to 0 dl 1746126612 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.393607:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14700 with x1830945721081216 ext(3403776->3407871) 00002000:00010000:0.0:1746126601.393610:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b14700 00000100:00100000:0.0:1746126601.394611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.399245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.399286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.399310:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721081728 00000100:00100000:0.0:1746126601.399318:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721081728 00010000:00010000:0.0:1746126601.399353:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878e00/0xb50e8258676111a9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5c5 expref: 226 pid: 15560 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746126601.399390:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721081600 00000100:00100000:0.0:1746126601.399393:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721081600 00010000:00010000:0.0:1746126601.399404:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4400/0xb50e8258676111cc lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5cc expref: 9 pid: 20362 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746126601.399419:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6544 00000100:00100000:0.0:1746126601.399426:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:1963:x1830945721081728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126601.399439:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126601.399444:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878e00/0xb50e8258676111a9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5c5 expref: 226 pid: 15560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.399454:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878e00/0xb50e8258676111a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5c5 expref: 226 pid: 15560 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.399476:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.399480:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878000/0xb50e82586761120b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126601.399487:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878000/0xb50e82586761120b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126601.399492:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126601.399528:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:1963:x1830945721081728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.399535:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6544 00000100:00100000:0.0:1746126601.399550:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6545 00000100:00100000:0.0:1746126601.399554:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721081600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126601.399560:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126601.399563:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4400/0xb50e8258676111cc lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5cc expref: 9 pid: 20362 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.399572:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4400/0xb50e8258676111cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c5cc expref: 9 pid: 20362 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.399581:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.399584:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878000/0xb50e82586761120b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126601.399590:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878000/0xb50e82586761120b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126601.399596:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878000/0xb50e82586761120b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126601.399611:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126601.399623:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721081600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.399628:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6545 00000100:00100000:0.0:1746126601.402559:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721081984 00000100:00100000:0.0:1746126601.402567:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721081984 00002000:00100000:0.0:1746126601.402609:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3928064->3932159) req@ffff880092b14e00 x1830945721081984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.402619:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14e00 with x1830945721081984 ext(3928064->3932159) 00002000:00010000:0.0:1746126601.402624:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b14e00 00000100:00100000:0.0:1746126601.402640:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7251 00000100:00100000:0.0:1746126601.402647:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721081984:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126601.404256:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721081984:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1604us (1759us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126601.404270:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7251 00002000:00100000:0.0:1746126601.404278:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3928064->3932159) req@ffff880092b14e00 x1830945721081984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:362/0 lens 488/4536 e 0 to 0 dl 1746126612 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.404286:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14e00 with x1830945721081984 ext(3928064->3932159) 00002000:00010000:0.0:1746126601.404291:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b14e00 00000100:00100000:0.0:1746126601.408685:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8717 00000100:00100000:0.0:1746126601.408697:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30846:x1830945721082368:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126601.408708:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.408725:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e825867611219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c612 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.408824:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408850:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408860:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408873:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408879:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408883:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408974:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408982:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.408988:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126601.408996:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126601.409083:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409090:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409095:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409107:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931c5600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.409110:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409117:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409127:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126601.409130:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.409133:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409138:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e82586761122e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409171:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409184:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409191:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409195:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931c5400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.409197:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409202:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409208:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8600) 00010000:00010000:0.0:1746126601.409210:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.409212:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409217:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611235 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.409252:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e825867611219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c612 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.409272:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c612 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.409281:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.409283:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126601.409286:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb50e825867611227 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.409295:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5200/0xb50e825867611227 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.409300:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931c4600, rc 0) 00000100:00100000:0.0:1746126601.409340:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30846:x1830945721082368:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 647us (821us total) trans 8589942856 rc 0/0 00000100:00100000:0.0:1746126601.409346:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8717 00000100:00100000:0.0:1746126601.409613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.410757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.420678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.424148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.424184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.424215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.430099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.430124:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721084672 00000100:00100000:0.0:1746126601.430133:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721084672 00000100:00100000:0.0:1746126601.430189:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8719 00000100:00100000:0.0:1746126601.430197:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30850:x1830945721084672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126601.430224:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.430243:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4400/0xb50e825867611274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c63c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.430358:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.430371:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.430381:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.430392:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.430396:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.430400:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432338:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e825867611289 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432352:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e825867611289 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432363:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e825867611289 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126601.432373:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126601.432474:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432480:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432486:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432491:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931c4e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.432495:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432501:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432512:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126601.432515:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.432518:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432523:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4e00/0xb50e82586761127b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432552:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432558:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432562:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432566:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931c5400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.432568:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432573:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432579:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1000) 00010000:00010000:0.0:1746126601.432581:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.432583:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432588:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5400/0xb50e825867611282 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.432631:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4400/0xb50e825867611274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c63c expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.432644:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5600/0xb50e825867611289 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c63c expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.432649:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.432651:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126601.432653:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931c5600, rc 0) 00000100:00100000:0.0:1746126601.432688:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:30850:x1830945721084672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2493us (2600us total) trans 8589942858 rc 0/0 00000100:00100000:0.0:1746126601.432695:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8719 00000100:00100000:0.0:1746126601.434182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.437517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.440714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.441333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.445962:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721224960:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126601.445992:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4878000/0xb50e825867611297 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c643 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.446005:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4878000/0xb50e825867611297 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c643 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.446014:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878000, rc 0) 00000100:00100000:0.0:1746126601.446053:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721085568:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4397us (4719us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126601.446058:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12585 00000100:00100000:0.0:1746126601.452173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.465570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.474378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.490226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.499054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.525908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.531442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.531472:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721086976 00000100:00100000:0.0:1746126601.531479:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721086976 00000100:00100000:0.0:1746126601.531530:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8720 00000100:00100000:0.0:1746126601.531537:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:30855:x1830945721086976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126601.531559:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.531576:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4400/0xb50e8258676112b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c65f expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.531687:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531699:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531708:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531718:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531723:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531728:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531853:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4c00/0xb50e8258676112c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531861:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4c00/0xb50e8258676112c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531866:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4c00/0xb50e8258676112c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126601.531875:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126601.531957:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531963:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531969:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531974:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45c4800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.531977:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531982:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.531991:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126601.531993:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.531996:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532000:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4800/0xb50e8258676112ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532017:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532022:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532026:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532029:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45c4a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.532030:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532034:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532038:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0a1100) 00010000:00010000:0.0:1746126601.532040:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.532042:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532045:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4a00/0xb50e8258676112c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126601.532073:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4400/0xb50e8258676112b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c65f expref: 229 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.532082:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45c4c00/0xb50e8258676112c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c65f expref: 228 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.532088:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.532090:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126601.532092:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45c4c00, rc 0) 00000100:00100000:0.0:1746126601.532122:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+228:30855:x1830945721086976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 586us (687us total) trans 8589942862 rc 0/0 00000100:00100000:0.0:1746126601.532128:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8720 00000100:00100000:0.0:1746126601.532225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.541132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.546010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.546050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.546081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.546653:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12591 00000100:00100000:0.0:1746126601.546662:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721087744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126601.546669:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.546676:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a45c4400/0xb50e8258676112e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c674 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126601.546696:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721225728:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126601.547787:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126601.548495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126601.550939:0:4642:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126600 -> 1746126601 00002000:00010000:0.0:1746126601.550946:0:4642:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126600 -> 1746126601 00000100:00100000:0.0:1746126601.550967:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721225728:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126601.550997:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a45c4400/0xb50e8258676112e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c674 expref: 33 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.551009:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a45c4400/0xb50e8258676112e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c674 expref: 33 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.551024:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45c4400, rc 0) 00000100:00100000:0.0:1746126601.551057:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721087744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4397us (5005us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126601.551064:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12591 00000100:00100000:0.0:1746126601.568799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.568868:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721088768 00000100:00100000:0.0:1746126601.568876:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721088768 00002000:00100000:0.0:1746126601.568915:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (303104->475135) req@ffff88009e9b9880 x1830945721088768/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.568925:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9b9880 with x1830945721088768 ext(303104->475135) 00010000:00010000:0.0:1746126601.568934:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4879c00/0xb50e82586761125f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->475135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c62e expref: 22 pid: 8436 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.568947:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4879c00/0xb50e82586761125f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->475135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c62e expref: 22 pid: 8436 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746126601.568954:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9b9880 00000100:00100000:0.0:1746126601.568976:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1644 00000100:00100000:0.0:1746126601.568983:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721088768:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126601.591620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.600494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.616805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.616873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.619960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.621562:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721090176 00000100:00100000:0.0:1746126601.621566:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721090176 00002000:00100000:0.0:1746126601.622997:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9bad80 x1830945721090176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.623004:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9bad80 with x1830945721090176 ext(1048576->2097151) 00002000:00010000:0.0:1746126601.623009:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9bad80 00000100:00100000:0.0:1746126601.654627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.685588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.685682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.694523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.694559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.694594:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721091200 00000100:00100000:0.0:1746126601.694602:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721091200 00010000:00010000:0.0:1746126601.694639:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b1a7400/0xb50e8258676112ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c658 expref: 26 pid: 8438 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746126601.697063:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6556 00000100:00100000:0.0:1746126601.697084:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721091200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126601.697104:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126601.697133:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b1a7400/0xb50e8258676112ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c658 expref: 26 pid: 8438 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.697147:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b1a7400/0xb50e8258676112ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c658 expref: 26 pid: 8438 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.697183:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.697185:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.697194:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093051c00/0xb50e82586761133f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2453504->2686975) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6a5 expref: 40 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.697202:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093051c00/0xb50e82586761133f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2453504->2686975) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6a5 expref: 40 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.697236:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093051c00/0xb50e82586761133f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2453504->2686975) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6a5 expref: 40 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126601.697249:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721227008:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126601.697342:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126601.699428:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721227008:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126601.699443:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126601.699461:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721091200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2387us (4902us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.699468:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6556 00000100:00100000:0.0:1746126601.705016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.717026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.717070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.720951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.729580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.755134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.755181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.755215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.755246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.790595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.790646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.833075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.837180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.850664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.858893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.860993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.861032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.872496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.872547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.872563:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721095040 00000100:00100000:0.0:1746126601.872571:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721095040 00010000:00010000:0.0:1746126601.872601:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d522600/0xb50e825867611307 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c690 expref: 28 pid: 8437 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746126601.890145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.896047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.908400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.910630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.910685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.932354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.950453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.953146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.954863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.961137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.961254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.961823:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.961870:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.961888:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721097216 00000100:00100000:0.0:1746126601.961891:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721097216 00000100:00100000:0.0:1746126601.961911:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721097472 00000100:00100000:0.0:1746126601.961914:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721097472 00000100:00100000:0.0:1746126601.961928:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12604 00000100:00100000:0.0:1746126601.961933:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721097216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126601.961940:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.961950:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf06400/0xb50e8258676113d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c6eb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126601.961975:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721228672:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126601.961994:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00010000:00010000:0.0:1746126601.973194:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973202:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126601.973243:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126601.973246:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126601.973261:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973270:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973278:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973283:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973288:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973293:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e898a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.973298:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973304:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973311:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126601.973314:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.973317:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973322:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898a00/0xb50e8258676113bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973343:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973348:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973352:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973356:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e898c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126601.973358:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973363:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973369:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215300) 00010000:00010000:0.0:1746126601.973371:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126601.973374:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973382:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898c00/0xb50e8258676113c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.973410:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898800/0xb50e8258676113b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.973419:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.973424:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126601.973426:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126601.973428:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e898e00, rc 0) 00000100:00100000:0.0:1746126601.973449:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:30872:x1830945721096704:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 22820us (23007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.973454:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8725 00000100:00100000:0.0:1746126601.979334:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721098112 00000100:00100000:0.0:1746126601.979345:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721098112 00002000:00100000:0.0:1746126601.979403:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (724992->1048575) req@ffff880093af6d80 x1830945721098112/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:362/0 lens 488/0 e 0 to 0 dl 1746126612 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126601.979414:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6d80 with x1830945721098112 ext(724992->1048575) 00010000:00010000:0.0:1746126601.979423:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f435a00/0xb50e82586761135b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6c1 expref: 26 pid: 8437 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126601.979437:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f435a00/0xb50e82586761135b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 724992->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6c1 expref: 26 pid: 8437 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746126601.979444:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093af6d80 00000100:00100000:0.0:1746126601.979494:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1647 00000100:00100000:0.0:1746126601.979505:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721098112:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126601.982414:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721098624 00000100:00100000:0.0:1746126601.982418:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721098624 00000100:00100000:0.0:1746126601.982443:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12607 00000100:00100000:0.0:1746126601.982450:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721098368:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126601.982466:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.982483:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf07600/0xb50e8258676113ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c70e expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126601.982535:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721228928:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126601.982593:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126601.982609:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12608 00000100:00100000:0.0:1746126601.982615:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721098496:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126601.982622:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.982632:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf07000/0xb50e8258676113f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c715 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.982644:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.982646:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.982653:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf07000/0xb50e8258676113f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c715 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.982666:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf07000/0xb50e8258676113f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c715 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.982680:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf07000, rc 0) 00000100:00100000:0.0:1746126601.982701:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721098496:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 85us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.982707:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12608 00000100:00100000:0.0:1746126601.982722:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12609 00000100:00100000:0.0:1746126601.982727:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721098624:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126601.982732:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.982738:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf06e00/0xb50e8258676113fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c71c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.982748:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.982750:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126601.982754:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf06e00/0xb50e8258676113fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c71c expref: 13 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.982762:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf06e00/0xb50e8258676113fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c71c expref: 13 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126601.982769:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf06e00, rc 0) 00000100:00100000:0.0:1746126601.982783:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721098624:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 56us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126601.982787:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12609 00000100:00100000:0.0:1746126601.998545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.999025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126601.999044:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721099008 00000100:00100000:0.0:1746126601.999048:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721099008 00000100:00100000:0.0:1746126601.999075:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8726 00000100:00100000:0.0:1746126601.999081:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:30872:x1830945721099008:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126601.999095:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126601.999114:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06400/0xb50e82586761140a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c723 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.999220:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06c00/0xb50e825867611411 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.999234:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.999239:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06c00/0xb50e825867611411 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126601.999256:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126601.999267:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 10 pid: 20362 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746126601.999275:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721229312:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126601.999294:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.003208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.003323:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721099136 00000100:00100000:0.0:1746126602.003328:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721099136 00010000:00010000:0.0:1746126602.003375:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 11 pid: 20362 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746126602.003407:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6565 00000100:00100000:0.0:1746126602.003414:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721099136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.003428:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126602.003434:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 11 pid: 20362 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126602.003444:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 11 pid: 20362 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126602.003465:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e898e00/0xb50e8258676113cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6e4 expref: 11 pid: 20362 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746126602.003483:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.003487:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06c00/0xb50e825867611411 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.003497:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06c00/0xb50e825867611411 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.003503:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06c00/0xb50e825867611411 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.003518:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.003601:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721099136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 186us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.003607:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6565 00000100:00100000:0.0:1746126602.003696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.006436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.019595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.020692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.031235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.036754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126602.037495:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126602.041168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.063253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.069992:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ada7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721229824:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126602.070015:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.070053:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721100800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6313us (6811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.070063:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6567 00000100:00100000:0.0:1746126602.091819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.097713:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721229952:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.099361:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721230080:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126602.099399:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [577536->1048575] (req 577536->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.099418:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093050a00, rc 0) 00000100:00100000:0.0:1746126602.099671:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:30867:x1830945721101184:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7440us (7859us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.099680:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12614 00000100:00100000:0.0:1746126602.099739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.099847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.099869:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721101312 00000100:00100000:0.0:1746126602.099875:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721101312 00010000:00010000:0.0:1746126602.099903:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929aac00/0xb50e82586761142d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c731 expref: 11 pid: 4642 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746126602.099921:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721101440 00000100:00100000:0.0:1746126602.099923:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721101440 00010000:00010000:0.0:1746126602.099932:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e899400/0xb50e8258676113e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c700 expref: 33 pid: 8437 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.099946:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6568 00000100:00100000:0.0:1746126602.099953:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721101312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.099965:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126602.099984:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929aac00/0xb50e82586761142d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c731 expref: 11 pid: 4642 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746126602.099993:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929aac00/0xb50e82586761142d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c731 expref: 11 pid: 4642 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746126602.100122:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929aac00/0xb50e82586761142d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c731 expref: 11 pid: 4642 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746126602.100132:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.100133:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.100140:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.100148:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.100205:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126602.100220:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721230208:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126602.100272:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.111427:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7276 00000100:00100000:0.0:1746126602.111436:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+43:1963:x1830945721101824:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126602.112488:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721230208:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126602.112511:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.113490:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721101312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 13535us (13749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.115447:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6568 00000100:00100000:0.0:1746126602.153023:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ada6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721230464:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126602.153045:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.153084:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+42:1964:x1830945721102464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7734us (8543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.153094:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6570 00000100:00100000:0.0:1746126602.174617:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721230592:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126602.174674:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3800/0xb50e82586761145e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c75b expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.174688:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3800/0xb50e82586761145e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c75b expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.174702:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3800, rc 0) 00000100:00100000:0.0:1746126602.174747:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721102592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8367us (8526us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126602.174756:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12616 00000100:00100000:0.0:1746126602.175598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.175654:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721102976 00000100:00100000:0.0:1746126602.175660:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721102976 00002000:00100000:0.0:1746126602.175698:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1540096->1544191) req@ffff88009e3f4380 x1830945721102976/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.175708:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4380 with x1830945721102976 ext(1540096->1544191) 00002000:00010000:0.0:1746126602.175712:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f4380 00000100:00100000:0.0:1746126602.175729:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7277 00000100:00100000:0.0:1746126602.175735:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+42:1966:x1830945721102976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126602.175922:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+42:1966:x1830945721102976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 186us (325us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126602.175928:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7277 00002000:00100000:0.0:1746126602.175933:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1540096->1544191) req@ffff88009e3f4380 x1830945721102976/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/4536 e 0 to 0 dl 1746126613 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.175940:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4380 with x1830945721102976 ext(1540096->1544191) 00002000:00010000:0.0:1746126602.175944:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f4380 00000100:00100000:0.0:1746126602.181447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.181496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.184800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.194200:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721230976:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126602.194235:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126602.195199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.195227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.195249:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721103744 00000100:00100000:0.0:1746126602.195255:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721103744 00010000:00010000:0.0:1746126602.195287:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239c00/0xb50e825867611426 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c72a expref: 11 pid: 20362 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.195324:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6571 00000100:00100000:0.0:1746126602.195331:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721103744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.195343:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126602.195348:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239c00/0xb50e825867611426 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c72a expref: 11 pid: 20362 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.195357:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239c00/0xb50e825867611426 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c72a expref: 11 pid: 20362 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.195380:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239c00/0xb50e825867611426 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c72a expref: 11 pid: 20362 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.195394:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.195399:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.195406:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.195415:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.195430:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.195463:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721103744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.195469:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6571 00000100:00100000:0.0:1746126602.195495:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721103872 00000100:00100000:0.0:1746126602.195497:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721103872 00002000:00100000:0.0:1746126602.195518:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (577536->1048575) req@ffff88009e3f5500 x1830945721103872/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.195527:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5500 with x1830945721103872 ext(577536->1048575) 00010000:00010000:0.0:1746126602.195534:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 32 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.195544:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 32 pid: 8437 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746126602.195550:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f5500 00000100:00100000:0.0:1746126602.195560:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1649 00000100:00100000:0.0:1746126602.195564:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721103872:12345-192.168.203.2@tcp:4:cat.0 00010000:00010000:0.0:1746126602.197513:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.197524:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126602.197542:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126602.197684:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e825867611473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c770 expref: 19 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.197700:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c770 expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.197707:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.197710:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126602.197713:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb19e00, rc 0) 00000100:00100000:0.0:1746126602.197745:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:30879:x1830945721103616:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12777us (12947us total) trans 8589942874 rc 0/0 00000100:00100000:0.0:1746126602.197753:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8729 00000100:00100000:0.0:1746126602.235968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.243953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.244032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.244057:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721104128 00000100:00100000:0.0:1746126602.244063:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721104128 00010000:00010000:0.0:1746126602.244096:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 34 pid: 8437 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.244118:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721104384 00000100:00100000:0.0:1746126602.244120:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721104384 00010000:00010000:0.0:1746126602.244129:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d522a00/0xb50e825867611346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6ac expref: 30 pid: 8437 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746126602.244143:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6572 00000100:00100000:0.0:1746126602.244150:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721104128:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.244176:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126602.244195:0:9817:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1847 -> 1951 00010000:00010000:0.0:1746126602.244201:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 34 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.244212:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 34 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.244233:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093050a00/0xb50e825867611450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 577536->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c74d expref: 34 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.244248:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.244250:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.244257:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e82586761146c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c769 expref: 30 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.244265:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e82586761146c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c769 expref: 30 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.244298:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e82586761146c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c769 expref: 30 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126602.244309:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721231488:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126602.244369:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.244384:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6573 00000100:00100000:0.0:1746126602.244390:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721104384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.244397:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126602.244407:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d522a00/0xb50e825867611346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6ac expref: 30 pid: 8437 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746126602.244415:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d522a00/0xb50e825867611346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6ac expref: 30 pid: 8437 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746126602.244427:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d522a00/0xb50e825867611346 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c6ac expref: 30 pid: 8437 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746126602.244435:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.244454:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721104384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.244460:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6573 00000100:00100000:0.0:1746126602.251146:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721231488:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126602.251176:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.251221:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721104128:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7070us (7269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.251228:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6572 00000100:00100000:0.0:1746126602.255935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.255967:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721104768 00000100:00100000:0.0:1746126602.255976:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721104768 00002000:00100000:0.0:1746126602.256020:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e3f4000 x1830945721104768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.256031:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4000 with x1830945721104768 ext(0->1048575) 00002000:00010000:0.0:1746126602.256036:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4000 00000100:00100000:0.0:1746126602.256054:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7278 00000100:00100000:0.0:1746126602.256061:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721104768:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126602.269605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.269633:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721105024 00000100:00100000:0.0:1746126602.269642:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721105024 00002000:00100000:0.0:1746126602.269684:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1859584->1863679) req@ffff88009e3f5180 x1830945721105024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.269694:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5180 with x1830945721105024 ext(1859584->1863679) 00002000:00010000:0.0:1746126602.269699:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5180 00000100:00100000:0.0:1746126602.269720:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7279 00000100:00100000:0.0:1746126602.269727:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721105024:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126602.269904:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721105024:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 176us (305us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126602.269911:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7279 00002000:00100000:0.0:1746126602.269916:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1859584->1863679) req@ffff88009e3f5180 x1830945721105024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/4536 e 0 to 0 dl 1746126613 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.269924:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5180 with x1830945721105024 ext(1859584->1863679) 00002000:00010000:0.0:1746126602.269926:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5180 00000100:00100000:0.0:1746126602.273568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.273675:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721105152 00000100:00100000:0.0:1746126602.273684:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721105152 00000100:00100000:0.0:1746126602.274574:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8730 00000100:00100000:0.0:1746126602.274584:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:30883:x1830945721105152:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126602.274606:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.274625:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e82586761148f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c77e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.274691:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867611496 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.274704:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867611496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.274714:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867611496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.274727:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e82586761149d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.274733:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e82586761149d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.274739:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e82586761149d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.275122:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e8258676114a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.275133:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c770 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.275139:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e8258676114a4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.275180:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c770 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.275192:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19e00/0xb50e82586761147a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c770 expref: 17 pid: 14548 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.275209:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721231744:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.275379:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.285359:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721104768:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 29291us (29559us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126602.285373:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7278 00002000:00100000:0.0:1746126602.285386:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e3f4000 x1830945721104768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/440 e 0 to 0 dl 1746126613 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.285395:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4000 with x1830945721104768 ext(0->1048575) 00002000:00010000:0.0:1746126602.285401:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4000 00000100:00100000:0.0:1746126602.286537:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721231744:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126602.286561:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e8258676114a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126602.298691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.298711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.298726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.298861:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721105792 00000100:00100000:0.0:1746126602.298870:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721105792 00002000:00100000:0.0:1746126602.301611:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1544191) req@ffff88009e3f6300 x1830945721105792/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.301623:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6300 with x1830945721105792 ext(1048576->1544191) 00010000:00010000:0.0:1746126602.301631:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093996600/0xb50e825867611457 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c754 expref: 42 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.301650:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093996600/0xb50e825867611457 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c754 expref: 42 pid: 8437 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746126602.301656:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3f6300 00000100:00100000:0.0:1746126602.301669:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1650 00000100:00100000:0.0:1746126602.301707:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+42:1964:x1830945721105792:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126602.313777:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.313803:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721106432 00000100:00100000:0.0:1746126602.313811:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721106432 00000100:00100000:0.0:1746126602.313862:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8731 00000100:00100000:0.0:1746126602.313869:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:30883:x1830945721106432:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126602.313884:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.313898:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0e00/0xb50e8258676114c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c7a1 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.313962:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b600/0xb50e8258676114ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.313975:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e8258676114a4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c77e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.313981:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b600/0xb50e8258676114ce lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126602.314004:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e8258676114a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c77e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.314016:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e8258676114a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c77e expref: 12 pid: 14548 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.314025:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721232256:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.314084:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.318496:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721106560 00000100:00100000:0.0:1746126602.318503:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721106560 00010000:00010000:0.0:1746126602.318537:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093996600/0xb50e825867611457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c754 expref: 22 pid: 8437 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.318570:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6577 00000100:00100000:0.0:1746126602.318576:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721106560:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.318587:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126602.318724:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093996600/0xb50e825867611457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c754 expref: 22 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.318734:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093996600/0xb50e825867611457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c754 expref: 22 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.318750:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093996600/0xb50e825867611457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c754 expref: 22 pid: 8437 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.318762:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.318764:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.318769:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39bc00/0xb50e8258676114ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c785 expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.318779:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39bc00/0xb50e8258676114ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c785 expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.318803:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39bc00/0xb50e8258676114ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c785 expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126602.318812:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721232384:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126602.318940:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.324118:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721232384:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126602.324131:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.324153:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721106560:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5577us (5815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.324169:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6577 00000100:00100000:0.0:1746126602.329954:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7280 00000100:00100000:0.0:1746126602.329961:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721107200:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126602.338189:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721107200:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 8223us (8524us total) trans 0 rc 712704/712704 00000100:00100000:0.0:1746126602.338198:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7280 00002000:00100000:0.0:1746126602.338207:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ada6680 x1830945721107200/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 504/440 e 0 to 0 dl 1746126613 ref 1 fl Complete:/200/0 rc 712704/712704 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.338215:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ada6680 with x1830945721107200 ext(1048576->2097151) 00002000:00010000:0.0:1746126602.338219:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ada6680 00000100:00100000:0.0:1746126602.341182:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721107584 00000100:00100000:0.0:1746126602.341189:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721107584 00000100:00100000:0.0:1746126602.341228:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8733 00000100:00100000:0.0:1746126602.341233:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:30883:x1830945721107584:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126602.341260:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.341274:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e43800/0xb50e8258676114f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c7af expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.341317:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e43800/0xb50e8258676114f1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7af expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.341343:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e43800/0xb50e8258676114f1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7af expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.341359:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.341361:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126602.341364:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e43800, rc 0) 00000100:00100000:0.0:1746126602.341387:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:30883:x1830945721107584:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 153us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.341392:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8733 00000100:00100000:0.0:1746126602.351561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.351595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.351621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.351652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.351672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.351857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.351872:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721107968 00000100:00100000:0.0:1746126602.351874:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721107968 00000100:00100000:0.0:1746126602.351886:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721108224 00000100:00100000:0.0:1746126602.351888:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721108224 00000100:00100000:0.0:1746126602.351896:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12625 00000100:00100000:0.0:1746126602.351900:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721108096:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126602.351916:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b21b600/0xb50e8258676114ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.351925:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099213600/0xb50e825867611488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c777 expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.351930:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126602.351932:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126602.351933:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b21b600/0xb50e8258676114ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.351946:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099213600/0xb50e825867611488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c777 expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.351953:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099213600/0xb50e825867611488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c777 expref: 7 pid: 4642 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.351961:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721232640:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.351977:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.402780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.402859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.402930:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721108608 00000100:00100000:0.0:1746126602.402937:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721108608 00002000:00100000:0.0:1746126602.402978:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1527808->1863679) req@ffff88009e3a4000 x1830945721108608/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.402993:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4000 with x1830945721108608 ext(1527808->1863679) 00010000:00010000:0.0:1746126602.403002:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099213600/0xb50e825867611488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c777 expref: 8 pid: 4642 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746126602.403014:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099213600/0xb50e825867611488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c777 expref: 8 pid: 4642 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746126602.403021:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3a4000 00000100:00100000:0.0:1746126602.403039:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1651 00000100:00100000:0.0:1746126602.403045:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721108608:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126602.415104:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721110272 00000100:00100000:0.0:1746126602.415114:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721110272 00000100:00100000:0.0:1746126602.415170:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8734 00000100:00100000:0.0:1746126602.415178:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ada7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+235:30889:x1830945721110272:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126602.415203:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.415222:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b000/0xb50e825867611522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c7b6 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.416381:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416394:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416405:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416416:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416422:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416433:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416671:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416680:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416686:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126602.416694:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126602.416763:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416770:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416776:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416781:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf06e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126602.416785:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416791:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416801:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.416805:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126602.416808:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416812:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf06e00/0xb50e825867611537 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416842:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416848:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416852:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416857:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d522400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126602.416859:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416864:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416870:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126602.416872:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126602.416874:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416879:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d522400/0xb50e825867611529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416886:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416890:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416895:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416899:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931c5000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126602.416901:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416905:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416910:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215a00) 00010000:00010000:0.0:1746126602.416912:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126602.416914:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416918:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c5000/0xb50e825867611530 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.416956:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b000/0xb50e825867611522 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7b6 expref: 237 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.418526:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b000/0xb50e825867611522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7b6 expref: 237 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.418539:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b21b000, rc 0) 00000100:00100000:0.0:1746126602.418620:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ada7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+236:30889:x1830945721110272:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3441us (3615us total) trans 8589942878 rc 301/301 00000100:00100000:0.0:1746126602.418628:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8734 00000100:00100000:0.0:1746126602.426273:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721111040 00000100:00100000:0.0:1746126602.426281:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721111040 00000100:00100000:0.0:1746126602.426322:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8735 00000100:00100000:0.0:1746126602.426329:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+237:30890:x1830945721111040:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126602.426345:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.426361:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b200/0xb50e825867611545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c7cb expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.426452:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426463:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426471:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426481:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426486:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426491:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426572:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426583:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f8f600/0xb50e8258676114e3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7a8 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.426588:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.426609:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099f8f600/0xb50e8258676114e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7a8 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.426618:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099f8f600/0xb50e8258676114e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7a8 expref: 13 pid: 14548 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.426627:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721234176:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.426693:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.437412:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721234176:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126602.437433:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126602.438432:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721112064 00000100:00100000:0.0:1746126602.438438:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721112064 00010000:00010000:0.0:1746126602.440552:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440558:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126602.440569:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126602.440649:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440654:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440659:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440663:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927e1200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126602.440666:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440674:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440681:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.440683:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126602.440685:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440689:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e82586761155a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440700:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440704:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440708:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440711:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b21b800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126602.440713:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440717:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440722:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126602.440723:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126602.440726:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440729:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b800/0xb50e82586761154c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440737:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440742:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440746:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440750:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927e1e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126602.440752:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440756:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440761:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e21fe00) 00010000:00010000:0.0:1746126602.440763:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126602.440765:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.440769:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611553 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.442100:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b200/0xb50e825867611545 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7cb expref: 239 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.442109:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b21b200/0xb50e825867611545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7cb expref: 239 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.442117:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b21b200, rc 0) 00000100:00100000:0.0:1746126602.442400:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+238:30890:x1830945721111040:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 16070us (16541us total) trans 8589942880 rc 301/301 00000100:00100000:0.0:1746126602.442407:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8735 00000100:00100000:0.0:1746126602.445663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.449119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.449179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.453216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.515624:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721114368 00000100:00100000:0.0:1746126602.515632:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721114368 00000100:00100000:0.0:1746126602.515672:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8737 00000100:00100000:0.0:1746126602.515679:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:30893:x1830945721114368:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126602.515695:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.515709:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e825867611599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c7f5 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.515778:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e8258676115a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.515789:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e8258676115a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126602.515798:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e8258676115a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126602.515806:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:0.0:1746126602.521004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.525213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.531418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.538082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.542353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.542385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.542408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.542429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.542560:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721115648 00000100:00100000:0.0:1746126602.542563:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721115648 00002000:00100000:0.0:1746126602.542578:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e3a5c00 x1830945721115648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.542586:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5c00 with x1830945721115648 ext(3145728->4194303) 00002000:00010000:0.0:1746126602.542589:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a5c00 00000100:00100000:0.0:1746126602.557686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.557712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.558360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.558385:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721116288 00000100:00100000:0.0:1746126602.558392:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721116288 00000100:00100000:0.0:1746126602.558438:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721116416 00000100:00100000:0.0:1746126602.558442:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721116416 00000100:00100000:0.0:1746126602.558455:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721116544 00000100:00100000:0.0:1746126602.558456:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721116544 00000100:00100000:0.0:1746126602.558733:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12638 00000100:00100000:0.0:1746126602.558740:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721116288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126602.558754:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.558768:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099f8f600/0xb50e8258676115b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c803 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.558784:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.558785:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.558792:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099f8f600/0xb50e8258676115b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c803 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.558807:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099f8f600/0xb50e8258676115b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c803 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.558815:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f8f600, rc 0) 00000100:00100000:0.0:1746126602.558866:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721116288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 126us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.558871:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12638 00000100:00100000:0.0:1746126602.558884:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12639 00000100:00100000:0.0:1746126602.558888:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1964:x1830945721116416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126602.558896:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.558904:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091dc1400/0xb50e8258676115bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c80a expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.558914:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.558915:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.558918:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091dc1400/0xb50e8258676115bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c80a expref: 7 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.558926:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091dc1400/0xb50e8258676115bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c80a expref: 7 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.558932:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dc1400, rc 0) 00000100:00100000:0.0:1746126602.558947:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1964:x1830945721116416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 59us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.558952:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12639 00000100:00100000:0.0:1746126602.558962:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12640 00000100:00100000:0.0:1746126602.558966:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721116544:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126602.558970:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.558977:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb55800/0xb50e8258676115c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c811 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126602.559006:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721234688:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126602.559060:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.563687:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721115392:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20931us (21338us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126602.563695:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7288 00002000:00100000:0.0:1746126602.563703:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e3a5880 x1830945721115392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/440 e 0 to 0 dl 1746126613 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.563711:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5880 with x1830945721115392 ext(2097152->3145727) 00002000:00010000:0.0:1746126602.563716:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a5880 00000100:00100000:0.0:1746126602.594310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.596683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.596708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.596722:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721117440 00000100:00100000:0.0:1746126602.596726:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721117440 00002000:00100000:0.0:1746126602.596749:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3a7800 x1830945721117440/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.596757:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7800 with x1830945721117440 ext(1048576->2097151) 00002000:00010000:0.0:1746126602.596762:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a7800 00000100:00100000:0.0:1746126602.596774:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721117568 00000100:00100000:0.0:1746126602.596776:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721117568 00002000:00100000:0.0:1746126602.596784:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1052672->2097151) req@ffff88009e3a7b80 x1830945721117568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.596790:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7b80 with x1830945721117568 ext(1052672->2097151) 00002000:00010000:0.0:1746126602.596793:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a7b80 00000100:00100000:0.0:1746126602.596802:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7293 00000100:00100000:0.0:1746126602.596807:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721117440:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126602.635111:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721117440:12345-192.168.203.2@tcp:3:cat.0 Request processed in 38295us (38423us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126602.635120:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7293 00002000:00100000:0.0:1746126602.635130:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3a7800 x1830945721117440/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:363/0 lens 488/440 e 0 to 0 dl 1746126613 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.635137:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7800 with x1830945721117440 ext(1048576->2097151) 00002000:00010000:0.0:1746126602.635142:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a7800 00000100:00100000:0.0:1746126602.667040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.667091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.676999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.693783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.698662:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721235328:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126602.698678:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.698715:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721118976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4642us (4938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.698724:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6594 00000100:00100000:0.0:1746126602.701948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.739063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.746626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.746665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.746687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.749648:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7300 00000100:00100000:0.0:1746126602.749658:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721120128:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:0.0:1746126602.795018:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126602.817513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.820215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.820245:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721120640 00000100:00100000:0.0:1746126602.820253:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721120640 00000100:00100000:0.0:1746126602.820313:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 662 00000100:00100000:0.0:1746126602.820321:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+243:1966:x1830945721120640:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126602.820334:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126602.820357:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98200/0xb50e82586761162c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c849 expref: 243 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.820377:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126602.820381:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126602.821716:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+242:1966:x1830945721120640:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1394us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.821724:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 662 00000100:00100000:0.0:1746126602.821775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.821793:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721120896 00000100:00100000:0.0:1746126602.821796:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721120896 00000100:00100000:0.0:1746126602.821823:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3649 00000100:00100000:0.0:1746126602.821844:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+242:30906:x1830945721120896:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126602.823775:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+243:30906:x1830945721120896:12345-192.168.203.2@tcp:35:cat.0 Request processed in 1937us (1990us total) trans 8589942888 rc 0/0 00000100:00100000:0.0:1746126602.824039:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3649 00000100:00100000:0.0:1746126602.826346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.827040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.832136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.846572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.846688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.846709:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721121536 00000100:00100000:0.0:1746126602.846716:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721121536 00000100:00100000:0.0:1746126602.846756:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721121664 00000100:00100000:0.0:1746126602.846758:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721121664 00000100:00100000:0.0:1746126602.846773:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12649 00000100:00100000:0.0:1746126602.846779:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+18:30900:x1830945721121536:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126602.846793:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.846806:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867611648 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c85e expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.846852:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009914fa00/0xb50e82586761157d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7e0 expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.846860:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c386a00/0xb50e8258676115ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c818 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.846865:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.846866:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.846869:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867611648 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c85e expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.846893:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c386a00/0xb50e8258676115ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c818 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.846907:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c386a00/0xb50e8258676115ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c818 expref: 11 pid: 8438 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746126602.846918:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721235584:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126602.846988:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009914fa00/0xb50e82586761157d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7e0 expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.846995:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009914fa00/0xb50e82586761157d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7e0 expref: 19 pid: 10890 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746126602.847002:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721235712:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.847019:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.849689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.860105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.860632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.860670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.865211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.865464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.870645:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721122816 00000100:00100000:0.0:1746126602.870652:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721122816 00002000:00100000:0.0:1746126602.870694:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093af5880 x1830945721122816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.870709:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5880 with x1830945721122816 ext(1048576->2097151) 00002000:00010000:0.0:1746126602.870714:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af5880 00000100:00100000:0.0:1746126602.870728:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721122944 00000100:00100000:0.0:1746126602.870731:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721122944 00002000:00100000:0.0:1746126602.870743:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093af6300 x1830945721122944/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.870748:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6300 with x1830945721122944 ext(1048576->2097151) 00002000:00010000:0.0:1746126602.870751:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af6300 00000100:00100000:0.0:1746126602.870774:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7302 00000100:00100000:0.0:1746126602.870781:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721122816:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126602.878338:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721123200 00000100:00100000:0.0:1746126602.878352:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721123200 00000100:00100000:0.0:1746126602.878408:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12653 00000100:00100000:0.0:1746126602.878417:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30896:x1830945721123200:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126602.878435:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.878451:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a99200/0xb50e825867611664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c87a expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.878481:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867611648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c85e expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.878489:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126602.878490:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126602.878494:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a99200/0xb50e825867611664 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c87a expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.878719:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867611648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c85e expref: 20 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.878732:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a2aec00/0xb50e825867611648 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c85e expref: 19 pid: 20294 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746126602.878847:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721236352:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126602.878896:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126602.891566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.891632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.900754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.913212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.919492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.919553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.941039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.941073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.941120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.941144:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721124864 00000100:00100000:0.0:1746126602.941159:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721124864 00000100:00100000:0.0:1746126602.942280:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12657 00000100:00100000:0.0:1746126602.942286:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721124864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126602.942291:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126602.942297:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98a00/0xb50e825867611680 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c88f expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126602.942307:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.942309:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126602.942316:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98a00/0xb50e825867611680 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c88f expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.942328:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98a00/0xb50e825867611680 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c88f expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126602.942337:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a98a00, rc 0) 00000100:00100000:0.0:1746126602.942504:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721124864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 217us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126602.942509:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12657 00000100:00100000:0.0:1746126602.943682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.943713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.943746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.943843:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721125760 00000100:00100000:0.0:1746126602.943846:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721125760 00002000:00100000:0.0:1746126602.943859:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2613248->3661823) req@ffff88009e9ff480 x1830945721125760/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:363/0 lens 488/0 e 0 to 0 dl 1746126613 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126602.943865:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9ff480 with x1830945721125760 ext(2613248->3661823) 00002000:00010000:0.0:1746126602.943867:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9ff480 00000100:00100000:0.0:1746126602.943877:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7306 00000100:00100000:0.0:1746126602.943881:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721125504:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126602.980205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.987401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.990210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.996071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126602.996773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.004008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.006687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.011142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.021326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.029026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.029754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.047073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.047128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.056444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.076597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.076654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.081341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.082410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.181291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.188759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.192441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.204582:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 663 00000100:00100000:0.0:1746126603.204593:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+246:1966:x1830945721130496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126603.204610:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126603.204639:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2a00/0xb50e82586761170c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c8f1 expref: 246 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.208731:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126603.208741:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676116f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.208753:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676116f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.208767:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126603.209147:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721130752 00000100:00100000:0.0:1746126603.209163:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721130752 00010000:00010000:0.0:1746126603.209201:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e20000/0xb50e8258676116e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c8e3 expref: 15 pid: 20362 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746126603.209759:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676116f0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.209765:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676116f0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746126603.209779:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:0.0:1746126603.218228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.218798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.234350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.234381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.234405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.234436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.234451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.234468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126603.235227:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126603.235230:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126603.248575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.248617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.248639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.261673:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 664 00000100:00100000:0.0:1746126603.261680:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721132928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126603.261688:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126603.261700:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e82586761177c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c93e expref: 17 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.261713:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126603.261717:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126603.262953:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721132928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1271us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126603.262960:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 664 00000100:00100000:0.0:1746126603.267660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.267757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.279014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.300509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.304915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.308895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.311194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.323077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.324268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.324319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.326417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.326434:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721135872 00000100:00100000:0.0:1746126603.326437:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721135872 00000100:00100000:0.0:1746126603.326465:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8746 00000100:00100000:0.0:1746126603.326470:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+245:30922:x1830945721135872:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126603.326482:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126603.326495:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30a00/0xb50e8258676117c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c96f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.326564:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326573:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326580:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326589:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326593:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326597:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326670:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676117d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326678:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676117d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326683:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676117d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746126603.326689:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126603.326754:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326760:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326765:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326772:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e3200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126603.326775:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326781:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326789:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126603.326791:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126603.326794:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326798:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3200/0xb50e8258676117c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326811:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326815:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326819:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326822:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e2800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126603.326824:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326847:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326853:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009333dd00) 00010000:00010000:0.0:1746126603.326854:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126603.326857:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326860:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676117d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.326889:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30a00/0xb50e8258676117c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c96f expref: 248 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.326898:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e8258676117d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c96f expref: 247 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.326904:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126603.326905:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126603.326907:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2400, rc 0) 00000100:00100000:0.0:1746126603.326937:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+247:30922:x1830945721135872:12345-192.168.203.2@tcp:101:cat.0 Request processed in 466us (521us total) trans 8589942896 rc 0/0 00000100:00100000:0.0:1746126603.326942:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8746 00000100:00100000:0.0:1746126603.348725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.348790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.359204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.359583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.359817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.370910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.402934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.404740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.420319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.425358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.425406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.462937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.473654:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7325 00000100:00100000:0.0:1746126603.473661:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721139584:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126603.491845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.498171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.508796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.508870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.528405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.531857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.563447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.589112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.593486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.593904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.610923:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721141888 00000100:00100000:0.0:1746126603.610930:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721141888 00000100:00100000:0.0:1746126603.610974:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12694 00000100:00100000:0.0:1746126603.610980:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:30931:x1830945721141888:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126603.610994:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126603.611008:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611863 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4c9d8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611036:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb9c00/0xb50e8258676117f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c984 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611043:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611824 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9b5 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611050:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec81800/0xb50e8258676117ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c95a expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611057:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e67800/0xb50e825867611808 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c999 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611063:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126603.611064:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126603.611067:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611863 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2138112->2355199] (req 2138112->2355199) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9d8 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611090:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e67800/0xb50e825867611808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c999 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611100:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e67800/0xb50e825867611808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c999 expref: 24 pid: 20294 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.611111:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721240832:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126603.611192:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec81800/0xb50e8258676117ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c95a expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611199:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec81800/0xb50e8258676117ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c95a expref: 12 pid: 8436 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.611206:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721240960:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126603.611226:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611824 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9b5 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611237:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611824 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9b5 expref: 24 pid: 8437 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.611243:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721241088:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126603.611259:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb9c00/0xb50e8258676117f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c984 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.611266:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb9c00/0xb50e8258676117f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c984 expref: 12 pid: 8436 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.611271:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721241216:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126603.611282:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126603.619774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.619850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.619887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.624359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.627901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.632630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.693155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.696426:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721143424 00000100:00100000:0.0:1746126603.696431:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721143424 00000100:00100000:0.0:1746126603.698186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.700035:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.701413:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.701443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.703751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.710075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.710115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.714818:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721144704 00000100:00100000:0.0:1746126603.714838:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721144704 00010000:00010000:0.0:1746126603.714866:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611863 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9d8 expref: 24 pid: 8437 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.714896:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6622 00000100:00100000:0.0:1746126603.714902:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721144704:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126603.714914:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126603.714926:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611863 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2138112->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9d8 expref: 24 pid: 8437 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746126603.714937:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611863 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2138112->2355199) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9d8 expref: 24 pid: 8437 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746126603.714955:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611863 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2138112->2355199) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9d8 expref: 24 pid: 8437 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746126603.715202:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126603.715205:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126603.715214:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3002367) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9ed expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.715221:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3002367) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9ed expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.715254:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3002367) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9ed expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.715265:0:7072:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d87e600/0xb50e825867611878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3002367) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9ed expref: 12 pid: 8437 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.715275:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721242368:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126603.715343:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126603.720247:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721242368:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126603.720269:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126603.720913:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721144704:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6009us (6168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126603.720921:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6622 00000100:00100000:0.0:1746126603.727972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.728946:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721145728 00000100:00100000:0.0:1746126603.728949:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721145728 00000100:00100000:0.0:1746126603.728974:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12702 00000100:00100000:0.0:1746126603.728980:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:30939:x1830945721145728:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126603.728992:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126603.729004:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ca1e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.729023:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126603.729028:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca1e expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.729043:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca1e expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.729053:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ead1c00, rc 0) 00000100:00100000:0.0:1746126603.729083:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:30939:x1830945721145728:12345-192.168.203.2@tcp:101:cat.0 Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126603.729089:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12702 00000100:00100000:0.0:1746126603.733245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.733751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.736215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.749547:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721146624 00000100:00100000:0.0:1746126603.749559:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721146624 00000100:00100000:0.0:1746126603.749604:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12703 00000100:00100000:0.0:1746126603.749611:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721146624:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126603.749628:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126603.749644:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ead0e00/0xb50e8258676118e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ca2c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126603.749694:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721242752:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126603.749778:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126603.750988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.763446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.763496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.766304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.767989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.791155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.793621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126603.797763:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51f2200/0xb50e825867611832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9c3 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.797773:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a51f2200/0xb50e825867611832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9c3 expref: 24 pid: 8437 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.797779:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721245312:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.797788:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746126603.797954:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126603.798313:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721148416:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29923us (30324us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126603.798319:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7333 00002000:00100000:1.0:1746126603.798324:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880099251500 x1830945721148416/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:364/0 lens 488/440 e 0 to 0 dl 1746126614 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126603.798330:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251500 with x1830945721148416 ext(3145728->4194303) 00010000:00010000:1.0:1746126603.798335:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac14a00/0xb50e825867611871 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9e6 expref: 14 pid: 8436 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.798342:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac14a00/0xb50e825867611871 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9e6 expref: 14 pid: 8436 timeout: 825 lvb_type: 1 00002000:00010000:1.0:1746126603.798347:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099251500 00000100:00100000:0.0:1746126603.809471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.809517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.809546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.809565:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721149696 00000100:00100000:1.0:1746126603.809568:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721149696 00000100:00100000:0.0:1746126603.809571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126603.809597:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f8f600/0xb50e8258676115b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c803 expref: 16 pid: 4642 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746126603.810037:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6625 00000100:00100000:1.0:1746126603.810045:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721149824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126603.810058:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.810080:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e664e00/0xb50e82586761173d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c90d expref: 10 pid: 4642 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.810091:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e664e00/0xb50e82586761173d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c90d expref: 10 pid: 4642 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.810112:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e664e00/0xb50e82586761173d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c90d expref: 10 pid: 4642 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.810270:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126603.810310:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721149824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 266us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.810316:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6625 00000100:00100000:1.0:1746126603.810329:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6627 00000100:00100000:1.0:1746126603.810333:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721149952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126603.810339:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.810346:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c387800/0xb50e825867611561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7bd expref: 26 pid: 8438 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.810354:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c387800/0xb50e825867611561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7bd expref: 26 pid: 8438 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.810365:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c387800/0xb50e825867611561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7bd expref: 26 pid: 8438 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126603.810379:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126603.810381:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126603.810385:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2000/0xb50e8258676118fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.810392:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c2000/0xb50e8258676118fd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.810412:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126603.810427:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721149952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 93us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.810432:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6627 00000100:00100000:1.0:1746126603.810728:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721148032:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40997us (42459us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126603.810735:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7335 00002000:00100000:1.0:1746126603.810743:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e3a5c00 x1830945721148032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:364/0 lens 488/440 e 0 to 0 dl 1746126614 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126603.810751:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5c00 with x1830945721148032 ext(3145728->4194303) 00010000:00010000:1.0:1746126603.810757:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e600/0xb50e82586761189b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9fb expref: 13 pid: 4640 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.810764:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e600/0xb50e82586761189b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9fb expref: 13 pid: 4640 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746126603.810770:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3a5c00 00000100:00100000:1.0:1746126603.810808:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721243520:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.814339:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721244032:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.814361:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721243648:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.814368:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721243776:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.814393:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126603.821508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.821737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126603.824067:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e82586761180f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9a0 expref: 23 pid: 20294 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.824082:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721244928:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.824093:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721245056:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.824102:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d87ea00/0xb50e8258676118a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca10 expref: 10 pid: 8437 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746126603.824111:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721245184:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.824120:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51f2200/0xb50e825867611832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9c3 expref: 22 pid: 8437 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.824127:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721245312:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.824156:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824186:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3000/0xb50e825867611744 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c914 expref: 9 pid: 8438 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746126603.824194:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721244288:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.824203:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c386800/0xb50e825867611568 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c7c4 expref: 21 pid: 8438 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746126603.824210:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721244416:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.824229:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824236:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824241:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824256:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824262:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824268:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824278:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008edef800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126603.824280:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824286:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824295:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824300:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008edef800/0xb50e825867611912 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126603.824328:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721148800:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 27284us (27332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.824334:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12707 00010000:00010000:1.0:1746126603.824357:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824364:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824378:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824383:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824389:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824394:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac14600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126603.824396:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824401:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824409:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.824414:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac14600/0xb50e825867611904 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126603.824440:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721148928:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 27861us (30828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.824445:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12705 00000100:00100000:1.0:1746126603.826902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.834701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126603.837810:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837818:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837851:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837859:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837866:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837872:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ba2200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126603.837876:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837883:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837892:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126603.837893:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126603.837898:0:4641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b896600/0xb50e82586761192e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca41 expref: 9 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837904:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b896600/0xb50e82586761192e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca41 expref: 9 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.837931:0:4641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b896600/0xb50e82586761192e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca41 expref: 9 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126603.837943:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721245440:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126603.838008:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126603.841389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.841425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.841557:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721152256 00000100:00100000:1.0:1746126603.841566:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721152256 00010000:00010000:1.0:1746126603.841602:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca1e expref: 22 pid: 8437 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.841643:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6641 00000100:00100000:1.0:1746126603.841652:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721152256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126603.841665:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.841685:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca1e expref: 22 pid: 8437 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.841695:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca1e expref: 22 pid: 8437 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.841717:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ead1c00/0xb50e8258676118c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca1e expref: 22 pid: 8437 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.841735:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126603.841773:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721152256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.841779:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6641 00000100:00100000:1.0:1746126603.842519:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721245440:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126603.842538:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.842547:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2200/0xb50e825867611920 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126603.842579:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721149312:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 44971us (45194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.842585:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12709 00000100:00100000:0.0:1746126603.846329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.846380:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721152512 00000100:00100000:1.0:1746126603.846391:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721152512 00010000:00010000:1.0:1746126603.846422:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e600/0xb50e82586761189b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9fb expref: 12 pid: 4640 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.846463:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6642 00000100:00100000:1.0:1746126603.846470:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721152512:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126603.846482:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.846503:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e600/0xb50e82586761189b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9fb expref: 12 pid: 4640 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.846514:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e600/0xb50e82586761189b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9fb expref: 12 pid: 4640 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.846535:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e600/0xb50e82586761189b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c9fb expref: 12 pid: 4640 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.846550:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126603.846552:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126603.846556:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c3e00/0xb50e82586761190b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.846564:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c3e00/0xb50e82586761190b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.846599:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126603.846643:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721152512:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 172us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.846649:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6642 00000100:00100000:0.0:1746126603.847543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.852452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.860784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.860865:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721153280 00000100:00100000:1.0:1746126603.860875:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721153280 00000100:00100000:1.0:1746126603.860937:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8753 00000100:00100000:1.0:1746126603.860946:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:30936:x1830945721153280:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:1.0:1746126603.860997:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.861021:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07200/0xb50e8258676118da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca25 expref: 20 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861054:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.861058:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126603.861089:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126603.861100:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465000/0xb50e82586761112b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c55c expref: 249 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861106:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464c00/0xb50e825867611132 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c563 expref: 249 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861112:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861118:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c612 expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861124:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e82586761132a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c697 expref: 249 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861134:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126603.861173:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e82586761132a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c697 expref: 249 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.861187:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e82586761132a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c697 expref: 249 pid: 20362 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.861200:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721245696:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.862190:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c612 expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.862199:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931c4600/0xb50e82586761123c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c612 expref: 23 pid: 14548 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.862207:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721245824:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.862301:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.862308:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 23 pid: 14548 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.862315:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721245952:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.862342:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464c00/0xb50e825867611132 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c563 expref: 249 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.862353:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464c00/0xb50e825867611132 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c563 expref: 249 pid: 14548 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.862359:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721246080:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.862375:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465000/0xb50e82586761112b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c55c expref: 249 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.862380:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465000/0xb50e82586761112b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c55c expref: 249 pid: 15560 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.862386:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721246208:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.862398:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126603.867469:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721152768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19804us (19916us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126603.867481:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7337 00002000:00100000:0.0:1746126603.867493:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880091da1500 x1830945721152768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:364/0 lens 488/440 e 0 to 0 dl 1746126614 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126603.867502:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1500 with x1830945721152768 ext(2097152->3145727) 00002000:00010000:0.0:1746126603.867507:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da1500 00000100:00100000:1.0:1746126603.869979:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721245696:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.869990:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721245824:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126603.870441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.870862:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721245952:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.870872:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464c00/0xb50e825867611132 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c563 expref: 249 pid: 14548 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.870884:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721246080:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126603.871015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.871198:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721153792 00000100:00100000:1.0:1746126603.871201:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721153792 00010000:00010000:1.0:1746126603.871215:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 26 pid: 14548 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.871234:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6644 00000100:00100000:1.0:1746126603.871463:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721153792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126603.871472:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.871477:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 26 pid: 14548 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.871581:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 26 pid: 14548 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.871642:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523600/0xb50e825867611139 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4c56a expref: 26 pid: 14548 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.871653:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.871657:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126603.871662:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126603.871679:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721153792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 440us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.871685:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6644 00000100:00100000:0.0:1746126603.873309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.873337:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721246208:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126603.873340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126603.873368:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126603.873725:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126603.873734:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:1.0:1746126603.874445:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2515, 88 off213168 00000004:00080000:1.0:1746126603.874454:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788625992ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874494:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2614, 88 off221976 00000004:00080000:1.0:1746126603.874499:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788671963ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874512:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2615, 88 off222064 00000004:00080000:1.0:1746126603.874514:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788686836ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874521:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2516, 88 off213256 00000004:00080000:1.0:1746126603.874523:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788695713ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874529:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2517, 88 off213344 00000004:00080000:1.0:1746126603.874531:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788703566ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874537:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2616, 88 off222152 00000004:00080000:1.0:1746126603.874539:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788711995ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874545:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2617, 88 off222240 00000004:00080000:1.0:1746126603.874547:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788719988ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874553:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2518, 88 off213432 00000004:00080000:1.0:1746126603.874555:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788727972ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874561:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2618, 88 off222328 00000004:00080000:1.0:1746126603.874563:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788735195ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874568:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2519, 88 off213520 00000004:00080000:1.0:1746126603.874570:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788742750ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874576:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2619, 88 off222416 00000004:00080000:1.0:1746126603.874578:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788750697ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874584:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2520, 88 off213608 00000004:00080000:1.0:1746126603.874587:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788759325ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874593:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2620, 88 off222504 00000004:00080000:1.0:1746126603.874596:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788768120ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874602:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2521, 88 off213696 00000004:00080000:1.0:1746126603.874604:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788776498ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.874610:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2621, 88 off222592 00000004:00080000:1.0:1746126603.874612:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788784728ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874618:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2622, 88 off222680 00000004:00080000:1.0:1746126603.874620:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725788792683ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.874626:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2522, 88 off213784 00000004:00080000:1.0:1746126603.874629:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725788801262ns, next at 687927188999ns, rc = 0 00000100:00100000:0.0:1746126603.877729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.879942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.879968:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721154560 00000100:00100000:1.0:1746126603.879975:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721154560 00000100:00100000:1.0:1746126603.880009:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8756 00000100:00100000:1.0:1746126603.880015:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:30935:x1830945721154560:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126603.880030:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126603.880045:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ca64 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.880088:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 25 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.880097:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 25 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.880106:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.880109:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126603.880113:0:15560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 247 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.880119:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997f4e00, rc 0) 00000100:00100000:1.0:1746126603.880162:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:30935:x1830945721154560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 147us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.880168:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8756 00000100:00100000:1.0:1746126603.883998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.885228:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721154816 00000100:00100000:0.0:1746126603.885239:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721154816 00000100:00100000:0.0:1746126603.885287:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8757 00000100:00100000:0.0:1746126603.885295:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+248:30944:x1830945721154816:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126603.885314:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126603.885333:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16ee00/0xb50e82586761196d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ca6b expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.885429:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.885445:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.885454:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.885462:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.885467:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.885471:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000001:00080000:0.0:1746126603.908706:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942896 is committed 00000001:00080000:0.0:1746126603.908724:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942883 is committed 00000001:00080000:0.0:1746126603.908740:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942905 is committed 00000004:00080000:0.0:1746126603.908745:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1908 committed 00000004:00080000:0.0:1746126603.908751:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2005 committed 00000004:00080000:0.0:1746126603.908757:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2004 committed 00000004:00080000:0.0:1746126603.908758:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1907 committed 00000004:00080000:0.0:1746126603.908760:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2003 committed 00000004:00080000:0.0:1746126603.908761:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1906 committed 00000004:00080000:0.0:1746126603.908763:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2002 committed 00000004:00080000:0.0:1746126603.908764:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1905 committed 00000004:00080000:0.0:1746126603.908765:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2001 committed 00000004:00080000:0.0:1746126603.908767:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1904 committed 00000004:00080000:0.0:1746126603.908768:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2000 committed 00000004:00080000:0.0:1746126603.908770:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1999 committed 00000004:00080000:0.0:1746126603.908771:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1903 committed 00000004:00080000:0.0:1746126603.908773:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1902 committed 00000004:00080000:0.0:1746126603.908775:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1998 committed 00000004:00080000:0.0:1746126603.908776:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1997 committed 00000004:00080000:0.0:1746126603.908778:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1901 committed 00000001:00080000:0.0:1746126603.908783:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942900 is committed 00000001:00080000:0.0:1746126603.908786:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942899 is committed 00000001:00080000:0.0:1746126603.908809:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942903 is committed 00000001:00080000:0.0:1746126603.908864:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942901 is committed 00000004:00010000:1.0:1746126603.908881:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091da0700 reply state ffff88008decb000 transno 8589942905 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746126603.908892:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746126603.908987:0:14549:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746126603.909001:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30936:x1830945721153280:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 48052us (48223us total) trans 8589942905 rc 0/0 00000100:00100000:1.0:1746126603.909008:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8753 00000100:00100000:1.0:1746126603.909824:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721246464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126603.909882:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.909906:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721246976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126603.909920:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.909928:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721247488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.909940:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.909947:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721248000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.909963:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.909977:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746126603.909982:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721246592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126603.909994:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.910001:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721247104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126603.910011:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.910017:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721247616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.910027:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.910034:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721248128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.910043:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126603.910063:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12715 00000100:00100000:1.0:1746126603.910073:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721246848:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746126603.910137:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126603.910163:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b492e00/0xb50e8258676118ef lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca33 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910171:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126603.910197:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b492e00/0xb50e8258676118ef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca33 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910208:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b492e00/0xb50e8258676118ef lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca33 expref: 7 pid: 20362 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746126603.910218:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721248384:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126603.910266:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746126603.910282:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.910289:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.910296:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126603.910377:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721246848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (910us total) trans 21474840182 rc 0/0 00010000:00010000:0.0:1746126603.910688:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.910702:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.910707:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.910713:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dc1b400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126603.910717:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.910723:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40218400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.910738:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126603.910740:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126603.910745:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910753:0:3281:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910761:0:3281:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910768:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910773:0:3281:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910779:0:3281:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.910856:0:3281:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126603.910864:0:3281:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721248512:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126603.910895:0:3281:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126603.910903:0:3281:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721248640:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126603.910918:0:3281:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746126603.910934:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126603.910937:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126603.911564:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12715 00000100:00100000:1.0:1746126603.911588:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12716 00000100:00100000:1.0:1746126603.911597:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721247360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.911656:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12718 00000100:00100000:1.0:1746126603.911662:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721246720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126603.911823:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721246720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (2273us total) trans 21474840184 rc 0/0 00000100:00100000:1.0:1746126603.912648:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12718 00000100:00100000:0.0:1746126603.912655:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721247360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1059us (3160us total) trans 17179873013 rc 0/0 00000100:00100000:0.0:1746126603.912662:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12716 00000100:00100000:1.0:1746126603.912666:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12721 00000100:00100000:1.0:1746126603.912672:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721248256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.912891:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721248256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (3276us total) trans 17179873014 rc 0/0 00000100:00100000:1.0:1746126603.912897:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12721 00000100:00100000:1.0:1746126603.912911:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12724 00000100:00100000:1.0:1746126603.912917:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721247488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.913171:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1830945721247488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (3229us total) trans 17179873015 rc 0/0 00000100:00100000:1.0:1746126603.913177:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12724 00000100:00100000:1.0:1746126603.913191:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12726 00000100:00100000:1.0:1746126603.913336:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830945721246592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126603.913417:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126603.913420:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126603.913421:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126603.913423:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126603.913425:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746126603.913445:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721246592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (3449us total) trans 21474840188 rc 0/0 00000100:00100000:1.0:1746126603.913449:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12726 00000004:00080000:1.0:1746126603.915083:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099251180/2, rc 0, transno 21474840188 00000100:00100000:1.0:1746126603.915092:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721246592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126603.915112:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15e300/2, rc 0, transno 21474840187 00000100:00100000:1.0:1746126603.915115:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721247104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126603.915125:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873003 gen 2 00000004:00080000:1.0:1746126603.915292:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e722680, transno 17179872903 00000004:00080000:1.0:1746126603.915305:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e721880, transno 17179872904 00000004:00080000:1.0:1746126603.915307:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e720e00, transno 17179872905 00000004:00080000:1.0:1746126603.915309:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e721500, transno 17179872906 00000004:00080000:1.0:1746126603.915311:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e721c00, transno 17179872907 00000004:00080000:1.0:1746126603.915313:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e723b80, transno 17179872908 00000004:00080000:1.0:1746126603.915315:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e723480, transno 17179872909 00000004:00080000:1.0:1746126603.915317:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b6b100, transno 17179872910 00000004:00080000:1.0:1746126603.915319:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e720380, transno 17179872911 00000004:00080000:1.0:1746126603.915321:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c7ca80, transno 17179872915 00000004:00080000:1.0:1746126603.915323:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099250380, transno 17179872916 00000004:00080000:1.0:1746126603.915325:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b191c00, transno 17179872917 00000004:00080000:1.0:1746126603.915327:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099253480, transno 17179872918 00000004:00080000:1.0:1746126603.915329:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b190000, transno 17179872919 00000004:00080000:1.0:1746126603.915331:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131d54a80, transno 17179872920 00000004:00080000:1.0:1746126603.915333:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1c00, transno 17179872921 00000004:00080000:1.0:1746126603.915335:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b192a00, transno 17179872922 00000004:00080000:1.0:1746126603.915338:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099251c00, transno 17179872923 00000004:00080000:1.0:1746126603.915340:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099250a80, transno 17179872924 00000004:00080000:1.0:1746126603.915342:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e722d80, transno 17179872925 00000004:00080000:1.0:1746126603.915343:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e722a00, transno 17179872926 00000004:00080000:1.0:1746126603.915346:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2d80, transno 17179872927 00000004:00080000:1.0:1746126603.915348:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3c000, transno 17179872928 00000004:00080000:1.0:1746126603.915350:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099253800, transno 17179872929 00000004:00080000:1.0:1746126603.915352:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e723800, transno 17179872930 00000004:00080000:1.0:1746126603.915354:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099251880, transno 17179872931 00000004:00080000:1.0:1746126603.915356:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e722300, transno 17179872932 00000004:00080000:1.0:1746126603.915359:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15c700, transno 17179872938 00000004:00080000:1.0:1746126603.915361:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d9a680, transno 17179872939 00000004:00080000:1.0:1746126603.915363:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15ce00, transno 17179872940 00000004:00080000:1.0:1746126603.915365:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d9a300, transno 17179872941 00000004:00080000:1.0:1746126603.915367:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15fb80, transno 17179872942 00000004:00080000:1.0:1746126603.915370:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924c6300, transno 17179872943 00000004:00080000:1.0:1746126603.915372:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15c000, transno 17179872944 00000004:00080000:1.0:1746126603.915374:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15d180, transno 17179872945 00000004:00080000:1.0:1746126603.915376:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99f80, transno 17179872946 00000004:00080000:1.0:1746126603.915378:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f54380, transno 17179872947 00000004:00080000:1.0:1746126603.915380:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f56680, transno 17179872948 00000004:00080000:1.0:1746126603.915382:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f54000, transno 17179872949 00000004:00080000:1.0:1746126603.915384:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f56a00, transno 17179872950 00000004:00080000:1.0:1746126603.915385:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135ed3800, transno 17179872951 00000004:00080000:1.0:1746126603.915387:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f55c00, transno 17179872952 00000004:00080000:1.0:1746126603.915389:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f56300, transno 17179872953 00000004:00080000:1.0:1746126603.915391:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f55f80, transno 17179872954 00000004:00080000:1.0:1746126603.915393:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f57b80, transno 17179872955 00000004:00080000:1.0:1746126603.915395:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98700, transno 17179872962 00000004:00080000:1.0:1746126603.915396:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99500, transno 17179872963 00000004:00080000:1.0:1746126603.915398:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98e00, transno 17179872964 00000004:00080000:1.0:1746126603.915399:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d9b100, transno 17179872965 00000004:00080000:1.0:1746126603.915401:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99880, transno 17179872966 00000004:00080000:1.0:1746126603.915403:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98380, transno 17179872967 00000004:00080000:1.0:1746126603.915404:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98a80, transno 17179872968 00000004:00080000:1.0:1746126603.915405:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99180, transno 17179872969 00000004:00080000:1.0:1746126603.915407:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a448ea00, transno 17179872970 00000004:00080000:1.0:1746126603.915409:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e580380, transno 17179872971 00000004:00080000:1.0:1746126603.915411:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b1500, transno 17179872972 00000004:00080000:1.0:1746126603.915413:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e582d80, transno 17179872973 00000004:00080000:1.0:1746126603.915415:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b1f80, transno 17179872974 00000004:00080000:1.0:1746126603.915416:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e580a80, transno 17179872975 00000004:00080000:1.0:1746126603.915418:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5b2300, transno 17179872976 00000004:00080000:1.0:1746126603.915421:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ddaea00, transno 17179872977 00000004:00080000:1.0:1746126603.915422:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e583480, transno 17179872978 00000004:00080000:1.0:1746126603.915425:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e581180, transno 17179872979 00000004:00080000:1.0:1746126603.915427:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15500, transno 17179872986 00000004:00080000:1.0:1746126603.915429:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14a80, transno 17179872987 00000004:00080000:1.0:1746126603.915430:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15180, transno 17179872988 00000004:00080000:1.0:1746126603.915433:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17480, transno 17179872989 00000004:00080000:1.0:1746126603.915435:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b16680, transno 17179872990 00000004:00080000:1.0:1746126603.915437:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17100, transno 17179872991 00000004:00080000:1.0:1746126603.915439:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b16300, transno 17179872992 00000004:00080000:1.0:1746126603.915441:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15c00, transno 17179872993 00000004:00080000:1.0:1746126603.915443:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dad1c00, transno 17179872994 00000004:00080000:1.0:1746126603.915445:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcd880, transno 17179872995 00000004:00080000:1.0:1746126603.915448:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcd500, transno 17179872996 00000004:00080000:1.0:1746126603.915450:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df5c00, transno 17179872997 00000004:00080000:1.0:1746126603.915452:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df5880, transno 17179872998 00000004:00080000:1.0:1746126603.915454:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df6300, transno 17179872999 00000004:00080000:1.0:1746126603.915456:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcc380, transno 17179873000 00000004:00080000:1.0:1746126603.915458:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df7100, transno 17179873001 00000004:00080000:1.0:1746126603.915460:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dab9f80, transno 17179873002 00000004:00080000:1.0:1746126603.915463:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df6680, transno 17179873003 00000100:00100000:1.0:1746126603.915468:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012b190e00 x1830945721247616/t17179873017(17179873017) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126619 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746126603.915476:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b190e00/2, rc 0, transno 17179873017 00000100:00100000:1.0:1746126603.915479:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721247616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126603.915492:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b191500/2, rc 0, transno 17179873018 00000100:00100000:1.0:1746126603.915495:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721248128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126603.915503:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099250700/2, rc 0, transno 21474840185 00000100:00100000:1.0:1746126603.915506:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721246464:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126603.915513:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099250000/2, rc 0, transno 21474840186 00000100:00100000:1.0:1746126603.915515:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721246976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126603.915522:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15ca80/2, rc 0, transno 17179873015 00000100:00100000:1.0:1746126603.915525:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721247488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126603.915531:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b191f80/2, rc 0, transno 17179873016 00000100:00100000:1.0:1746126603.915534:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721248000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.915648:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721247744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3825us (6054us total) trans 17179873019 rc 0/0 00000100:00100000:1.0:1746126603.915655:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12720 00000100:00100000:0.0:1746126603.915982:0:3281:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721248512:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126603.915992:0:3281:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721248640:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126603.916009:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126603.916017:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dc1b400/0xb50e82586761193c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746126603.917031:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721248384:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.917049:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126603.918274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.918334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.918356:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721155072 00000100:00100000:1.0:1746126603.918362:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721155072 00000100:00100000:1.0:1746126603.918397:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8758 00000100:00100000:1.0:1746126603.918403:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30936:x1830945721155072:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126603.918423:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126603.918436:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ca72 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126603.918595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.918677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126603.918994:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.919045:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.919060:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.919062:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126603.919065:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d523200, rc 0) 00000100:00100000:1.0:1746126603.919084:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30936:x1830945721155072:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 680us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.919089:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8758 00010000:00010000:1.0:1746126603.919110:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919117:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126603.919130:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126603.919236:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919243:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919249:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919254:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f16fe00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126603.919258:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919263:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919270:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.919272:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126603.919274:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919278:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fe00/0xb50e825867611982 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919294:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919299:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919303:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919307:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b897400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126603.919308:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919312:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919317:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126603.919319:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126603.919321:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919324:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b897400/0xb50e82586761194a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919333:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919337:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919342:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919346:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b896800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126603.919348:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919352:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919357:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a496a700) 00010000:00010000:1.0:1746126603.919359:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126603.919361:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126603.919365:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896800/0xb50e825867611951 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126603.919380:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919387:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126603.919392:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896400/0xb50e825867611943 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca4f expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.919397:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896400/0xb50e825867611943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca4f expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1746126603.919397:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126603.919403:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b896400, rc 0) 00000100:00100000:1.0:1746126603.919416:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30942:x1830945721154048:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 48687us (48939us total) trans 8589942906 rc 301/301 00000100:00100000:1.0:1746126603.919421:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8754 00010000:00010000:0.0:1746126603.919440:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919445:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919450:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919453:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f16f200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126603.919455:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919460:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919467:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126603.919469:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126603.919471:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919475:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f200/0xb50e825867611989 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919485:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919493:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919497:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919501:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f16fa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126603.919503:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919507:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919513:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126603.919514:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126603.919517:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919520:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611974 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919527:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919531:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919536:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919539:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f16f400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126603.919541:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919549:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919554:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a496a700) 00010000:00010000:0.0:1746126603.919556:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126603.919557:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919560:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16f400/0xb50e82586761197b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126603.919585:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16ee00/0xb50e82586761196d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca6b expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.919590:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16ee00/0xb50e82586761196d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca6b expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.919596:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f16ee00, rc 0) 00000100:00100000:0.0:1746126603.919612:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:30944:x1830945721154816:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 34319us (35620us total) trans 8589942907 rc 301/301 00000100:00100000:0.0:1746126603.919617:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8757 00000100:00100000:1.0:1746126603.919823:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721248768 00000100:00100000:1.0:1746126603.919843:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721248768 00000100:00100000:1.0:1746126603.919864:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12730 00000100:00100000:1.0:1746126603.919869:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721248768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126603.920043:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721248768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (1686us total) trans 17179873020 rc 0/0 00000100:00100000:1.0:1746126603.920052:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12730 00000100:00100000:0.0:1746126603.942986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.943014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.943025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.943036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.943053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.943081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.952708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.952753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.964082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.964171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.964257:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721157504 00000100:00100000:1.0:1746126603.964261:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721157504 00000100:00100000:1.0:1746126603.964303:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8759 00000100:00100000:1.0:1746126603.964315:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30935:x1830945721157504:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126603.964330:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126603.964347:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc200/0xb50e8258676119c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ca9c expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.964399:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc200/0xb50e8258676119c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca9c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.964411:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc200/0xb50e8258676119c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca9c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.964427:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.964430:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126603.964433:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cc200, rc 0) 00000100:00100000:1.0:1746126603.964533:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:30935:x1830945721157504:12345-192.168.203.2@tcp:101:cat.0 Request processed in 224us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.964539:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8759 00000100:00100000:0.0:1746126603.964820:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.964884:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721157632 00000100:00100000:1.0:1746126603.964887:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721157632 00000100:00100000:1.0:1746126603.964901:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8760 00000100:00100000:1.0:1746126603.964905:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:30942:x1830945721157632:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126603.964912:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126603.964914:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746126603.964927:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997f4e00/0xb50e825867611966 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca64 expref: 10 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.964951:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.964954:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126603.964959:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc800/0xb50e8258676119cf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4caa3 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.964990:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126603.965002:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 222 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.965009:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.965018:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc200/0xb50e8258676119c8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca9c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.965023:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126603.965047:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc200/0xb50e8258676119c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca9c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.965057:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc200/0xb50e8258676119c8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca9c expref: 10 pid: 20362 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.965066:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721248896:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.965125:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.965133:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 8 pid: 14549 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.965140:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249024:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.965168:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 222 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126603.965175:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b896e00/0xb50e82586761195f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca5d expref: 222 pid: 20362 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746126603.965181:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249152:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.965192:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126603.971169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.971212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126603.971216:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721248896:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.971228:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249024:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126603.971237:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249152:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126603.971262:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126603.971401:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6650 00000100:00100000:1.0:1746126603.971408:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721157760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126603.971416:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126603.971421:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 9 pid: 14549 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.971441:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 9 pid: 14549 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.971454:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523200/0xb50e825867611990 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca72 expref: 9 pid: 14549 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746126603.971472:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126603.971476:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126603.971481:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126603.971484:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126603.971521:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721157760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126603.971530:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6650 00000100:00100000:0.0:1746126603.974447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.974497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126603.978846:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126603.978856:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00000040:00080000:1.0:1746126603.979411:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2523, 88 off213872 00000004:00080000:1.0:1746126603.979417:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725893588828ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980007:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2623, 88 off222768 00000004:00080000:1.0:1746126603.980012:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894184359ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980031:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2624, 88 off222856 00000004:00080000:1.0:1746126603.980034:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894206221ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980041:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2524, 88 off213960 00000004:00080000:1.0:1746126603.980044:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894216169ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980049:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2525, 88 off214048 00000004:00080000:1.0:1746126603.980052:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894224222ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980058:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2625, 88 off222944 00000004:00080000:1.0:1746126603.980060:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894232450ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980066:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2626, 88 off223032 00000004:00080000:1.0:1746126603.980068:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894240446ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980073:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2526, 88 off214136 00000004:00080000:1.0:1746126603.980075:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894248059ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980081:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2627, 88 off223120 00000004:00080000:1.0:1746126603.980083:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894255607ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980088:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2527, 88 off214224 00000004:00080000:1.0:1746126603.980091:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894263189ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980096:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2628, 88 off223208 00000004:00080000:1.0:1746126603.980098:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894270882ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980104:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2528, 88 off214312 00000004:00080000:1.0:1746126603.980106:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894278522ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980121:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2629, 88 off223296 00000004:00080000:1.0:1746126603.980124:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894296410ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980130:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2529, 88 off214400 00000004:00080000:1.0:1746126603.980134:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894306457ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126603.980140:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2630, 88 off223384 00000004:00080000:1.0:1746126603.980142:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894314854ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980156:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2631, 88 off223472 00000004:00080000:1.0:1746126603.980159:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725894331319ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126603.980165:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2530, 88 off214488 00000004:00080000:1.0:1746126603.980168:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725894340227ns, next at 687927188999ns, rc = 0 00000100:00100000:1.0:1746126603.997810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126603.998243:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721158272 00000100:00100000:0.0:1746126603.998252:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721158272 00000100:00100000:0.0:1746126603.998296:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8762 00000100:00100000:0.0:1746126603.998303:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:30944:x1830945721158272:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126603.998326:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126603.998344:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cab1 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.998399:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab1 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.998409:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab1 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.998419:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126603.998422:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126603.998425:0:15560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e8258676119dd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caaa expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126603.998430:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a64200, rc 0) 00000100:00100000:0.0:1746126603.998471:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+223:30944:x1830945721158272:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 169us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126603.998477:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8762 00010000:00010000:1.0:1746126604.002365:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002380:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126604.002383:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746126604.002387:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e8258676119dd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caaa expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002397:0:20362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e8258676119dd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caaa expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002404:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e8258676119dd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caaa expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002411:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab1 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002418:0:20362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab1 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002423:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab1 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.002458:0:20362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64200/0xb50e8258676119e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab1 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126604.002471:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249280:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126604.002557:0:20362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e8258676119dd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caaa expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126604.002565:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249408:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126604.002582:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44f00 going to sleep for 11 seconds 00000001:00080000:0.0:1746126604.002721:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942907 is committed 00000001:00080000:0.0:1746126604.002732:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942910 is committed 00000004:00080000:0.0:1746126604.002736:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1916 committed 00000004:00080000:0.0:1746126604.002742:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746126604.002747:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2013 committed 00000004:00080000:0.0:1746126604.002749:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1915 committed 00000004:00080000:0.0:1746126604.002750:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746126604.002752:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1914 committed 00000004:00080000:0.0:1746126604.002753:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746126604.002755:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1913 committed 00000004:00080000:0.0:1746126604.002767:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746126604.002768:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1912 committed 00000004:00080000:0.0:1746126604.002770:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2009 committed 00000004:00080000:0.0:1746126604.002771:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2008 committed 00000004:00080000:0.0:1746126604.002773:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1911 committed 00000004:00080000:0.0:1746126604.002775:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1910 committed 00000004:00080000:0.0:1746126604.002776:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2007 committed 00000004:00080000:0.0:1746126604.002781:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2006 committed 00000004:00080000:0.0:1746126604.002783:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1909 committed 00000001:00080000:0.0:1746126604.002800:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942909 is committed 00000100:00100000:0.0:1746126604.005878:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721249664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.005917:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.005936:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.005947:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.005955:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.005968:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.005976:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721251200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.005986:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.005998:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:0.0:1746126604.006002:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721249536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.006013:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006020:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.006031:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006039:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.006049:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006057:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721251072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.006068:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006076:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721251584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.006087:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006101:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721250816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.006114:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006121:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721251328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.006132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006139:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126604.006152:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721250944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.006167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.006174:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721251456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.006184:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126604.006660:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12741 00000100:00100000:1.0:1746126604.006668:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721250176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.006864:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3297:x1830945721250176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (915us total) trans 17179873025 rc 0/0 00000100:00100000:1.0:1746126604.006870:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12741 00000004:00080000:0.0:1746126604.006879:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e9500/2, rc 0, transno 17179873025 00000100:00100000:1.0:1746126604.006881:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12742 00000100:00100000:0.0:1746126604.006884:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.006885:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721250688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126604.006992:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126604.006995:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126604.006997:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126604.006999:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126604.007000:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:1.0:1746126604.007021:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721250688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (1052us total) trans 21474840189 rc 0/0 00000100:00100000:0.0:1746126604.007021:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12743 00000100:00100000:1.0:1746126604.007026:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12742 00000100:00100000:0.0:1746126604.007027:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721251200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007033:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12744 00000100:00100000:1.0:1746126604.007037:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721249536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126604.007103:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126604.007105:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126604.007107:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126604.007110:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126604.007111:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126604.007116:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721251200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1128us total) trans 21474840190 rc 0/0 00000100:00100000:0.0:1746126604.007121:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12743 00000100:00100000:1.0:1746126604.007124:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3297:x1830945721249536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1110us total) trans 17179873026 rc 0/0 00000100:00100000:1.0:1746126604.007128:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12744 00000100:00100000:0.0:1746126604.007132:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12745 00000100:00100000:1.0:1746126604.007134:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12746 00000100:00100000:0.0:1746126604.007136:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721250048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.007138:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721250560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.007184:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12747 00000100:00100000:1.0:1746126604.007189:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721251072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126604.007226:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126604.007229:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126604.007230:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126604.007232:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126604.007233:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126604.007251:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3297:x1830945721250048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (1219us total) trans 17179873027 rc 0/0 00000100:00100000:0.0:1746126604.007256:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12745 00000100:00100000:1.0:1746126604.007260:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721251072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1191us total) trans 21474840191 rc 0/0 00000100:00100000:1.0:1746126604.007265:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12747 00000100:00100000:0.0:1746126604.007267:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12748 00000100:00100000:0.0:1746126604.007271:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721251584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007274:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12749 00000100:00100000:1.0:1746126604.007277:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721250816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007339:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3297:x1830945721250560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (1288us total) trans 17179873028 rc 0/0 00000100:00100000:0.0:1746126604.007339:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721251584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1251us total) trans 21474840192 rc 0/0 00000100:00100000:1.0:1746126604.007344:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12746 00000100:00100000:0.0:1746126604.007346:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12748 00000100:00100000:1.0:1746126604.007351:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12750 00000100:00100000:0.0:1746126604.007354:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12751 00000100:00100000:1.0:1746126604.007355:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721251328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.007357:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721250944:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.007380:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8700/2, rc 0, transno 17179873026 00000100:00100000:0.0:1746126604.007384:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721249536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126604.007390:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e9880/2, rc 0, transno 17179873027 00000100:00100000:0.0:1746126604.007393:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126604.007398:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918eb480/2, rc 0, transno 17179873028 00000100:00100000:0.0:1746126604.007400:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126604.007407:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e722680/2, rc 0, transno 21474840191 00000100:00100000:0.0:1746126604.007410:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721251072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.007415:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e721c00/2, rc 0, transno 21474840192 00000100:00100000:0.0:1746126604.007418:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721251584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007424:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721251328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1290us total) trans 21474840193 rc 0/0 00000004:00080000:0.0:1746126604.007424:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b192a00/2, rc 0, transno 21474840189 00000100:00100000:0.0:1746126604.007426:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721250688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007429:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12750 00000004:00080000:0.0:1746126604.007431:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e721880/2, rc 0, transno 21474840190 00000100:00100000:0.0:1746126604.007433:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721251200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007437:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12752 00000100:00100000:1.0:1746126604.007442:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721251456:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.007444:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e720e00/2, rc 0, transno 21474840193 00000100:00100000:0.0:1746126604.007447:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721251328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.007521:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721251456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1335us total) trans 21474840194 rc 0/0 00000100:00100000:1.0:1746126604.007526:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12752 00002000:00010000:1.0:1746126604.007581:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126604.007584:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126602 -> 1746126602 00002000:00010000:1.0:1746126604.007585:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126602 -> 1746126602 00002000:00010000:1.0:1746126604.007587:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126602 -> 1746126602 00002000:00010000:1.0:1746126604.007588:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126604.007600:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721250816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (1485us total) trans 21474840195 rc 0/0 00000100:00100000:1.0:1746126604.007605:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12749 00000004:00080000:0.0:1746126604.008473:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e721500/2, rc 0, transno 21474840194 00000100:00100000:0.0:1746126604.008477:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721251456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.008484:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b190a80/2, rc 0, transno 21474840195 00000100:00100000:0.0:1746126604.008486:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721250816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.008499:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8a80/2, rc 0, transno 17179873029 00000100:00100000:0.0:1746126604.008502:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721249664:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126604.008574:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126604.008576:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126604.008579:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126604.008581:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126604.008582:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126604.008605:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721250944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1247us (2436us total) trans 21474840196 rc 0/0 00000100:00100000:0.0:1746126604.008610:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12751 00000004:00080000:0.0:1746126604.008628:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b190380/2, rc 0, transno 21474840196 00000100:00100000:0.0:1746126604.008631:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721250944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.011335:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249280:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126604.011348:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721249408:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126604.011383:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc800/0xb50e8258676119cf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 10 pid: 20362 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746126604.011509:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.011538:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cc400, rc 0) 00000100:00100000:1.0:1746126604.011586:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30942:x1830945721157632:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 46679us (46764us total) trans 8589942910 rc 0/0 00000100:00100000:1.0:1746126604.011594:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8760 00000100:00100000:0.0:1746126604.012705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.012876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.013134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126604.013195:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126604.015731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126604.016031:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126604.019159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.019223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.019291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126604.019603:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746126604.019607:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126604.020618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.020630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.020662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.023168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.023927:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721159680 00000100:00100000:1.0:1746126604.023933:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721159680 00010000:00010000:1.0:1746126604.023956:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973a2c00/0xb50e8258676119b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca95 expref: 25 pid: 8438 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746126604.023975:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6653 00000100:00100000:1.0:1746126604.023980:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721159680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126604.023991:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126604.024010:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973a2c00/0xb50e8258676119b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca95 expref: 25 pid: 8438 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126604.024019:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973a2c00/0xb50e8258676119b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca95 expref: 25 pid: 8438 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126604.024038:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973a2c00/0xb50e8258676119b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca95 expref: 25 pid: 8438 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746126604.024047:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126604.024062:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721159680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 81us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.024067:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6653 00000100:00100000:0.0:1746126604.024179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.024247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.031294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.031653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.032555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.032591:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7344 00000100:00100000:1.0:1746126604.032600:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721160576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126604.038136:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721160576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 5524us (6470us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126604.038154:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7344 00002000:00100000:1.0:1746126604.038165:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f1e2d80 x1830945721160576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:365/0 lens 488/440 e 0 to 0 dl 1746126615 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126604.038175:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2d80 with x1830945721160576 ext(4194304->4976639) 00002000:00010000:1.0:1746126604.038181:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e2d80 00000100:00100000:0.0:1746126604.039302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.042738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.042822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.042884:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721161344 00000100:00100000:1.0:1746126604.042894:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721161344 00002000:00100000:1.0:1746126604.042934:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3719168->3723263) req@ffff88008f1e0380 x1830945721161344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:365/0 lens 488/0 e 0 to 0 dl 1746126615 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126604.042943:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0380 with x1830945721161344 ext(3719168->3723263) 00002000:00010000:1.0:1746126604.042949:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e0380 00000100:00100000:1.0:1746126604.042982:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7346 00000100:00100000:1.0:1746126604.042989:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721161344:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126604.043136:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721161344:12345-192.168.203.2@tcp:3:cat.0 Request processed in 146us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126604.043143:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7346 00002000:00100000:1.0:1746126604.043517:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3719168->3723263) req@ffff88008f1e0380 x1830945721161344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:365/0 lens 488/4536 e 0 to 0 dl 1746126615 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126604.043525:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0380 with x1830945721161344 ext(3719168->3723263) 00002000:00010000:1.0:1746126604.043528:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e0380 00000100:00100000:0.0:1746126604.048120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.051281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.081399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126604.081939:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126604.086477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.086516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.086545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.086562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.086861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.093485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.095736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.096081:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6655 00000100:00100000:0.0:1746126604.096089:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721163136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126604.096102:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126604.096106:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136897400/0xb50e825867611a38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf0 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746126604.096265:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136897400/0xb50e825867611a38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf0 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746126604.096286:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136897400/0xb50e825867611a38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf0 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746126604.096310:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126604.096315:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136896800/0xb50e825867611a70 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126604.096323:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136896800/0xb50e825867611a70 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126604.096329:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136896800/0xb50e825867611a70 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126604.096384:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126604.096665:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721163136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 577us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126604.096672:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6655 00000100:00100000:0.0:1746126604.098584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.100646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.103003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.103037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.103107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.103119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.103417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.103548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.104460:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721164288 00000100:00100000:0.0:1746126604.104464:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721164288 00000100:00100000:0.0:1746126604.104480:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12772 00000100:00100000:0.0:1746126604.104485:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721164288:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126604.104499:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.104509:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0800/0xb50e8258676119f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cabf expref: 10 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.104514:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126604.104516:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126604.104517:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.104535:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0800/0xb50e8258676119f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3723263) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cabf expref: 10 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.104543:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0800/0xb50e8258676119f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3723263) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cabf expref: 10 pid: 17475 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746126604.104551:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721254784:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126604.104572:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084180 going to sleep for 11 seconds 00000100:00100000:1.0:1746126604.110615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.110637:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721164416 00000100:00100000:1.0:1746126604.110642:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721164416 00002000:00100000:1.0:1746126604.110688:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1163264->1789951) req@ffff88009e3a6a00 x1830945721164416/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:365/0 lens 488/0 e 0 to 0 dl 1746126615 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126604.110698:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a6a00 with x1830945721164416 ext(1163264->1789951) 00010000:00010000:1.0:1746126604.110705:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c386600/0xb50e8258676119eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab8 expref: 23 pid: 8437 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746126604.110717:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c386600/0xb50e8258676119eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab8 expref: 23 pid: 8437 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746126604.110723:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a6a00 00000100:00100000:1.0:1746126604.110743:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1666 00000100:00100000:1.0:1746126604.110749:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721164416:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126604.111423:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721254784:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126604.111446:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126604.112332:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.112634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.112662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.112688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.112870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.113041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.113737:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6660 00000100:00100000:1.0:1746126604.113746:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721165312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126604.113754:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126604.113766:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c40e600/0xb50e825867611a62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb13 expref: 11 pid: 23766 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.113776:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c40e600/0xb50e825867611a62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb13 expref: 11 pid: 23766 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.113789:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c40e600/0xb50e825867611a62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb13 expref: 11 pid: 23766 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.113803:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126604.114162:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721165312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 417us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.114169:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6660 00000100:00100000:0.0:1746126604.114187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.114582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.114608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.114633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.114658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.115900:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721166080 00000100:00100000:1.0:1746126604.115905:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721166080 00010000:00010000:1.0:1746126604.115922:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec06e00/0xb50e825867611958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca56 expref: 12 pid: 4642 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746126604.115934:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6662 00000100:00100000:1.0:1746126604.115940:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721165824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126604.115950:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126604.115966:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4581a00/0xb50e8258676119a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca79 expref: 26 pid: 8438 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.115976:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4581a00/0xb50e8258676119a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca79 expref: 26 pid: 8438 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.115992:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4581a00/0xb50e8258676119a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca79 expref: 26 pid: 8438 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.116003:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126604.116027:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721165824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 88us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.116033:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6662 00000100:00100000:1.0:1746126604.116046:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6665 00000100:00100000:1.0:1746126604.116051:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721165184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126604.116057:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126604.116066:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136605000/0xb50e8258676119c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca8e expref: 24 pid: 8438 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.116074:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136605000/0xb50e8258676119c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca8e expref: 24 pid: 8438 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.116084:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136605000/0xb50e8258676119c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ca8e expref: 24 pid: 8438 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.116092:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126604.116094:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126604.116097:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0000/0xb50e825867611aa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.116116:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0000/0xb50e825867611aa8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.116137:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126604.116167:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721165184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 114us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.116173:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6665 00000100:00080000:1.0:1746126604.116207:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126604.116290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.116324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.116683:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721165696 00000100:00100000:1.0:1746126604.116687:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721165696 00010000:00010000:1.0:1746126604.116700:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867611a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf7 expref: 9 pid: 23766 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746126604.116715:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6667 00000100:00100000:1.0:1746126604.116719:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721165696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126604.116725:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126604.116732:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867611a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf7 expref: 9 pid: 23766 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.116739:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867611a54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf7 expref: 9 pid: 23766 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.117566:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867611a54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caf7 expref: 7 pid: 23766 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746126604.117576:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126604.117577:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126604.117580:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867611ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.117587:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867611ab6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.117610:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126604.117627:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721165696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 907us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.117633:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6667 00000100:00100000:1.0:1746126604.121001:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721164416:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 10242us (10377us total) trans 17179873030 rc 0/0 00000100:00100000:1.0:1746126604.121015:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1666 00002000:00100000:1.0:1746126604.121027:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1163264->1789951) req@ffff88009e3a6a00 x1830945721164416/t17179873030(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:365/0 lens 488/448 e 0 to 0 dl 1746126615 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126604.121043:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a6a00 with x1830945721164416 ext(1163264->1789951) 00010000:00010000:1.0:1746126604.121052:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c386600/0xb50e8258676119eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab8 expref: 24 pid: 8437 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746126604.121066:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c386600/0xb50e8258676119eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cab8 expref: 24 pid: 8437 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746126604.121073:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a6a00 00000100:00100000:0.0:1746126604.124641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126604.124937:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.124946:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.124963:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.124971:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.124977:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.124983:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136897600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126604.124987:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.124994:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.125005:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126604.125011:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136897600/0xb50e825867611a9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126604.125071:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721163776:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 21402us (22033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126604.125079:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12767 00000100:00100000:0.0:1746126604.126913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126604.127375:0:4640:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127383:0:4640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127399:0:4640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127405:0:4640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127411:0:4640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127417:0:4640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a64e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126604.127421:0:4640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127432:0:4640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127441:0:4640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126604.127447:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a64e00/0xb50e825867611abd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126604.127485:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721164288:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 23000us (23937us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.127492:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12772 00000100:00100000:0.0:1746126604.128791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.132662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126604.132762:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721166976 00000100:00100000:1.0:1746126604.132766:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721166976 00010000:00010000:1.0:1746126604.132780:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746126604.132794:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6672 00000100:00100000:1.0:1746126604.132799:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721166976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126604.132805:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126604.132809:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746126604.132816:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746126604.132850:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e8258676119d6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4caa3 expref: 9 pid: 20362 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746126604.132859:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126604.132861:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126604.132867:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126604.132873:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126604.132887:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126604.132903:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721166976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126604.132909:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6672 00000001:00080000:1.0:1746126604.151169:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942915 is committed 00000004:00080000:1.0:1746126604.151181:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1924 committed 00000004:00080000:1.0:1746126604.151189:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2023 committed 00000004:00080000:1.0:1746126604.151195:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2022 committed 00000004:00080000:1.0:1746126604.151197:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1923 committed 00000004:00080000:1.0:1746126604.151199:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2021 committed 00000004:00080000:1.0:1746126604.151200:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1922 committed 00000004:00080000:1.0:1746126604.151201:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2020 committed 00000004:00080000:1.0:1746126604.151203:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1921 committed 00000004:00080000:1.0:1746126604.151204:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2019 committed 00000004:00080000:1.0:1746126604.151206:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1920 committed 00000004:00080000:1.0:1746126604.151207:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2018 committed 00000004:00080000:1.0:1746126604.151209:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2017 committed 00000004:00080000:1.0:1746126604.151211:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1919 committed 00000004:00080000:1.0:1746126604.151212:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1918 committed 00000004:00080000:1.0:1746126604.151214:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2016 committed 00000004:00080000:1.0:1746126604.151215:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2015 committed 00000004:00080000:1.0:1746126604.151217:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1917 committed 00000001:00080000:1.0:1746126604.151227:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942912 is committed 00000001:00080000:1.0:1746126604.151231:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942911 is committed 00000004:00010000:0.0:1746126604.152337:0:14548:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ed4b100 reply state ffff880092ea2800 transno 8589942915 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126604.152349:0:14548:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746126604.152456:0:14548:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746126604.152472:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:30951:x1830945721166592:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 23412us (23679us total) trans 8589942915 rc 0/0 00000100:00100000:0.0:1746126604.152480:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8767 00010000:00010000:0.0:1746126604.152610:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126604.152618:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126604.152624:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126604.152629:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5a98000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126604.152632:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126604.152638:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126604.152656:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126604.152659:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126604.152662:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126604.152667:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a98000/0xb50e825867611ac4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126604.153702:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721255680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.153748:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126604.153776:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721256192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.153790:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126604.153802:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721256704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.153817:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.153889:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721255296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.154008:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721255424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126604.154299:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721257216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.154314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.154567:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721255680 00000100:00100000:0.0:1746126604.154578:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721255680 00000100:00100000:0.0:1746126604.154612:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256192 00000100:00100000:0.0:1746126604.154614:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256192 00000100:00100000:0.0:1746126604.154842:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257216 00000100:00100000:0.0:1746126604.154845:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257216 00000004:00080000:1.0:1746126604.155653:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14a80/2, rc 0, transno 21474840198 00000100:00100000:1.0:1746126604.155660:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721256192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126604.155668:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b17100/2, rc 0, transno 17179873032 00000100:00100000:1.0:1746126604.155674:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721256704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126604.155682:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14000/2, rc 0, transno 17179873033 00000100:00100000:1.0:1746126604.155684:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721257216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.155721:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126604.155727:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721257344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.155747:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126604.155773:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257344 00000100:00100000:1.0:1746126604.155776:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257344 00000100:00100000:1.0:1746126604.155792:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12777 00000100:00100000:1.0:1746126604.155796:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3296:x1830945721257344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126604.155899:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3296:x1830945721257344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (151us total) trans 17179873034 rc 0/0 00000100:00100000:1.0:1746126604.155905:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12777 00000004:00080000:1.0:1746126604.155925:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14700/2, rc 0, transno 17179873034 00000100:00100000:1.0:1746126604.155928:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721257344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156458:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12780 00000100:00100000:0.0:1746126604.156465:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3295:x1830945721256576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156562:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721256576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (492us total) trans 17179873035 rc 0/0 00000100:00100000:0.0:1746126604.156567:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12780 00000100:00100000:0.0:1746126604.156575:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12781 00000100:00100000:0.0:1746126604.156578:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3295:x1830945721257088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156648:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721257088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (556us total) trans 17179873036 rc 0/0 00000100:00100000:0.0:1746126604.156652:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12781 00000100:00100000:0.0:1746126604.156681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156701:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721255936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.156717:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156723:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721256448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156743:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721256960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156770:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156779:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721255808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.156801:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156808:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721256320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156819:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156825:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721256832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.156854:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126604.156873:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721255424 00000100:00100000:0.0:1746126604.156875:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721255424 00000100:00100000:0.0:1746126604.156886:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721255936 00000100:00100000:0.0:1746126604.156887:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721255936 00000100:00100000:0.0:1746126604.156893:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256448 00000100:00100000:0.0:1746126604.156894:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256448 00000100:00100000:0.0:1746126604.156899:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256960 00000100:00100000:0.0:1746126604.156901:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256960 00000100:00100000:0.0:1746126604.156906:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721255296 00000100:00100000:0.0:1746126604.156908:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721255296 00000100:00100000:0.0:1746126604.156913:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721255808 00000100:00100000:0.0:1746126604.156915:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721255808 00000100:00100000:0.0:1746126604.156920:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256320 00000100:00100000:0.0:1746126604.156922:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256320 00000100:00100000:0.0:1746126604.156929:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256832 00000100:00100000:0.0:1746126604.156930:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256832 00000100:00100000:0.0:1746126604.156939:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12782 00000100:00100000:0.0:1746126604.156943:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721255424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.157029:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721255424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (347us total) trans 21474840200 rc 0/0 00000100:00100000:0.0:1746126604.157034:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12782 00000100:00100000:0.0:1746126604.157043:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12783 00000100:00100000:0.0:1746126604.157047:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721255936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.157115:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721255936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (396us total) trans 21474840201 rc 0/0 00000100:00100000:0.0:1746126604.157120:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12783 00000100:00100000:0.0:1746126604.157128:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12784 00000100:00100000:0.0:1746126604.157132:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721256448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.157215:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721256448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (478us total) trans 17179873037 rc 0/0 00000100:00100000:0.0:1746126604.157220:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12784 00000100:00100000:0.0:1746126604.157228:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12785 00000100:00100000:0.0:1746126604.157232:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721256960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.157294:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721256960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (538us total) trans 17179873038 rc 0/0 00000100:00100000:0.0:1746126604.157299:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12785 00000100:00100000:0.0:1746126604.157307:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12786 00000100:00100000:0.0:1746126604.157310:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721255296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.157384:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3297:x1830945721255296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (613us total) trans 21474840202 rc 0/0 00000100:00100000:0.0:1746126604.157389:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12786 00000100:00100000:0.0:1746126604.157397:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12787 00000100:00100000:0.0:1746126604.157401:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721255808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.157470:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3297:x1830945721255808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (667us total) trans 21474840203 rc 0/0 00000100:00100000:0.0:1746126604.157475:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12787 00000100:00100000:0.0:1746126604.157483:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12788 00000100:00100000:0.0:1746126604.157487:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721256320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126604.157562:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721256320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (741us total) trans 17179873039 rc 0/0 00000100:00100000:0.0:1746126604.157566:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12788 00000100:00100000:0.0:1746126604.157575:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12789 00000100:00100000:0.0:1746126604.157578:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721256832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126604.157646:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126604.157649:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126604.157651:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126604.157653:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126604.157655:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126604.157672:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721256832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (818us total) trans 17179873040 rc 0/0 00000100:00100000:0.0:1746126604.157677:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12789 00000004:00080000:0.0:1746126604.157701:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a5500/2, rc 0, transno 21474840200 00000100:00100000:0.0:1746126604.157705:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721255424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.157711:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a4000/2, rc 0, transno 21474840201 00000100:00100000:0.0:1746126604.157713:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721255936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.157719:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b17480/2, rc 0, transno 17179873037 00000100:00100000:0.0:1746126604.157722:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721256448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126604.157727:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15c00/2, rc 0, transno 17179873038 00000100:00100000:0.0:1746126604.157730:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721256960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126604.157741:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a5880/2, rc 0, transno 21474840202 00000100:00100000:0.0:1746126604.157744:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721255296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.157749:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a4700/2, rc 0, transno 21474840203 00000100:00100000:0.0:1746126604.157751:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721255808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126604.157756:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15180/2, rc 0, transno 17179873039 00000100:00100000:0.0:1746126604.157759:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721256320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126604.157763:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b16300/2, rc 0, transno 17179873040 00000100:00100000:0.0:1746126604.157765:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721256832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126604.157866:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a5f80/2, rc 0, transno 21474840197 00000100:00100000:1.0:1746126604.157870:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721255680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126604.158460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.164966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.167404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.168165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.168999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.169507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.170358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126604.170391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126604.800195:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126605.093062:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721257728:0@lo:400:kworker.0 00000100:00100000:1.0:1746126605.093123:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.093123:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721257472:0@lo:400:kworker.0 00000100:00100000:0.0:1746126605.093882:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.093925:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721257984:0@lo:400:kworker.0 00000100:00100000:0.0:1746126605.093948:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.093977:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257600 00000100:00100000:0.0:1746126605.093980:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257600 00000100:00100000:0.0:1746126605.094002:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721258112 00000100:00100000:0.0:1746126605.094004:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721258112 00000100:00100000:0.0:1746126605.094014:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1746126605.094019:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830945721257600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126605.094047:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830945721257600:12345-0@lo:400:kworker.0 Request processed in 27us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.094053:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1746126605.094070:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126605.094076:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721257856:0@lo:400:kworker.0 00000100:00100000:0.0:1746126605.094096:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721257472:0@lo:400:kworker.0 00000100:00100000:1.0:1746126605.094102:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.094122:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257984 00000100:00100000:0.0:1746126605.094124:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257984 00000100:00100000:1.0:1746126605.094126:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721257728:0@lo:400:kworker.0 00000100:00080000:1.0:1746126605.094153:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126605.094155:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257856 00000100:00080000:1.0:1746126605.094157:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126605.094157:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257856 00000100:00080000:1.0:1746126605.094183:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126605.094214:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721257984:0@lo:400:kworker.0 00000100:00100000:1.0:1746126605.094423:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721257856:0@lo:400:kworker.0 00000100:00100000:1.0:1746126605.109311:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721258240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746126605.109380:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.109962:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721258240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746126605.110371:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721258368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746126605.110401:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.111807:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721258368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746126605.185569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.186941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.190539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.191424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.191440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.191454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.191467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.191497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.191517:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721168512 00000100:00100000:0.0:1746126605.191521:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721168512 00000100:00100000:0.0:1746126605.191541:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721168896 00000100:00100000:0.0:1746126605.191543:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721168896 00000100:00100000:0.0:1746126605.191560:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169024 00000100:00100000:0.0:1746126605.191561:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169024 00000100:00100000:0.0:1746126605.191568:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169408 00000100:00100000:0.0:1746126605.191569:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169408 00000100:00100000:0.0:1746126605.191576:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169664 00000100:00100000:0.0:1746126605.191578:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169664 00000100:00100000:1.0:1746126605.192190:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721169920 00000100:00100000:1.0:1746126605.192195:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721169920 00000100:00100000:1.0:1746126605.192219:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7349 00000100:00100000:1.0:1746126605.192224:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721168512:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:1.0:1746126605.192241:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.192249:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.192250:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.192254:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.192262:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.194526:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7351 00000100:00100000:1.0:1746126605.194536:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721169024:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:1.0:1746126605.194560:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.194569:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.194570:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.194574:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.194583:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746126605.195881:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746126605.195886:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126605.195987:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7354 00000100:00100000:0.0:1746126605.195995:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721169664:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126605.196013:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.196021:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.196022:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.196025:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.196032:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236414:0:21462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236432:0:21462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236440:0:21462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236447:0:21462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e664a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126605.236450:0:21462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236457:0:21462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236475:0:21462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.236480:0:21462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e664a00/0xb50e825867611b26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.236580:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721169024:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 42039us (45131us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126605.236591:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7351 00010000:00010000:1.0:1746126605.253343:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.253355:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.253367:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.253372:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a64e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126605.253375:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.253382:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.253394:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.253399:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a64e00/0xb50e825867611b3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.253458:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721169664:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 57462us (61987us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126605.253465:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7354 00010000:00010000:1.0:1746126605.259423:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.259441:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.259449:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.259460:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e664c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126605.259464:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.259473:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.259492:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.259498:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e664c00/0xb50e825867611b18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.259578:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721168512:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 67347us (69043us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126605.259588:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7349 00000100:00100000:0.0:1746126605.275427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.278043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.280198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.299728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.305437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.307801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.310776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.317270:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721172096 00000100:00100000:1.0:1746126605.317278:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721172096 00000100:00100000:1.0:1746126605.317316:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12801 00000100:00100000:1.0:1746126605.317323:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721172096:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.317339:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.317357:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013489e000/0xb50e825867611bb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cb9f expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.317376:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.317379:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.317386:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013489e000/0xb50e825867611bb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb9f expref: 14 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.317399:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013489e000/0xb50e825867611bb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb9f expref: 14 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.317410:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013489e000, rc 0) 00000100:00100000:1.0:1746126605.317448:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721172096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 125us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.317453:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12801 00000100:00100000:0.0:1746126605.324438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.324487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.324512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.324535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.324601:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.324671:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721172992 00000100:00100000:1.0:1746126605.324680:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721172992 00010000:00010000:1.0:1746126605.324718:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e825867611b7a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb75 expref: 224 pid: 14548 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.324744:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721172736 00000100:00100000:1.0:1746126605.324746:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721172736 00010000:00010000:1.0:1746126605.324757:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008edee800/0xb50e825867611b57 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb6e expref: 12 pid: 14548 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.324769:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721172864 00000100:00100000:1.0:1746126605.324771:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721172864 00010000:00010000:1.0:1746126605.324779:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867611ad9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb3d expref: 10 pid: 20362 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.324793:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6673 00000100:00100000:1.0:1746126605.324799:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:1964:x1830945721172992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.324813:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.324819:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e825867611b7a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb75 expref: 224 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.324852:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed55c00/0xb50e825867611b7a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb75 expref: 224 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.324876:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.324881:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.324890:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.324895:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.324936:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:1964:x1830945721172992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 136us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.324943:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6673 00000100:00100000:1.0:1746126605.324958:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6674 00000100:00100000:1.0:1746126605.324964:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721172736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.324971:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.324975:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008edee800/0xb50e825867611b57 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb6e expref: 12 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.324982:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008edee800/0xb50e825867611b57 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb6e expref: 12 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.324992:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.324995:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.325004:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.325008:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.325022:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721172736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 59us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.325027:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6674 00000100:00100000:1.0:1746126605.325037:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6675 00000100:00100000:1.0:1746126605.325041:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721172864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.325048:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.325052:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867611ad9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb3d expref: 10 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.325060:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867611ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb3d expref: 10 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.325069:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.325072:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.325078:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.325084:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009379bc00/0xb50e825867611ba4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126605.325098:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.325112:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721172864:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.325120:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6675 00000100:00100000:1.0:1746126605.327343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.338101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.345457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.345985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.347550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.348287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.349358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.352682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.352700:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175040 00000100:00100000:0.0:1746126605.352707:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175040 00000100:00100000:0.0:1746126605.352744:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12802 00000100:00100000:0.0:1746126605.352751:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721175040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.352763:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.352778:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867611c0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbc9 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.352795:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.352797:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.352804:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867611c0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbc9 expref: 22 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.352886:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867611c0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbc9 expref: 22 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.352896:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace45200, rc 0) 00000100:00100000:0.0:1746126605.352922:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721175040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 172us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.352929:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12802 00000100:00100000:0.0:1746126605.352973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.352983:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175168 00000100:00100000:0.0:1746126605.352985:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175168 00000100:00100000:0.0:1746126605.352998:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12803 00000100:00100000:0.0:1746126605.353002:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721175168:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.353009:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.353018:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ace44c00/0xb50e825867611c14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbd0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.353029:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.353030:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.353034:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44c00/0xb50e825867611c14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd0 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.353042:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ace44c00/0xb50e825867611c14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd0 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.353049:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44c00, rc 0) 00000100:00100000:0.0:1746126605.353065:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721175168:12345-192.168.203.2@tcp:101:cat.0 Request processed in 61us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.353069:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12803 00000100:00100000:0.0:1746126605.360930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.360972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.360989:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175424 00000100:00100000:0.0:1746126605.360989:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175680 00000100:00100000:1.0:1746126605.360997:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175424 00000100:00100000:0.0:1746126605.360997:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175680 00000100:00100000:1.0:1746126605.361038:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12804 00000100:00100000:1.0:1746126605.361046:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721175424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.361063:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.361080:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013489f400/0xb50e825867611c1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbde expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.361104:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.361106:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.361115:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013489f400/0xb50e825867611c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbde expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126605.361121:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12805 00000100:00100000:0.0:1746126605.361129:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721175680:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.361130:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013489f400/0xb50e825867611c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbde expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.361147:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.361150:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013489f400, rc 0) 00010000:00010000:0.0:1746126605.361159:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ace44800/0xb50e825867611c22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbec expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.361173:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.361174:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.361179:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44800/0xb50e825867611c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbec expref: 25 pid: 4640 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126605.361182:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721175424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 138us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.361188:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12804 00010000:00010000:0.0:1746126605.361190:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ace44800/0xb50e825867611c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbec expref: 25 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.361197:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44800, rc 0) 00000100:00100000:0.0:1746126605.361222:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721175680:12345-192.168.203.2@tcp:101:cat.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.361227:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12805 00000100:00100000:1.0:1746126605.361238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.361260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.361265:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175296 00000100:00100000:0.0:1746126605.361268:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175296 00000100:00100000:0.0:1746126605.361285:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175552 00000100:00100000:0.0:1746126605.361287:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175552 00000100:00100000:1.0:1746126605.361297:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12806 00000100:00100000:1.0:1746126605.361303:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721175296:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126605.361307:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12807 00000100:00100000:0.0:1746126605.361311:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721175552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.361313:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.361317:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.361319:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbd7 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.361325:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace44200/0xb50e825867611c30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbe5 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.361330:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.361331:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.361334:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.361335:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd7 expref: 26 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.361336:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.361340:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace44200/0xb50e825867611c30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbe5 expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.361344:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd7 expref: 26 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.361349:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace44200/0xb50e825867611c30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbe5 expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.361350:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013489e600, rc 0) 00010000:00010000:0.0:1746126605.361355:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44200, rc 0) 00000100:00100000:1.0:1746126605.361365:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721175296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 62us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.361370:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12806 00000100:00100000:0.0:1746126605.361370:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721175552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 58us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.361374:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12807 00000100:00100000:1.0:1746126605.361404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.361938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.361960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.361975:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175808 00000100:00100000:1.0:1746126605.361978:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175808 00010000:00010000:1.0:1746126605.361997:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d2ea00/0xb50e825867611bea lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbad expref: 227 pid: 20362 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.362013:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721175936 00000100:00100000:1.0:1746126605.362015:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721175936 00010000:00010000:1.0:1746126605.362024:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e3200/0xb50e825867611bf8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbbb expref: 11 pid: 15560 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.362039:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721176064 00000100:00100000:1.0:1746126605.362052:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721176064 00010000:00010000:1.0:1746126605.362062:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a3e800/0xb50e825867611acb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb36 expref: 9 pid: 14548 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.362075:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6677 00000100:00100000:1.0:1746126605.362080:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:1964:x1830945721175808:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.362090:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.362095:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d2ea00/0xb50e825867611bea lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbad expref: 227 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.362102:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d2ea00/0xb50e825867611bea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbad expref: 227 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.362120:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.362125:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362132:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362146:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.362164:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:1964:x1830945721175808:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.362169:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6677 00000100:00100000:1.0:1746126605.362179:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6679 00000100:00100000:1.0:1746126605.362183:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721176064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.362191:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.362194:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a3e800/0xb50e825867611acb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb36 expref: 9 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.362202:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a3e800/0xb50e825867611acb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb36 expref: 9 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.362209:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.362217:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362222:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362227:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362242:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.362254:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721176064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.362258:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6679 00000100:00100000:1.0:1746126605.362318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.362338:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721176192 00000100:00100000:1.0:1746126605.362341:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721176192 00000100:00100000:1.0:1746126605.362373:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8777 00000100:00100000:1.0:1746126605.362378:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:30961:x1830945721176192:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126605.362392:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.362400:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbf3 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.362445:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362451:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.362462:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1c00/0xb50e825867611c06 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126605.362470:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.362479:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.362482:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126605.362485:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.362491:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a65000, rc 0) 00000100:00100000:1.0:1746126605.362506:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:30961:x1830945721176192:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 128us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.362510:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8777 00000100:00100000:1.0:1746126605.364529:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.364547:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721176320 00000100:00100000:1.0:1746126605.364552:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721176320 00000100:00100000:1.0:1746126605.364580:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8778 00000100:00100000:1.0:1746126605.364586:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:30964:x1830945721176320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.364602:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.364616:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64a00/0xb50e825867611c3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cbfa expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.364660:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64a00/0xb50e825867611c3e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbfa expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.364668:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64a00/0xb50e825867611c3e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbfa expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.364678:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.364681:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126605.364684:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.364689:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a64a00, rc 0) 00000100:00100000:1.0:1746126605.364717:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+227:30964:x1830945721176320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 131us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.364721:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8778 00000100:00100000:1.0:1746126605.375193:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721174784:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21247us (25826us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126605.375205:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7357 00002000:00100000:1.0:1746126605.375218:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e9d7b80 x1830945721174784/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/440 e 0 to 0 dl 1746126616 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.375227:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7b80 with x1830945721174784 ext(1048576->2097151) 00002000:00010000:1.0:1746126605.375233:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d7b80 00000001:00080000:1.0:1746126605.403242:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942924 is committed 00000004:00080000:1.0:1746126605.403258:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1932 committed 00000004:00080000:1.0:1746126605.403269:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2032 committed 00000004:00080000:1.0:1746126605.403275:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2031 committed 00000004:00080000:1.0:1746126605.403277:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1931 committed 00000004:00080000:1.0:1746126605.403278:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746126605.403280:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1930 committed 00000004:00080000:1.0:1746126605.403281:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746126605.403283:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1929 committed 00000004:00080000:1.0:1746126605.403284:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746126605.403285:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1928 committed 00000004:00080000:1.0:1746126605.403287:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746126605.403289:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746126605.403292:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1927 committed 00000004:00080000:1.0:1746126605.403293:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1926 committed 00000004:00080000:1.0:1746126605.403294:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2025 committed 00000004:00080000:1.0:1746126605.403295:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2024 committed 00000004:00080000:1.0:1746126605.403297:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1925 committed 00000001:00080000:1.0:1746126605.403302:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942923 is committed 00000001:00080000:1.0:1746126605.403311:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942917 is committed 00000100:00100000:1.0:1746126605.403518:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721259264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.403554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.403571:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721259904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.403583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.403593:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721260416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.403606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.403617:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721261056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.403629:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.403644:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746126605.403648:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721259520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.403917:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721259264 00000100:00100000:0.0:1746126605.403925:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721259264 00000100:00100000:0.0:1746126605.403972:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721259904 00000100:00100000:0.0:1746126605.403975:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721259904 00000100:00100000:0.0:1746126605.403987:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721260416 00000100:00100000:0.0:1746126605.403988:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721260416 00000100:00100000:0.0:1746126605.403998:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721261056 00000100:00100000:0.0:1746126605.403999:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721261056 00000100:00100000:0.0:1746126605.404011:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12808 00000100:00100000:0.0:1746126605.404017:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3294:x1830945721259264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126605.404205:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746126605.404209:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126601 -> 1746126601 00002000:00010000:0.0:1746126605.404211:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126601 -> 1746126601 00002000:00010000:0.0:1746126605.404212:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126601 -> 1746126601 00002000:00010000:0.0:1746126605.404214:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:0.0:1746126605.404247:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721259264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (692us total) trans 21474840205 rc 0/0 00000100:00100000:0.0:1746126605.404253:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12808 00000100:00100000:0.0:1746126605.404268:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12809 00000100:00100000:0.0:1746126605.404272:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3294:x1830945721259904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.404356:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721259904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (771us total) trans 21474840206 rc 0/0 00000100:00100000:0.0:1746126605.404361:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12809 00000100:00100000:0.0:1746126605.404370:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12810 00000100:00100000:0.0:1746126605.404375:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721260416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126605.404473:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126605.404476:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126605.404478:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126601 -> 1746126601 00002000:00010000:0.0:1746126605.404480:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126605.404482:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126605.404507:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3294:x1830945721260416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (899us total) trans 17179873041 rc 0/0 00000100:00100000:0.0:1746126605.404512:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12810 00000100:00100000:0.0:1746126605.404521:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12811 00000100:00100000:0.0:1746126605.404525:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721261056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126605.404592:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126605.404594:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126605.404596:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126605.404598:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126605.404599:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126605.404616:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3294:x1830945721261056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (986us total) trans 17179873042 rc 0/0 00000100:00100000:0.0:1746126605.404621:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12811 00000100:00100000:1.0:1746126605.404778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.404796:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721260032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.404814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.404962:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721260672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.404979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405436:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721261184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.405453:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126605.405479:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093231f80/2, rc 0, transno 21474840205 00000100:00100000:1.0:1746126605.405484:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721259264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.405492:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093233480/2, rc 0, transno 21474840206 00000100:00100000:1.0:1746126605.405494:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721259904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.405500:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fd500/2, rc 0, transno 17179873041 00000100:00100000:1.0:1746126605.405506:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721260416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.405511:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ff480/2, rc 0, transno 17179873042 00000100:00100000:1.0:1746126605.405514:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721261056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.405526:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721259648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.405543:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405555:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.405568:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405575:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.405587:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405593:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721261312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.405606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405617:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746126605.405620:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721259776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.405633:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405640:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.405651:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405657:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.405667:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405673:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721261440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.405685:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.405704:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721261440 00000100:00100000:1.0:1746126605.405707:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721261440 00000100:00100000:1.0:1746126605.405720:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12814 00000100:00100000:1.0:1746126605.405724:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721260672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126605.405801:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126605.405803:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126602 -> 1746126602 00002000:00010000:1.0:1746126605.405805:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126602 -> 1746126602 00002000:00010000:1.0:1746126605.405807:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126602 -> 1746126602 00002000:00010000:1.0:1746126605.405809:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126605.405842:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3294:x1830945721260672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (846us total) trans 17179873043 rc 0/0 00000100:00100000:1.0:1746126605.405847:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12814 00000100:00100000:1.0:1746126605.405860:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12816 00000100:00100000:1.0:1746126605.405864:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721259648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126605.405932:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126605.405935:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.405936:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.405938:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.405940:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746126605.405953:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3296:x1830945721259648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (410us total) trans 21474840209 rc 0/0 00000100:00100000:1.0:1746126605.405960:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12816 00000100:00100000:1.0:1746126605.405968:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12819 00000100:00100000:1.0:1746126605.405971:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830945721261312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.406044:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830945721261312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (437us total) trans 17179873045 rc 0/0 00000100:00100000:1.0:1746126605.406049:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12819 00000100:00100000:1.0:1746126605.406059:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12821 00000100:00100000:1.0:1746126605.406063:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721260288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.406064:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12822 00000100:00100000:0.0:1746126605.406071:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3296:x1830945721260928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.406132:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721260288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (480us total) trans 21474840212 rc 0/0 00000100:00100000:1.0:1746126605.406150:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12821 00000100:00100000:0.0:1746126605.406199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000004:00080000:1.0:1746126605.406200:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093232a00/2, rc 0, transno 21474840211 00000100:00100000:1.0:1746126605.406203:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721259776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.406209:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093230000/2, rc 0, transno 21474840212 00000100:00100000:1.0:1746126605.406211:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.406215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000004:00080000:1.0:1746126605.406217:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fc380/2, rc 0, transno 17179873046 00000100:00100000:1.0:1746126605.406219:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721261440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.406224:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093232680/2, rc 0, transno 21474840209 00000100:00100000:1.0:1746126605.406227:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721259648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.406232:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093230a80/2, rc 0, transno 21474840210 00000100:00100000:1.0:1746126605.406234:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.406239:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fce00/2, rc 0, transno 17179873045 00000100:00100000:1.0:1746126605.406240:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721261312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126605.406269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.406285:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721176448 00000100:00100000:0.0:1746126605.406483:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721176448 00000100:00100000:0.0:1746126605.406504:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3672 00000100:00100000:0.0:1746126605.406509:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30961:x1830945721176448:12345-192.168.203.2@tcp:49:multiop.0 00000100:00100000:0.0:1746126605.406551:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30961:x1830945721176448:12345-192.168.203.2@tcp:49:multiop.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.406556:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3672 00000100:00100000:0.0:1746126605.406641:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3296:x1830945721260928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 570us (971us total) trans 17179873047 rc 0/0 00000100:00100000:0.0:1746126605.406647:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12822 00000004:00080000:1.0:1746126605.406683:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ff100/2, rc 0, transno 17179873047 00000100:00100000:1.0:1746126605.406687:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126605.407079:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721261568 00000100:00100000:0.0:1746126605.407082:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721261568 00000100:00100000:0.0:1746126605.407110:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12824 00000100:00100000:0.0:1746126605.407114:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3295:x1830945721261568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126605.407218:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3295:x1830945721261568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (304us total) trans 17179873048 rc 0/0 00000100:00100000:0.0:1746126605.407223:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12824 00000004:00080000:1.0:1746126605.408462:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fed80/2, rc 0, transno 17179873049 00000100:00100000:1.0:1746126605.408466:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721260800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126605.410617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.410709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.410979:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721176960 00000100:00100000:1.0:1746126605.410983:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721176960 00000100:00100000:1.0:1746126605.411020:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 667 00000100:00100000:1.0:1746126605.411025:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721176960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.411038:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.411120:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fa00/0xb50e825867611c45 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc01 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.411564:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.411569:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.411590:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721176960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 565us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.411596:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 667 00000100:00100000:0.0:1746126605.415228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.419659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.419688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.419718:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721177344 00000100:00100000:1.0:1746126605.419727:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721177344 00010000:00010000:1.0:1746126605.419759:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd7 expref: 28 pid: 9686 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.419761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.419781:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721177472 00000100:00100000:0.0:1746126605.419781:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721177216 00000100:00100000:1.0:1746126605.419783:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721177472 00000100:00100000:0.0:1746126605.419783:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721177216 00010000:00010000:1.0:1746126605.419793:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e825867611aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb52 expref: 9 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.419795:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009359a600/0xb50e825867611b88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb8a expref: 14 pid: 10890 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.419807:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6680 00000100:00100000:1.0:1746126605.419814:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721177344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126605.419823:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6681 00000100:00100000:0.0:1746126605.419852:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721177472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.419860:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.419884:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e825867611aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb52 expref: 9 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.419894:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e825867611aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb52 expref: 9 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.419920:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.419955:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721177472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.419961:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6681 00000100:00100000:0.0:1746126605.419977:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6682 00000100:00100000:0.0:1746126605.419982:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721177216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.419989:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.419997:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009359a600/0xb50e825867611b88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb8a expref: 14 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.420004:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009359a600/0xb50e825867611b88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb8a expref: 14 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.420015:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.420029:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721177216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 47us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.420034:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6682 00010000:00010000:1.0:1746126605.420235:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.420244:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd7 expref: 28 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.420252:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd7 expref: 28 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.420264:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611c29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbd7 expref: 28 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.420272:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.420274:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.420279:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.420287:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 26 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.420959:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 26 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.420972:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721262080:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126605.421162:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.421381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.421722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.422408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.424177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.424182:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721262080:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126605.424200:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.424206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.424224:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721177344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4411us (4574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.424233:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6680 00000100:00100000:1.0:1746126605.424259:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721178624 00000100:00100000:1.0:1746126605.424262:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721178624 00002000:00100000:1.0:1746126605.424276:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008e3ab480 x1830945721178624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.424283:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3ab480 with x1830945721178624 ext(1048576->2097151) 00010000:00010000:1.0:1746126605.424289:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 15 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.424297:0:21459:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 15 pid: 8438 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746126605.424304:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3ab480 00000100:00100000:1.0:1746126605.424317:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1668 00000100:00100000:1.0:1746126605.424321:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721178624:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126605.431701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.431794:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721178752 00000100:00100000:1.0:1746126605.431801:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721178752 00010000:00010000:1.0:1746126605.431845:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3f000/0xb50e825867611ae7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb4b expref: 8 pid: 10890 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.431865:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6683 00000100:00100000:1.0:1746126605.431871:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721178752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.431883:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.431901:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3f000/0xb50e825867611ae7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb4b expref: 8 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.431910:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3f000/0xb50e825867611ae7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb4b expref: 8 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.431929:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3f000/0xb50e825867611ae7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb4b expref: 8 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.431938:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.431958:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721178752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.431963:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6683 00000100:00100000:0.0:1746126605.445405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.446776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.447192:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721178624:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22868us (22983us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126605.447202:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1668 00002000:00100000:1.0:1746126605.447213:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008e3ab480 x1830945721178624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/440 e 0 to 0 dl 1746126616 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.447221:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3ab480 with x1830945721178624 ext(1048576->2097151) 00010000:00010000:1.0:1746126605.447228:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 14 pid: 8438 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.447247:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 14 pid: 8438 timeout: 827 lvb_type: 1 00002000:00010000:1.0:1746126605.447258:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3ab480 00000100:00100000:0.0:1746126605.449954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.449985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.451075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.452028:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721179392 00000100:00100000:1.0:1746126605.452035:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721179392 00010000:00010000:1.0:1746126605.452059:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a592ce00/0xb50e825867611af5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb59 expref: 8 pid: 20294 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.452077:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6687 00000100:00100000:1.0:1746126605.452083:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721179392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.452090:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.452104:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a592ce00/0xb50e825867611af5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb59 expref: 8 pid: 20294 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.452112:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a592ce00/0xb50e825867611af5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb59 expref: 8 pid: 20294 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.452128:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a592ce00/0xb50e825867611af5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb59 expref: 8 pid: 20294 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.452151:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.452153:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.452159:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.452167:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.452199:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.452210:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721262976:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126605.453000:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.453396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.453496:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721179648 00000100:00100000:1.0:1746126605.453500:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721179648 00002000:00100000:1.0:1746126605.453535:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2007039) req@ffff88008e3a9f80 x1830945721179648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.453544:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9f80 with x1830945721179648 ext(1048576->2007039) 00002000:00010000:1.0:1746126605.453548:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9f80 00000100:00100000:1.0:1746126605.453575:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7362 00000100:00100000:1.0:1746126605.453581:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721179648:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126605.458128:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721262976:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126605.458162:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.458536:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721179392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6450us (7459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.458546:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6687 00000100:00100000:0.0:1746126605.471568:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721179648:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17983us (18169us total) trans 0 rc 958464/958464 00000100:00100000:0.0:1746126605.471576:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7362 00002000:00100000:0.0:1746126605.471584:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2007039) req@ffff88008e3a9f80 x1830945721179648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/440 e 0 to 0 dl 1746126616 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.471592:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9f80 with x1830945721179648 ext(1048576->2007039) 00002000:00010000:0.0:1746126605.471596:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9f80 00000100:00100000:0.0:1746126605.471647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.472789:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721180288 00000100:00100000:1.0:1746126605.472795:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721180288 00000100:00100000:1.0:1746126605.472846:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12828 00000100:00100000:1.0:1746126605.472854:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+14:30962:x1830945721179776:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.472869:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.472887:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc1d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.472912:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.472919:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126605.472921:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126605.472925:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.472955:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.472966:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 25 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.472977:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721263104:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.473047:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.473065:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721179904 00000100:00100000:1.0:1746126605.473068:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721179904 00010000:00010000:1.0:1746126605.473085:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 16 pid: 8438 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.473104:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6688 00000100:00100000:1.0:1746126605.473108:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721179904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.473117:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.473150:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 16 pid: 8438 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.473160:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 16 pid: 8438 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.473177:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867611bab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb83 expref: 16 pid: 8438 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.473191:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.473193:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.473198:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.473205:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.473225:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.473234:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721263232:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126605.473369:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.473393:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12829 00000100:00100000:0.0:1746126605.473401:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+25:30964:x1830945721180288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.473408:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.473416:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc24 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.473429:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.473434:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126605.473435:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126605.473437:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.473451:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.473458:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 15 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.473465:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721263360:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126605.473485:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.477806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.477824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.477880:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721263104:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.477909:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.477926:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2800, rc 0) 00000100:00100000:1.0:1746126605.477969:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:30962:x1830945721179776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5116us (10263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.477980:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12828 00000100:00100000:0.0:1746126605.479037:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721180416 00000100:00100000:0.0:1746126605.479045:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721180416 00002000:00100000:0.0:1746126605.479080:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (2007040->2097151) req@ffff88008e3aa680 x1830945721180416/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.479095:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aa680 with x1830945721180416 ext(2007040->2097151) 00010000:00010000:0.0:1746126605.479103:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 27 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.479113:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 27 pid: 23766 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746126605.479119:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3aa680 00000100:00100000:0.0:1746126605.479144:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721180672 00000100:00100000:0.0:1746126605.479146:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721180672 00002000:00100000:0.0:1746126605.479158:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1286144->1290239) req@ffff88008e3a8700 x1830945721180672/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.479164:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8700 with x1830945721180672 ext(1286144->1290239) 00010000:00010000:0.0:1746126605.479169:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 14 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.479176:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 14 pid: 23766 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746126605.479181:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3a8700 00000100:00100000:0.0:1746126605.479200:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1669 00000100:00100000:0.0:1746126605.479207:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721180416:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126605.479422:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1670 00000100:00100000:0.0:1746126605.479428:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721180672:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126605.479558:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721180672:12345-192.168.203.2@tcp:3:cat.0 Request processed in 130us (1732us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126605.479565:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1670 00002000:00100000:0.0:1746126605.479570:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1286144->1290239) req@ffff88008e3a8700 x1830945721180672/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/4536 e 0 to 0 dl 1746126616 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.479577:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8700 with x1830945721180672 ext(1286144->1290239) 00010000:00010000:0.0:1746126605.479582:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 14 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.479589:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 14 pid: 23766 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746126605.479594:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3a8700 00000100:00100000:1.0:1746126605.479682:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721263360:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.479702:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.479712:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b493c00, rc 0) 00000100:00100000:1.0:1746126605.479733:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:30964:x1830945721180288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6333us (8085us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.479739:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12829 00000100:00100000:0.0:1746126605.490293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.490339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.493123:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721181312 00000100:00100000:0.0:1746126605.493129:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721181312 00010000:00010000:0.0:1746126605.493163:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 28 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.493198:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6689 00000100:00100000:0.0:1746126605.493204:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721181312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.493217:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126605.493234:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126602 -> 1746126605 00002000:00010000:0.0:1746126605.493237:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126602 -> 1746126605 00010000:00010000:0.0:1746126605.493243:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 28 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.493253:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 28 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.493276:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611c4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc08 expref: 28 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.493304:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.493306:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.493313:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 13 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.493322:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 13 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.493353:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 13 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.493365:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721263488:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126605.493425:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.503799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.503867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.503909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.503999:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1672 00000100:00100000:1.0:1746126605.504008:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721181568:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126605.515893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.517469:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721181568:12345-192.168.203.2@tcp:4:cat.0 Request processed in 13461us (13557us total) trans 17179873051 rc 0/0 00000100:00100000:1.0:1746126605.517478:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1672 00002000:00100000:1.0:1746126605.517484:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1286144->1634303) req@ffff8800a5957100 x1830945721181568/t17179873051(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/448 e 0 to 0 dl 1746126616 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.517492:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5957100 with x1830945721181568 ext(1286144->1634303) 00010000:00010000:1.0:1746126605.517498:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 16 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.517511:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f16fc00/0xb50e825867611c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc0f expref: 16 pid: 23766 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746126605.517518:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5957100 00000100:00100000:0.0:1746126605.520326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.523632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.523664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.523682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.523738:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.523760:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721182464 00000100:00100000:0.0:1746126605.523767:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721182464 00000100:00100000:0.0:1746126605.523802:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721182592 00000100:00100000:0.0:1746126605.523805:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721182592 00000100:00100000:0.0:1746126605.523816:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721182720 00000100:00100000:0.0:1746126605.523818:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721182720 00000100:00100000:0.0:1746126605.523844:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721182848 00000100:00100000:0.0:1746126605.523846:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721182848 00000100:00100000:0.0:1746126605.523863:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12830 00000100:00100000:0.0:1746126605.523870:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:30962:x1830945721182464:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.523887:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.523905:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc32 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.523932:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.523940:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126605.523941:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126605.523945:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 14 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.523974:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.523986:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 23 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.523997:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721263744:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126605.524042:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.524060:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12831 00000100:00100000:0.0:1746126605.524066:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721182592:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126605.524073:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.524084:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e825867611c92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc39 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.524097:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.524099:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.524106:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e825867611c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc39 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.524119:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e825867611c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc39 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.524129:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e664400, rc 0) 00000100:00100000:0.0:1746126605.524164:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721182592:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 98us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.524170:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12831 00000100:00100000:0.0:1746126605.524186:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12832 00000100:00100000:0.0:1746126605.524191:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721182720:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126605.524197:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.524203:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc40 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.524213:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.524214:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.524218:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.524227:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.524234:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099f8f600, rc 0) 00000100:00100000:0.0:1746126605.524249:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721182720:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 59us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.524254:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12832 00000100:00100000:0.0:1746126605.524265:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12833 00000100:00100000:0.0:1746126605.524269:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721182848:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126605.524275:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.524280:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb55800/0xb50e825867611ca0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc47 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.524303:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721263872:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126605.524324:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.530910:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721263744:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.530940:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 14 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.530955:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cd400, rc 0) 00000100:00100000:1.0:1746126605.530978:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:30962:x1830945721182464:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7108us (7351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.530984:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12830 00000100:00100000:1.0:1746126605.532748:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721182976 00000100:00100000:1.0:1746126605.532755:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721182976 00002000:00100000:1.0:1746126605.532796:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1265663) req@ffff8800918eb100 x1830945721182976/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.532805:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eb100 with x1830945721182976 ext(1048576->1265663) 00000100:00100000:0.0:1746126605.533427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126605.533487:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 24 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.533503:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 24 pid: 23766 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746126605.533509:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eb100 00000100:00100000:1.0:1746126605.533522:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1673 00000100:00100000:1.0:1746126605.533527:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721182976:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126605.539468:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721182976:12345-192.168.203.2@tcp:4:cat.0 Request processed in 5929us (6938us total) trans 21474840213 rc 0/0 00000100:00100000:1.0:1746126605.539480:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1673 00002000:00100000:1.0:1746126605.539491:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1265663) req@ffff8800918eb100 x1830945721182976/t21474840213(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/448 e 0 to 0 dl 1746126616 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.539500:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eb100 with x1830945721182976 ext(1048576->1265663) 00010000:00010000:1.0:1746126605.539510:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 26 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.539522:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 26 pid: 23766 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746126605.539528:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eb100 00000100:00100000:0.0:1746126605.546578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.546648:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721183744 00000100:00100000:1.0:1746126605.546658:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721183744 00010000:00010000:1.0:1746126605.546696:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 26 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.547198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.547332:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6692 00000100:00100000:1.0:1746126605.547342:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721183744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.547356:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.547381:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 26 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.547394:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 26 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.547416:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed55c00/0xb50e825867611c5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc16 expref: 26 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.548046:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.548049:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.548057:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.548066:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.548100:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.548112:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721264128:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126605.548191:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.549221:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1965:x1830945721183232:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16171us (16635us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126605.549232:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7365 00002000:00100000:0.0:1746126605.549239:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800918ea300 x1830945721183232/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/440 e 0 to 0 dl 1746126616 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.549247:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ea300 with x1830945721183232 ext(1048576->2097151) 00002000:00010000:0.0:1746126605.549252:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ea300 00000100:00100000:0.0:1746126605.556740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.557432:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721264128:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126605.557451:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.557494:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721183744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10153us (10925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.557502:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6692 00000100:00100000:0.0:1746126605.559039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.559400:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721184384 00000100:00100000:1.0:1746126605.559408:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721184384 00002000:00100000:1.0:1746126605.559444:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5954000 x1830945721184384/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.559455:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954000 with x1830945721184384 ext(1048576->2097151) 00002000:00010000:1.0:1746126605.559460:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5954000 00000100:00100000:1.0:1746126605.559925:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7366 00000100:00100000:1.0:1746126605.559933:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721184384:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126605.561666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.562900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.564388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.564438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.564458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.564473:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185152 00000100:00100000:1.0:1746126605.564476:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185152 00000100:00100000:1.0:1746126605.565162:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12837 00000100:00100000:1.0:1746126605.565169:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721184896:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126605.565199:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.565214:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 14 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.565222:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009341f400/0xb50e825867611cd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc63 expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.565228:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.565234:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.565236:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.565238:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.565266:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.565283:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 10 pid: 9686 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.565296:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721264256:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126605.565311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126605.565356:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009341f400/0xb50e825867611cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc63 expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.565363:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009341f400/0xb50e825867611cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc63 expref: 27 pid: 10890 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.565371:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721264384:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.568206:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 14 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.568220:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 14 pid: 4642 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.568231:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721264768:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.568257:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746126605.568286:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.568294:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 27 pid: 17475 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.568307:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721264896:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.568322:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.568372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.568389:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185280 00000100:00100000:1.0:1746126605.568392:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185280 00000100:00100000:1.0:1746126605.568412:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12839 00000100:00100000:1.0:1746126605.568417:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721185024:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126605.568435:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.568444:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 15 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.568449:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.568450:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.568452:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.568467:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 15 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.568474:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 15 pid: 10890 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.568481:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721265408:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.568499:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.574711:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721264256:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.574725:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721264384:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126605.575355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.575408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.575427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.575450:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185664 00000100:00100000:0.0:1746126605.575456:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185664 00010000:00010000:0.0:1746126605.575490:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 15 pid: 4642 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.575514:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185408 00000100:00100000:0.0:1746126605.575516:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185408 00010000:00010000:0.0:1746126605.575526:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 12 pid: 9686 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.575529:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721185792 00000100:00100000:1.0:1746126605.575533:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721185792 00000100:00100000:0.0:1746126605.575542:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6693 00000100:00100000:0.0:1746126605.575549:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721185664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.575551:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a592c800/0xb50e825867611b96 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb98 expref: 16 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.575562:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126605.575572:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6694 00000100:00100000:1.0:1746126605.575577:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721185408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.575585:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.575586:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 15 pid: 4642 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.575593:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 12 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.575595:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 15 pid: 4642 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.575605:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 12 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.575632:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.575676:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721185664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 126us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.575682:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6693 00000100:00100000:0.0:1746126605.575719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126605.575728:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f8f600/0xb50e825867611c99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc40 expref: 12 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.575750:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.575769:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721185408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 191us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.575774:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6694 00000100:00100000:1.0:1746126605.575786:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6696 00000100:00100000:1.0:1746126605.575790:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721185536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.575798:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.575808:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e825867611c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc39 expref: 11 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.575816:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e825867611c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc39 expref: 11 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.575851:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e825867611c92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc39 expref: 11 pid: 9686 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.575860:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.575876:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721185536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 86us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.575882:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6696 00010000:00010000:1.0:1746126605.575906:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2800/0xb50e825867611c61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc1d expref: 14 pid: 4642 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.575918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.575919:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721264768:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126605.575930:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186048 00000100:00100000:0.0:1746126605.575933:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186048 00010000:00010000:1.0:1746126605.575938:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.575945:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 28 pid: 17475 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.575960:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6697 00000100:00100000:0.0:1746126605.575965:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721186048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.575971:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.575983:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 28 pid: 17475 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.575991:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 28 pid: 17475 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.576002:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b493c00/0xb50e825867611c68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc24 expref: 28 pid: 17475 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.576009:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721265408:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126605.576018:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.576019:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.576020:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.576024:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.576032:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.576048:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.576946:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721186048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 979us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.576950:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721184384:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17016us (17915us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126605.576951:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6697 00000100:00100000:1.0:1746126605.576959:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7366 00002000:00100000:1.0:1746126605.576965:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5954000 x1830945721184384/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/440 e 0 to 0 dl 1746126616 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746126605.576967:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746126605.576973:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954000 with x1830945721184384 ext(1048576->2097151) 00010000:00010000:0.0:1746126605.576973:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.576978:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 13 pid: 10890 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.576986:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd400/0xb50e825867611c8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc32 expref: 13 pid: 10890 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.576991:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126605.576992:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5954000 00010000:00010000:0.0:1746126605.576998:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.577004:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.577014:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f16f200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126605.577017:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.577024:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.577032:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.577036:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867611ced lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.577067:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721184768:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 12576us (12682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.577073:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12836 00000100:00100000:0.0:1746126605.580355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.580391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.580451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.580486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.580497:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186560 00000100:00100000:0.0:1746126605.580500:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186560 00010000:00010000:0.0:1746126605.580523:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013489e000/0xb50e825867611bb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb9f expref: 14 pid: 17475 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.580541:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186432 00000100:00100000:0.0:1746126605.580544:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186432 00010000:00010000:0.0:1746126605.580551:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed55400/0xb50e825867611afc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb60 expref: 10 pid: 20294 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.580560:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186816 00000100:00100000:0.0:1746126605.580562:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186816 00010000:00010000:0.0:1746126605.580568:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3ec00/0xb50e825867611ae0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb44 expref: 11 pid: 10890 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.580574:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186944 00000100:00100000:0.0:1746126605.580575:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186944 00010000:00010000:0.0:1746126605.580581:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44800/0xb50e825867611c22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbec expref: 29 pid: 4640 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.580589:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6699 00000100:00100000:0.0:1746126605.580593:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721186304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.580599:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.580609:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ace44200/0xb50e825867611c30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbe5 expref: 25 pid: 4640 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.580615:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ace44200/0xb50e825867611c30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbe5 expref: 25 pid: 4640 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.580692:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6701 00000100:00100000:1.0:1746126605.580697:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721186816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.580703:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.580716:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3ec00/0xb50e825867611ae0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb44 expref: 11 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.580724:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3ec00/0xb50e825867611ae0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb44 expref: 11 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746126605.580988:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3ec00/0xb50e825867611ae0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb44 expref: 11 pid: 10890 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.581097:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ace44200/0xb50e825867611c30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbe5 expref: 25 pid: 4640 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.581118:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.581140:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721186304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 539us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.581147:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6699 00000100:00100000:0.0:1746126605.581224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.581233:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187072 00000100:00100000:0.0:1746126605.581235:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187072 00010000:00010000:0.0:1746126605.581245:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a592de00/0xb50e825867611b03 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb67 expref: 9 pid: 20294 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.581257:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6703 00000100:00100000:0.0:1746126605.581261:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721187072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.581265:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.581272:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a592de00/0xb50e825867611b03 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb67 expref: 9 pid: 20294 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.581279:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a592de00/0xb50e825867611b03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb67 expref: 9 pid: 20294 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.581288:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.581289:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.581292:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009359a600/0xb50e825867611d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.581298:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009359a600/0xb50e825867611d02 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.581307:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.581318:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721187072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 56us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.581325:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6703 00000100:00100000:0.0:1746126605.581352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.581360:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721186688 00000100:00100000:0.0:1746126605.581362:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721186688 00010000:00010000:0.0:1746126605.581371:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009379a600/0xb50e825867611b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb7c expref: 13 pid: 4641 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746126605.581381:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6704 00000100:00100000:0.0:1746126605.581385:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721186688:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.581390:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.582369:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.582389:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721186816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1691us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.582396:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6701 00010000:00010000:0.0:1746126605.583181:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009379a600/0xb50e825867611b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb7c expref: 13 pid: 4641 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.583193:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009379a600/0xb50e825867611b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb7c expref: 13 pid: 4641 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.583207:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379a600/0xb50e825867611b8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cb7c expref: 13 pid: 4641 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.583341:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.583343:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.583347:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009341f000/0xb50e825867611cdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.583355:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009341f000/0xb50e825867611cdf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.583380:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.583404:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721186688:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2017us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.583410:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6704 00000100:00100000:0.0:1746126605.583480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.583520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.583531:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187968 00000100:00100000:1.0:1746126605.583535:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187968 00000100:00100000:0.0:1746126605.583541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.583555:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187328 00000100:00100000:1.0:1746126605.583558:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187584 00000100:00100000:0.0:1746126605.583558:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187328 00000100:00100000:1.0:1746126605.583560:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187584 00000100:00100000:1.0:1746126605.583571:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12842 00000100:00100000:1.0:1746126605.583576:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721187712:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126605.583582:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12843 00000100:00100000:0.0:1746126605.583587:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721187968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.583592:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.583595:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.583605:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009379a400/0xb50e825867611d09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc7f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.583606:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b492e00/0xb50e825867611d10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc8d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.583619:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746126605.583621:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c70b, atime: 0x6813c70b, ctime: 0x6813c70b, blocks: 0x1029 00010000:00010000:1.0:1746126605.583625:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009379a400/0xb50e825867611d09 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc7f expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.583630:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.583631:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.583634:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379a400/0xb50e825867611d09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc7f expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.583636:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b492e00/0xb50e825867611d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc8d expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.583641:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009379a400, rc 0) 00010000:00010000:0.0:1746126605.583647:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b492e00/0xb50e825867611d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc8d expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.583654:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b492e00, rc 0) 00000100:00100000:1.0:1746126605.583657:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721187712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 82us (400us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126605.583663:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12842 00000100:00100000:0.0:1746126605.583671:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721187968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.583959:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12845 00000100:00100000:1.0:1746126605.583964:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721187328:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126605.583965:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12843 00010000:00010000:1.0:1746126605.583969:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.583974:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611d1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc6a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.583997:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611d1e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc6a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.584004:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611d1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc6a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126605.584008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126605.584010:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009379aa00, rc 0) 00000100:00100000:1.0:1746126605.584019:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721187328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 55us (499us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126605.584019:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721187840 00000100:00100000:0.0:1746126605.584022:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721187840 00000100:00100000:1.0:1746126605.584025:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12845 00000100:00100000:0.0:1746126605.584047:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12846 00000100:00100000:0.0:1746126605.584051:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721187840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.584057:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.584065:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b492800/0xb50e825867611d2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc86 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126605.584075:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c70b, atime: 0x6813c70b, ctime: 0x6813c70b, blocks: 0x1641 00010000:00010000:0.0:1746126605.584081:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.584082:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.584086:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b492800/0xb50e825867611d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc86 expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.584093:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b492800/0xb50e825867611d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc86 expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126605.584099:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b492800, rc 0) 00000100:00100000:0.0:1746126605.584110:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721187840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 59us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.584114:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12846 00000100:00100000:0.0:1746126605.590097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126605.590875:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590886:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590907:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590914:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590920:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590926:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009379b400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126605.590930:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590937:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590948:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.590953:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611cfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.590991:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1964:x1830945721185024:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 22574us (25680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.590998:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12839 00000100:00100000:1.0:1746126605.594097:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721188224 00000100:00100000:1.0:1746126605.594106:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721188224 00000100:00100000:1.0:1746126605.594169:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12847 00000100:00100000:1.0:1746126605.594177:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:30964:x1830945721188224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.594194:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.594213:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009379a400/0xb50e825867611d33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cc94 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126605.594236:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c70d, atime: 0x6813c70a, ctime: 0x6813c70d, blocks: 0x821 00010000:00010000:1.0:1746126605.594256:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.594258:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.594265:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009379a400/0xb50e825867611d33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc94 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.594284:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009379a400/0xb50e825867611d33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc94 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.594295:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009379a400, rc 0) 00000100:00100000:1.0:1746126605.595253:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:30964:x1830945721188224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1073us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.595260:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12847 00000100:00100000:0.0:1746126605.596061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126605.597726:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597738:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597767:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597775:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597782:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597789:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4b69600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126605.597792:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597804:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597818:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.597823:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b69600/0xb50e825867611ce6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.597942:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721184896:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 32770us (33500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.597950:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12837 00000100:00100000:0.0:1746126605.602468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.602491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.603384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.604936:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721189248 00000100:00100000:0.0:1746126605.604943:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721189248 00000100:00100000:1.0:1746126605.604969:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7367 00002000:00100000:0.0:1746126605.604969:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a448df80 x1830945721189248/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.604976:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448df80 with x1830945721189248 ext(3145728->4194303) 00000100:00100000:1.0:1746126605.604979:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721188736:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:0.0:1746126605.604979:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448df80 00000100:00100000:0.0:1746126605.604998:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7368 00000100:00100000:0.0:1746126605.605002:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721188864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126605.606825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.606874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.622892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.622910:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721190016 00000100:00100000:0.0:1746126605.622916:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721190016 00010000:00010000:0.0:1746126605.622942:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64a00/0xb50e825867611c3e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbfa expref: 224 pid: 14548 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.622961:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6708 00000100:00100000:0.0:1746126605.622966:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:1966:x1830945721190016:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.622978:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.622983:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64a00/0xb50e825867611c3e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbfa expref: 224 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.622992:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a64a00/0xb50e825867611c3e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbfa expref: 224 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.623017:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126605.623021:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.623029:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.623044:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:1966:x1830945721190016:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.623048:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6708 00000100:00100000:0.0:1746126605.623069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.623076:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721190144 00000100:00100000:0.0:1746126605.623078:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721190144 00010000:00010000:0.0:1746126605.623086:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 9 pid: 14548 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126605.623103:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6709 00000100:00100000:0.0:1746126605.623107:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721190144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.623112:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.623115:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 9 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.623121:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a65000/0xb50e825867611c37 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cbf3 expref: 9 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126605.623129:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126605.623131:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.623149:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126605.623161:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721190144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 54us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.623166:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6709 00000100:00100000:1.0:1746126605.629955:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721188736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24963us (27483us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126605.629970:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7367 00002000:00100000:1.0:1746126605.629987:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a448e300 x1830945721188736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:366/0 lens 488/440 e 0 to 0 dl 1746126616 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126605.629998:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448e300 with x1830945721188736 ext(2097152->3145727) 00002000:00010000:1.0:1746126605.630004:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448e300 00000100:00100000:0.0:1746126605.630468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000001:00080000:1.0:1746126605.655777:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942929 is committed 00000004:00080000:1.0:1746126605.655785:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1940 committed 00000004:00080000:1.0:1746126605.655792:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2041 committed 00000004:00080000:1.0:1746126605.655798:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2040 committed 00000004:00080000:1.0:1746126605.655799:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1939 committed 00000004:00080000:1.0:1746126605.655801:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746126605.655802:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1938 committed 00000004:00080000:1.0:1746126605.655803:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746126605.655805:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1937 committed 00000004:00080000:1.0:1746126605.655806:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2037 committed 00000004:00080000:1.0:1746126605.655807:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1936 committed 00000004:00080000:1.0:1746126605.655808:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746126605.655810:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746126605.655811:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1935 committed 00000004:00080000:1.0:1746126605.655812:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1934 committed 00000004:00080000:1.0:1746126605.655814:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746126605.655815:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746126605.655817:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1933 committed 00000001:00080000:1.0:1746126605.655822:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942926 is committed 00000001:00080000:1.0:1746126605.655843:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942925 is committed 00000100:00100000:0.0:1746126605.656786:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721266816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.656809:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.656839:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746126605.656844:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721266688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.656857:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746126605.656880:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.656887:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.656893:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.656898:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136605000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126605.656901:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.656907:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126605.657146:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721266816 00000100:00100000:1.0:1746126605.657149:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721266816 00000100:00100000:1.0:1746126605.657167:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721266688 00000100:00100000:1.0:1746126605.657169:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721266688 00000100:00100000:1.0:1746126605.657180:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267072 00010000:00010000:0.0:1746126605.657180:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:1.0:1746126605.657182:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267072 00010000:00010000:0.0:1746126605.657183:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126605.657189:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2800/0xb50e825867611d41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc9b expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.657193:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12849 00000100:00100000:1.0:1746126605.657197:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3294:x1830945721266944:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746126605.657200:0:3281:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2800/0xb50e825867611d41 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc9b expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.657208:0:3281:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2800/0xb50e825867611d41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc9b expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.657236:0:3281:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2800/0xb50e825867611d41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc9b expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.657246:0:3281:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721268096:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126605.657282:0:3281:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.657297:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12850 00000100:00100000:1.0:1746126605.657301:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3294:x1830945721266944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (1109us total) trans 21474840215 rc 0/0 00000100:00100000:0.0:1746126605.657302:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3297:x1830945721266816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.657307:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12849 00000100:00100000:1.0:1746126605.657315:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12851 00000100:00100000:1.0:1746126605.657319:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721266688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.657353:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.657372:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.657385:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.657397:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.657405:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746126605.657409:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.657420:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.657425:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801369f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.657435:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.657450:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267200 00000100:00100000:1.0:1746126605.657453:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267200 00000100:00100000:1.0:1746126605.657463:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267712 00000100:00100000:1.0:1746126605.657465:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267712 00000100:00100000:1.0:1746126605.657470:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267328 00000100:00100000:1.0:1746126605.657472:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267328 00000100:00100000:1.0:1746126605.657477:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267840 00000100:00100000:1.0:1746126605.657478:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267840 00000100:00100000:1.0:1746126605.657485:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12852 00000100:00100000:1.0:1746126605.657490:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830945721267072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126605.657599:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126605.657602:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126605 -> 1746126605 00002000:00010000:1.0:1746126605.657604:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126605.657606:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126605 -> 1746126605 00002000:00010000:1.0:1746126605.657607:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126605.657626:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3295:x1830945721267072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (581us total) trans 17179873052 rc 0/0 00000100:00100000:1.0:1746126605.657630:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12852 00000100:00100000:1.0:1746126605.657640:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12853 00000100:00100000:1.0:1746126605.657645:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3296:x1830945721267200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.657723:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3296:x1830945721267200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (351us total) trans 17179873053 rc 0/0 00000100:00100000:1.0:1746126605.657728:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12853 00000100:00100000:1.0:1746126605.657737:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12854 00000100:00100000:1.0:1746126605.657740:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3296:x1830945721267712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126605.657742:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126605.657744:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126605.657746:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126605.657748:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:0.0:1746126605.657750:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:0.0:1746126605.659027:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3297:x1830945721266816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1723us (2215us total) trans 21474840216 rc 0/0 00000100:00100000:0.0:1746126605.659034:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12850 00000100:00100000:1.0:1746126605.659114:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3296:x1830945721267712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1373us (1715us total) trans 17179873054 rc 0/0 00000100:00100000:0.0:1746126605.659157:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12856 00000100:00100000:0.0:1746126605.659162:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3296:x1830945721267840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126605.659212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126605.659442:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126605.659444:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126605 -> 1746126605 00002000:00010000:0.0:1746126605.659446:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126602 -> 1746126602 00002000:00010000:0.0:1746126605.659449:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126605 -> 1746126605 00002000:00010000:0.0:1746126605.659451:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126605.659470:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721266688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2150us (2612us total) trans 21474840217 rc 0/0 00000100:00100000:0.0:1746126605.659475:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12851 00000100:00100000:0.0:1746126605.660120:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3296:x1830945721267840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 958us (2682us total) trans 17179873056 rc 0/0 00000100:00100000:0.0:1746126605.660126:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12856 00000100:00100000:0.0:1746126605.660270:0:3281:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721268096:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126605.660287:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126605.660293:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136605000/0xb50e825867611d3a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126605.661088:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12854 00000100:00100000:1.0:1746126605.661102:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267584 00000100:00100000:1.0:1746126605.661106:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267584 00000100:00100000:1.0:1746126605.661121:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268224 00000100:00100000:1.0:1746126605.661122:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268224 00000100:00100000:1.0:1746126605.661132:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267456 00000100:00100000:1.0:1746126605.661146:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267456 00000100:00100000:1.0:1746126605.661153:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267968 00000100:00100000:1.0:1746126605.661154:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267968 00000100:00100000:1.0:1746126605.661159:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268608 00000100:00100000:1.0:1746126605.661161:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268608 00000100:00100000:1.0:1746126605.661168:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12857 00000100:00100000:1.0:1746126605.661173:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3295:x1830945721267584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126605.661286:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126605.661289:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126605.661290:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126605.661292:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126605.661294:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126605.661318:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3295:x1830945721267584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (533us total) trans 17179873057 rc 0/0 00000100:00100000:1.0:1746126605.661324:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12857 00000100:00100000:1.0:1746126605.661333:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12858 00000100:00100000:1.0:1746126605.661337:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3295:x1830945721268224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661432:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3295:x1830945721268224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (557us total) trans 21474840218 rc 0/0 00000100:00100000:1.0:1746126605.661436:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12858 00000100:00100000:1.0:1746126605.661444:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12859 00000100:00100000:1.0:1746126605.661448:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3295:x1830945721267456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.661528:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3295:x1830945721267456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (619us total) trans 17179873058 rc 0/0 00000100:00100000:1.0:1746126605.661533:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12859 00000100:00100000:1.0:1746126605.661540:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12860 00000100:00100000:1.0:1746126605.661544:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3295:x1830945721267968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.661610:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3295:x1830945721267968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (677us total) trans 17179873059 rc 0/0 00000100:00100000:1.0:1746126605.661614:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12860 00000100:00100000:1.0:1746126605.661622:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12861 00000100:00100000:1.0:1746126605.661625:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3295:x1830945721268608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661689:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3295:x1830945721268608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (735us total) trans 21474840219 rc 0/0 00000100:00100000:1.0:1746126605.661694:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12861 00000004:00080000:1.0:1746126605.661737:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5956a00/2, rc 0, transno 21474840215 00000100:00100000:1.0:1746126605.661741:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721266944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661756:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721268480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661777:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126605.661797:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a448e680/2, rc 0, transno 21474840217 00000100:00100000:1.0:1746126605.661800:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721266688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.661808:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5956680/2, rc 0, transno 21474840216 00000100:00100000:1.0:1746126605.661811:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721266816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661817:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746126605.661822:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721268352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661857:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.661874:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268480 00000100:00100000:1.0:1746126605.661877:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268480 00000100:00100000:1.0:1746126605.661891:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268352 00000100:00100000:1.0:1746126605.661893:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268352 00000100:00100000:1.0:1746126605.661901:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12862 00000100:00100000:1.0:1746126605.661904:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3297:x1830945721268480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.661990:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721268480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (212us total) trans 21474840220 rc 0/0 00000100:00100000:1.0:1746126605.661995:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12862 00000100:00100000:0.0:1746126605.662000:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12863 00000100:00100000:0.0:1746126605.662006:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3297:x1830945721268352:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.662021:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801369f9500/2, rc 0, transno 17179873055 00000100:00100000:1.0:1746126605.662024:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.662032:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801369f8e00/2, rc 0, transno 17179873056 00000100:00100000:1.0:1746126605.662035:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.662043:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801369f8380/2, rc 0, transno 17179873053 00000100:00100000:1.0:1746126605.662045:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.662053:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801369f8a80/2, rc 0, transno 17179873054 00000100:00100000:1.0:1746126605.662055:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801369f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721267712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.662069:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6d80/2, rc 0, transno 21474840220 00000100:00100000:1.0:1746126605.662071:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721268480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.662096:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721268352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (237us total) trans 21474840221 rc 0/0 00000100:00100000:0.0:1746126605.662101:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12863 00000004:00080000:1.0:1746126605.662102:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6680/2, rc 0, transno 21474840221 00000100:00100000:1.0:1746126605.662104:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721268352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126605.662783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.663460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.663651:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721191168 00000100:00100000:1.0:1746126605.663655:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721191168 00010000:00010000:1.0:1746126605.663672:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fc00/0xb50e825867611cc3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc55 expref: 8 pid: 14548 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.663695:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6711 00000100:00100000:1.0:1746126605.663704:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721191168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.663714:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.663719:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fc00/0xb50e825867611cc3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc55 expref: 8 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.663730:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fc00/0xb50e825867611cc3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc55 expref: 8 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.663749:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f16fc00/0xb50e825867611cc3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc55 expref: 8 pid: 14548 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.663762:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.663767:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4581a00/0xb50e825867611d6b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126605.663775:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4581a00/0xb50e825867611d6b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126605.663784:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4581a00/0xb50e825867611d6b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126605.663811:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.664395:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721191168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 694us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.664402:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6711 00000100:00100000:0.0:1746126605.664577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.668478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.668586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.673761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.686753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.687200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.689252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.689467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.699048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.699113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.699192:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721193216 00000100:00100000:1.0:1746126605.699199:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721193216 00010000:00010000:1.0:1746126605.699236:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e825867611d64 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb0 expref: 9 pid: 20362 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.699263:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6712 00000100:00100000:1.0:1746126605.699270:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721193216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126605.699283:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126605.699288:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e825867611d64 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb0 expref: 9 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.699297:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e825867611d64 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb0 expref: 9 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.699320:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc400/0xb50e825867611d64 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb0 expref: 9 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126605.699336:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126605.699341:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126605.699351:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126605.699356:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126605.699393:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721193216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.699400:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6712 00000100:00100000:1.0:1746126605.709810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.710338:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721193472 00000100:00100000:0.0:1746126605.710347:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721193472 00000100:00100000:0.0:1746126605.710389:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12866 00000100:00100000:0.0:1746126605.710396:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:30964:x1830945721193472:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.710411:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.710429:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093dfce00/0xb50e825867611d8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ccc5 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.710453:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.710455:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.710463:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093dfce00/0xb50e825867611d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccc5 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.710476:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093dfce00/0xb50e825867611d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccc5 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.710487:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093dfce00, rc 0) 00000100:00100000:0.0:1746126605.711045:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:30964:x1830945721193472:12345-192.168.203.2@tcp:101:cat.0 Request processed in 649us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.711050:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12866 00000100:00100000:1.0:1746126605.721887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000001:00080000:1.0:1746126605.733417:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942932 is committed 00000001:00080000:1.0:1746126605.733426:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942930 is committed 00000001:00080000:1.0:1746126605.733430:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942933 is committed 00000004:00080000:1.0:1746126605.733433:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1948 committed 00000004:00080000:1.0:1746126605.733439:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2050 committed 00000004:00080000:1.0:1746126605.733443:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2049 committed 00000004:00080000:1.0:1746126605.733444:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1947 committed 00000004:00080000:1.0:1746126605.733447:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2048 committed 00000004:00080000:1.0:1746126605.733448:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1946 committed 00000004:00080000:1.0:1746126605.733450:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2047 committed 00000004:00080000:1.0:1746126605.733451:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1945 committed 00000004:00080000:1.0:1746126605.733452:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2046 committed 00000004:00080000:1.0:1746126605.733454:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1944 committed 00000004:00080000:1.0:1746126605.733455:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2045 committed 00000004:00080000:1.0:1746126605.733457:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2044 committed 00000004:00080000:1.0:1746126605.733458:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1943 committed 00000004:00080000:1.0:1746126605.733460:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1942 committed 00000004:00080000:1.0:1746126605.733461:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2043 committed 00000004:00080000:1.0:1746126605.733463:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2042 committed 00000004:00080000:1.0:1746126605.733464:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1941 committed 00000100:00100000:1.0:1746126605.733876:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721269504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.733909:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126605.734097:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721269632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.734161:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721270016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.734177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734190:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721270528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.734202:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734210:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721271040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.734218:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734233:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721269760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.734243:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734250:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721270272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.734259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734266:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721270784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.734275:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734283:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721271296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.734291:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126605.734308:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721269504 00000100:00100000:1.0:1746126605.734312:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721269504 00000100:00100000:1.0:1746126605.734332:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270016 00000100:00100000:1.0:1746126605.734334:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270016 00000100:00100000:1.0:1746126605.734341:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270528 00000100:00100000:1.0:1746126605.734343:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270528 00000100:00100000:1.0:1746126605.734350:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721271040 00000100:00100000:1.0:1746126605.734352:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721271040 00000100:00100000:1.0:1746126605.734357:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721269760 00000100:00100000:1.0:1746126605.734359:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721269760 00000100:00100000:1.0:1746126605.734363:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270272 00000100:00100000:1.0:1746126605.734365:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270272 00000100:00100000:1.0:1746126605.734369:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270784 00000100:00100000:1.0:1746126605.734370:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270784 00000100:00100000:1.0:1746126605.734375:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721271296 00000100:00100000:1.0:1746126605.734376:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721271296 00000100:00100000:1.0:1746126605.734384:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12867 00000100:00100000:1.0:1746126605.734389:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3296:x1830945721269504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126605.734520:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126605.734523:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126605 -> 1746126605 00002000:00010000:1.0:1746126605.734525:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126601 -> 1746126601 00002000:00010000:1.0:1746126605.734526:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126605 -> 1746126605 00002000:00010000:1.0:1746126605.734528:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126605.734551:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3296:x1830945721269504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (642us total) trans 17179873061 rc 0/0 00000100:00100000:1.0:1746126605.734556:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12867 00000100:00100000:1.0:1746126605.734567:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12868 00000100:00100000:1.0:1746126605.734570:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3296:x1830945721270016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126605.734627:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126605.734629:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126605.734630:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126605.734632:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126605.734633:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126605.734648:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3296:x1830945721270016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (470us total) trans 17179873062 rc 0/0 00000100:00100000:1.0:1746126605.734652:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12868 00000100:00100000:1.0:1746126605.734661:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12869 00000100:00100000:1.0:1746126605.734664:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3296:x1830945721270528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.734755:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721270528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (551us total) trans 21474840222 rc 0/0 00000100:00100000:1.0:1746126605.734759:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12869 00000100:00100000:1.0:1746126605.734768:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12870 00000100:00100000:1.0:1746126605.734772:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3296:x1830945721271040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.734858:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721271040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (637us total) trans 21474840223 rc 0/0 00000100:00100000:1.0:1746126605.734862:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12870 00000100:00100000:1.0:1746126605.734870:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12871 00000100:00100000:1.0:1746126605.734873:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3294:x1830945721269760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126605.734935:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746126605.734937:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.734939:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.734941:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.734943:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746126605.734960:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721269760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (716us total) trans 17179873063 rc 0/0 00000100:00100000:1.0:1746126605.734965:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12871 00000100:00100000:1.0:1746126605.734972:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12872 00000100:00100000:1.0:1746126605.734975:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3294:x1830945721270272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126605.735038:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721270272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (776us total) trans 17179873064 rc 0/0 00000100:00100000:1.0:1746126605.735042:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12872 00000100:00100000:1.0:1746126605.735049:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12873 00000100:00100000:1.0:1746126605.735053:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3294:x1830945721270784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126605.735110:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126605.735112:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.735114:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.735115:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126603 -> 1746126603 00002000:00010000:1.0:1746126605.735117:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:1.0:1746126605.735131:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3294:x1830945721270784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (855us total) trans 21474840224 rc 0/0 00000100:00100000:1.0:1746126605.735157:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12873 00000100:00100000:1.0:1746126605.735165:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12874 00000100:00100000:1.0:1746126605.735169:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3294:x1830945721271296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126605.735238:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3294:x1830945721271296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (945us total) trans 21474840225 rc 0/0 00000100:00100000:1.0:1746126605.735243:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12874 00000004:00080000:1.0:1746126605.735279:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a7b80/2, rc 0, transno 17179873063 00000100:00100000:1.0:1746126605.735286:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721269760:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.735293:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e804000/2, rc 0, transno 17179873064 00000100:00100000:1.0:1746126605.735295:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721270272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.735302:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d6a00/2, rc 0, transno 21474840224 00000100:00100000:1.0:1746126605.735305:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721270784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.735310:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f135180/2, rc 0, transno 21474840225 00000100:00100000:1.0:1746126605.735312:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721271296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.735337:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d4e00/2, rc 0, transno 21474840222 00000100:00100000:1.0:1746126605.735339:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721270528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.735344:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f134380/2, rc 0, transno 21474840223 00000100:00100000:1.0:1746126605.735347:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721271040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126605.735352:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099251c00/2, rc 0, transno 17179873061 00000100:00100000:1.0:1746126605.735354:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721269504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126605.735359:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14380/2, rc 0, transno 17179873062 00000100:00100000:1.0:1746126605.735361:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721270016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126605.742715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.742908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.744378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.751560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.751643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.756309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.756346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.756373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.756417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.756438:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721195392 00000100:00100000:0.0:1746126605.756445:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721195392 00002000:00100000:0.0:1746126605.756478:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5955880 x1830945721195392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.756486:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5955880 with x1830945721195392 ext(3145728->4194303) 00002000:00010000:0.0:1746126605.756491:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5955880 00000100:00100000:0.0:1746126605.756521:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721195520 00000100:00100000:0.0:1746126605.756524:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721195520 00002000:00100000:0.0:1746126605.756536:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5956d80 x1830945721195520/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:366/0 lens 488/0 e 0 to 0 dl 1746126616 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126605.756543:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956d80 with x1830945721195520 ext(2097152->3145727) 00002000:00010000:0.0:1746126605.756545:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5956d80 00000100:00100000:0.0:1746126605.756555:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7378 00000100:00100000:0.0:1746126605.756561:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721195392:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126605.758069:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721195008 00000100:00100000:1.0:1746126605.758074:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721195008 00000100:00100000:1.0:1746126605.758094:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12884 00000100:00100000:1.0:1746126605.758098:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:30972:x1830945721195008:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126605.758106:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.758120:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cce1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126605.758143:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c70d, atime: 0x6813c70a, ctime: 0x6813c70d, blocks: 0x821 00010000:00010000:1.0:1746126605.758156:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.758158:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.758163:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1216512->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce1 expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.758175:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1216512->1462271) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce1 expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.758182:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3600, rc 0) 00000100:00100000:1.0:1746126605.758204:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:30972:x1830945721195008:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 106us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.758209:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12884 00000100:00100000:0.0:1746126605.761007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.761619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.764617:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721196160 00000100:00100000:1.0:1746126605.764624:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721196160 00000100:00100000:1.0:1746126605.764895:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12885 00000100:00100000:1.0:1746126605.764902:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:30969:x1830945721196160:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126605.764913:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.764927:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2800/0xb50e825867611dcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cce8 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.764949:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.764957:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.764958:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.764961:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2800/0xb50e825867611dcd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1306624->1437695] (req 1306624->1437695) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce8 expref: 18 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.764986:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.764996:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 18 pid: 4641 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.765006:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721271680:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.765611:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.774356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.774360:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721271680:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.774380:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2800/0xb50e825867611dcd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1306624->1437695] (req 1306624->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce8 expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.774383:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721196288 00000100:00100000:0.0:1746126605.774388:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721196288 00010000:00010000:1.0:1746126605.774398:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2800, rc 0) 00010000:00010000:0.0:1746126605.774411:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 17 pid: 4641 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.774433:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:30969:x1830945721196160:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9532us (12814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126605.774437:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6714 00000100:00100000:1.0:1746126605.774439:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12885 00000100:00100000:0.0:1746126605.774443:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721196288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126605.774453:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126605.774473:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 16 pid: 4641 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.774483:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 16 pid: 4641 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.774500:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013489e600/0xb50e825867611d17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc71 expref: 16 pid: 4641 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746126605.774523:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.774525:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126605.774530:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2800/0xb50e825867611dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce8 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.774537:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2800/0xb50e825867611dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce8 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126605.774559:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2800/0xb50e825867611dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce8 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.774569:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721271808:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126605.774612:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.776288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.776322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.776495:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721196416 00000100:00100000:1.0:1746126605.776500:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721196416 00000100:00100000:1.0:1746126605.776521:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721196544 00000100:00100000:1.0:1746126605.776522:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721196544 00000100:00100000:1.0:1746126605.776535:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12886 00000100:00100000:1.0:1746126605.776541:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721196416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.776551:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.776565:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ccef expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126605.776581:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c709, atime: 0x6813c709, ctime: 0x6813c709, blocks: 0x7a1 00010000:00010000:1.0:1746126605.776592:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.776594:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.776599:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.776610:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 13 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.776617:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3200, rc 0) 00000100:00100000:1.0:1746126605.776633:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721196416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 92us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.776640:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12886 00000100:00100000:1.0:1746126605.776650:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12887 00000100:00100000:1.0:1746126605.776654:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721196544:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.776660:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.776666:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3800/0xb50e825867611ddb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ccf6 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.776692:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721271936:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126605.776736:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.778713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.778937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.783563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.788378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.788421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.790104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.790145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.790891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.792465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.793439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.793453:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721198592 00000100:00100000:0.0:1746126605.793456:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721198592 00000100:00100000:0.0:1746126605.793473:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3683 00000100:00100000:0.0:1746126605.793478:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:30969:x1830945721198592:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126605.793971:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:30969:x1830945721198592:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 492us (531us total) trans 8589942936 rc 0/0 00000100:00100000:0.0:1746126605.793976:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3683 00010000:00010000:0.0:1746126605.800913:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126605.813920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.820632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.833597:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721199104 00000100:00100000:0.0:1746126605.833604:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721199104 00000100:00100000:0.0:1746126605.833631:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721199232 00000100:00100000:0.0:1746126605.833632:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721199232 00000100:00100000:0.0:1746126605.833941:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12894 00000100:00100000:0.0:1746126605.833948:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721199232:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126605.833963:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126605.833976:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800997f6400/0xb50e825867611e0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cd27 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126605.834014:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272576:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126605.834072:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6180 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.837021:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272576:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126605.837050:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800997f6400/0xb50e825867611e0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd27 expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.837061:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997f6400/0xb50e825867611e0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd27 expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.839718:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997f6400, rc 0) 00000100:00100000:1.0:1746126605.839787:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721199232:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5838us (6246us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126605.839793:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12894 00000100:00100000:0.0:1746126605.843300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.843384:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721199360 00000100:00100000:1.0:1746126605.843392:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721199360 00000100:00100000:1.0:1746126605.843433:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12895 00000100:00100000:1.0:1746126605.843440:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721199360:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.843457:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.843472:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3e00/0xb50e825867611e13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cd2e expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.843514:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272704:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126605.843590:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.844927:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272704:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126605.847213:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3e00/0xb50e825867611e13 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd2e expref: 28 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.847240:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3e00/0xb50e825867611e13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd2e expref: 28 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.847271:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3e00, rc 0) 00000100:00100000:1.0:1746126605.847331:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721199360:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3891us (4036us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126605.847338:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12895 00000100:00100000:0.0:1746126605.916917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.942352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.943464:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721199744 00000100:00100000:1.0:1746126605.943474:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721199744 00000100:00100000:1.0:1746126605.943533:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12896 00000100:00100000:1.0:1746126605.943540:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:30978:x1830945721199744:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126605.943555:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.943570:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cd3c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.943595:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b492e00/0xb50e825867611d10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc8d expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.943604:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093dfce00/0xb50e825867611d8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccc5 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.943610:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.943612:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126605.943615:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2199552->2506751] (req 2199552->2506751) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd3c expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.943639:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093dfce00/0xb50e825867611d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccc5 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.943650:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093dfce00/0xb50e825867611d8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccc5 expref: 26 pid: 9686 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126605.943661:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272832:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.943758:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b492e00/0xb50e825867611d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc8d expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.943766:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b492e00/0xb50e825867611d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cc8d expref: 16 pid: 8438 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746126605.943775:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272960:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.943791:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.947232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.947519:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272832:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126605.947538:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721272960:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126605.947573:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2199552->2506751] (req 2199552->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd3c expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126605.947587:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3400, rc 0) 00000100:00100000:1.0:1746126605.948040:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:30978:x1830945721199744:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4499us (5698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126605.948049:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12896 00000100:00100000:0.0:1746126605.956522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.968206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.976341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.976391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.977057:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721200640 00000100:00100000:1.0:1746126605.977061:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721200640 00000100:00100000:1.0:1746126605.977085:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12897 00000100:00100000:1.0:1746126605.977090:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721200640:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.977098:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.977116:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3000/0xb50e825867611e44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cd43 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.977171:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721273216:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126605.977247:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126605.978056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.984328:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721273216:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126605.984365:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3000/0xb50e825867611e44 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd43 expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.984379:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3000/0xb50e825867611e44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd43 expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.984407:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3000, rc 0) 00000100:00100000:1.0:1746126605.984463:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721200640:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7371us (8069us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126605.984473:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12897 00000100:00100000:1.0:1746126605.984985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.985993:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721201152 00000100:00100000:0.0:1746126605.986001:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721201152 00000100:00100000:0.0:1746126605.986050:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3684 00000100:00100000:0.0:1746126605.986056:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:30984:x1830945721201152:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126605.986271:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:30984:x1830945721201152:12345-192.168.203.2@tcp:35:cat.0 Request processed in 214us (1286us total) trans 8589942939 rc 0/0 00000100:00100000:0.0:1746126605.986991:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3684 00000100:00100000:0.0:1746126605.989034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.990713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.990757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126605.990977:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721201536 00000100:00100000:1.0:1746126605.990983:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721201536 00000100:00100000:1.0:1746126605.991073:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721201664 00000100:00100000:1.0:1746126605.991077:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721201664 00000100:00100000:1.0:1746126605.991096:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12898 00000100:00100000:1.0:1746126605.991101:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721201536:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126605.991113:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126605.991127:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867611e6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cd51 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126605.991176:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721273344:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126605.991275:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126605.993044:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721273344:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126605.993066:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867611e6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd51 expref: 29 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.993077:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867611e6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd51 expref: 29 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126605.993103:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2e00, rc 0) 00000100:00100000:1.0:1746126605.993156:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721201536:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2053us (2445us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126605.993163:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12898 00000100:00100000:0.0:1746126605.994977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126605.995153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.003550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126606.006041:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126606.017582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126606.018698:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126606.026755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126606.027253:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126606.028396:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721202944 00000100:00100000:0.0:1746126606.028399:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721202944 00010000:00010000:0.0:1746126606.028414:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390400/0xb50e825867611e60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd4a expref: 229 pid: 20362 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126606.028440:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6718 00000100:00100000:0.0:1746126606.028445:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721202944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.028452:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.028456:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390400/0xb50e825867611e60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd4a expref: 229 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126606.028465:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390400/0xb50e825867611e60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd4a expref: 229 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126606.028477:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390400/0xb50e825867611e60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd4a expref: 229 pid: 20362 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126606.028488:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126606.028492:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390600/0xb50e825867611e83 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.028498:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390600/0xb50e825867611e83 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.028503:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390600/0xb50e825867611e83 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.028520:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.028540:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+228:1963:x1830945721202944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 95us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.028545:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6718 00000100:00080000:1.0:1746126606.029022:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126606.029876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126606.030483:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126606.032230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.037229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.038895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.047892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126606.048063:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126606.049761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.050890:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203840 00000100:00100000:0.0:1746126606.050898:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203840 00010000:00010000:0.0:1746126606.050923:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d523600/0xb50e825867611d79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb7 expref: 27 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746126606.051558:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6720 00000100:00100000:0.0:1746126606.051565:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721203840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.051576:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.051593:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d523600/0xb50e825867611d79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb7 expref: 27 pid: 23766 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126606.051603:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d523600/0xb50e825867611d79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb7 expref: 27 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126606.051604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126606.051618:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d523600/0xb50e825867611d79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccb7 expref: 27 pid: 23766 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746126606.051619:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721203968 00000100:00100000:1.0:1746126606.051622:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721203968 00010000:00010000:1.0:1746126606.051635:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1462271) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce1 expref: 29 pid: 8436 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746126606.051703:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.051706:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.051712:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867611e9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3940351) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd74 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.051720:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867611e9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3940351) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd74 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.051746:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f16e200/0xb50e825867611e9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd74 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126606.051757:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721274368:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126606.051797:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6721 00000100:00100000:1.0:1746126606.051803:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721203968:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.051812:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.051822:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1462271) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce1 expref: 29 pid: 8436 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126606.051850:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1462271) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce1 expref: 29 pid: 8436 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126606.051861:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3600/0xb50e825867611dc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1462271) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cce1 expref: 29 pid: 8436 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746126606.051904:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.051906:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.051910:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.051920:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126606.051926:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6840 going to sleep for 11 seconds 00010000:00010000:1.0:1746126606.051936:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.051943:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721274496:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126606.051960:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.051992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.054019:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721274496:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126606.054031:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.054056:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721203968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2253us (2451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.054063:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6721 00000100:00100000:0.0:1746126606.056732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.060523:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7394 00000100:00100000:1.0:1746126606.060533:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721204864:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126606.067607:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721205120 00000100:00100000:0.0:1746126606.067616:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721205120 00002000:00100000:0.0:1746126606.067650:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880091da3480 x1830945721205120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126606.067658:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3480 with x1830945721205120 ext(1048576->2097151) 00002000:00010000:0.0:1746126606.067663:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091da3480 00000100:00100000:0.0:1746126606.067691:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7395 00000100:00100000:0.0:1746126606.067696:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721205120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126606.075684:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721204864:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 15144us (16433us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126606.075696:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7394 00002000:00100000:1.0:1746126606.075706:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880091da2680 x1830945721204864/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.075715:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da2680 with x1830945721204864 ext(1048576->2097151) 00002000:00010000:1.0:1746126606.075720:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da2680 00000100:00100000:0.0:1746126606.087095:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.088924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.092971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.108277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.116648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.116695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.117061:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7399 00000100:00100000:1.0:1746126606.117069:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721206656:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126606.127691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.127731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.128019:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7401 00000100:00100000:0.0:1746126606.128027:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721206912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126606.140386:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721206656:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23311us (23684us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126606.140395:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7399 00002000:00100000:0.0:1746126606.140403:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800937ba680 x1830945721206656/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126606.140411:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ba680 with x1830945721206656 ext(3145728->4194303) 00002000:00010000:0.0:1746126606.140415:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ba680 00000100:00100000:0.0:1746126606.147352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.148055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.157155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.160388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.162854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.163791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.163845:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721208576 00000100:00100000:0.0:1746126606.163850:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721208576 00010000:00010000:0.0:1746126606.163867:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611ede lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd90 expref: 28 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.163894:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6725 00000100:00100000:0.0:1746126606.163900:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721208576:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.163908:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.163924:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611ede lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd90 expref: 28 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.163939:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd90 expref: 28 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.163954:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379aa00/0xb50e825867611ede lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd90 expref: 28 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.163978:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.163979:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.163985:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f01ec00/0xb50e825867611ee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->2678783) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd9e expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.165510:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01ec00/0xb50e825867611ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->2678783) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd9e expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.165582:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f01ec00/0xb50e825867611ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd9e expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.165595:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721275520:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126606.165655:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.168303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.168340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.168877:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721275520:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126606.168892:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.168913:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721208576:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5013us (5122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.168920:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6725 00000100:00100000:0.0:1746126606.171201:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.183628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.185890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.188783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.188849:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721209600 00000100:00100000:1.0:1746126606.188855:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721209600 00010000:00010000:1.0:1746126606.188880:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd3c expref: 19 pid: 4640 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.188900:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6726 00000100:00100000:1.0:1746126606.188905:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721209600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.188915:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.188937:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd3c expref: 19 pid: 4640 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.188948:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2506751) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd3c expref: 19 pid: 4640 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.188972:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867611e3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2506751) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd3c expref: 19 pid: 4640 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.188987:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.188989:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.188995:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009379a600/0xb50e825867611ef3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdac expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.189002:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009379a600/0xb50e825867611ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdac expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.189030:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009379a600/0xb50e825867611ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdac expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.189041:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721275648:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126606.189100:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.192517:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721275648:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126606.192538:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.192570:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721209600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3664us (6680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.192578:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6726 00000100:00100000:0.0:1746126606.193506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.193548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.203699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.203739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.204207:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721210752 00000100:00100000:1.0:1746126606.204217:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721210752 00002000:00100000:1.0:1746126606.204250:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880134c3ce00 x1830945721210752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.204258:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ce00 with x1830945721210752 ext(2097152->3145727) 00002000:00010000:1.0:1746126606.204263:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3ce00 00000100:00100000:1.0:1746126606.204280:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7406 00000100:00100000:1.0:1746126606.204285:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721210752:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126606.222017:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721210752:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17730us (18276us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126606.222026:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7406 00002000:00100000:1.0:1746126606.222036:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880134c3ce00 x1830945721210752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.222045:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ce00 with x1830945721210752 ext(2097152->3145727) 00002000:00010000:1.0:1746126606.222050:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3ce00 00000100:00100000:0.0:1746126606.233874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.238302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.238703:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721211648 00000100:00100000:1.0:1746126606.238711:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721211648 00002000:00100000:1.0:1746126606.238745:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880134c3dc00 x1830945721211648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.238753:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3dc00 with x1830945721211648 ext(4194304->4976639) 00002000:00010000:1.0:1746126606.238758:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3dc00 00000100:00100000:1.0:1746126606.238781:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7407 00000100:00100000:1.0:1746126606.238786:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721211648:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126606.251074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.251117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.265139:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721211648:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26325us (26816us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126606.265155:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7407 00002000:00100000:1.0:1746126606.265165:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880134c3dc00 x1830945721211648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.265173:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3dc00 with x1830945721211648 ext(4194304->4976639) 00002000:00010000:1.0:1746126606.265178:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3dc00 00000100:00100000:0.0:1746126606.292721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.296139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.296237:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721212416 00000100:00100000:1.0:1746126606.296242:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721212416 00000100:00100000:1.0:1746126606.296273:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12915 00000100:00100000:1.0:1746126606.296278:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721212416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126606.296288:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.296299:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edee000/0xb50e825867611f40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cddd expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.296317:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008edee000/0xb50e825867611f40 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cddd expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.296325:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008edee000/0xb50e825867611f40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cddd expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.296335:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edee000, rc 0) 00000100:00100000:1.0:1746126606.296349:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721212416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 71us (220us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126606.296353:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12915 00000100:00100000:0.0:1746126606.301553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.301702:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721212544 00000100:00100000:1.0:1746126606.301710:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721212544 00010000:00010000:1.0:1746126606.301741:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611de9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd04 expref: 15 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.301773:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6727 00000100:00100000:1.0:1746126606.301779:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721212544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.301789:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.301805:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611de9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd04 expref: 15 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.301814:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611de9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd04 expref: 15 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.301859:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611de9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd04 expref: 15 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.301876:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.301911:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721212544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.301917:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6727 00000100:00100000:0.0:1746126606.311054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.311084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.311108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.311119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.311155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.323956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.326520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.331928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.334207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.335349:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721213696:12345-192.168.203.2@tcp:3:cat.0 Request processed in 8612us (8827us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746126606.335359:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7411 00002000:00100000:0.0:1746126606.335370:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880136a80e00 x1830945721213696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126606.335378:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80e00 with x1830945721213696 ext(4194304->4976639) 00002000:00010000:0.0:1746126606.335383:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a80e00 00000100:00100000:0.0:1746126606.339057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.346996:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721214592 00000100:00100000:1.0:1746126606.347004:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721214592 00000100:00100000:1.0:1746126606.347040:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12921 00000100:00100000:1.0:1746126606.347046:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721214592:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126606.347059:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.347072:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611f8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ce0e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.347102:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611f8d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce0e expref: 30 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.347111:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e825867611f8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce0e expref: 30 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.347123:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edef200, rc 0) 00000100:00100000:1.0:1746126606.347176:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721214592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 130us (2458us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126606.347181:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12921 00000100:00100000:0.0:1746126606.347612:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721214464 00000100:00100000:0.0:1746126606.347616:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721214464 00000100:00100000:0.0:1746126606.347640:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 668 00000100:00100000:0.0:1746126606.347644:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721214464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.347652:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.347666:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51f2200/0xb50e825867611f7f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce07 expref: 17 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.347694:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126606.347697:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.347715:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721214464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.347719:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 668 00000100:00100000:0.0:1746126606.351524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.408051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.410153:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721214848 00000100:00100000:1.0:1746126606.410163:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721214848 00000100:00100000:1.0:1746126606.410477:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12923 00000100:00100000:1.0:1746126606.410485:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:30997:x1830945721214848:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126606.410500:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.410514:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e825867611f9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ce1c expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.410538:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f600/0xb50e825867611e91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd66 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.410546:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01f800/0xb50e825867611f24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdc1 expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.410552:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.410555:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.410558:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e825867611f9b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1073152->1642495] (req 1073152->1642495) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce1c expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.410581:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01f800/0xb50e825867611f24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdc1 expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.410591:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f01f800/0xb50e825867611f24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdc1 expref: 21 pid: 8438 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.410602:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721276160:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.410697:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16f600/0xb50e825867611e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd66 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.410705:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f16f600/0xb50e825867611e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd66 expref: 29 pid: 8438 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.410712:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721276288:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.410730:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.413726:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721276160:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.413736:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721276288:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.413757:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e825867611f9b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1073152->1642495] (req 1073152->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce1c expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.413771:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edef200, rc 0) 00000100:00100000:1.0:1746126606.413803:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+21:30997:x1830945721214848:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3319us (5759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.413811:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12923 00000100:00100000:0.0:1746126606.417328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.417368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.421921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.435761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.452767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.458461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.467234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.467714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.474228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.475016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.493583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.499845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.506236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.507418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.508027:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721217664 00000100:00100000:0.0:1746126606.508033:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721217664 00000100:00100000:0.0:1746126606.508075:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3690 00000100:00100000:0.0:1746126606.508083:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:31006:x1830945721217664:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126606.508278:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:31006:x1830945721217664:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 195us (860us total) trans 8589942951 rc 0/0 00000100:00100000:0.0:1746126606.508284:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3690 00000100:00100000:0.0:1746126606.516148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.522470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.535859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.552264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.575276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.585151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.587964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.588172:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721218688 00000100:00100000:0.0:1746126606.588177:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721218688 00002000:00100000:0.0:1746126606.588206:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2199551) req@ffff88008f1e1880 x1830945721218688/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126606.588214:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1880 with x1830945721218688 ext(2097152->2199551) 00010000:00010000:0.0:1746126606.588222:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611f63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2555903] (req 2097152->2199551) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce00 expref: 30 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.588231:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611f63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2555903] (req 2097152->2199551) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce00 expref: 30 pid: 4642 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746126606.588238:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e1880 00000100:00100000:0.0:1746126606.588252:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1682 00000100:00100000:0.0:1746126606.588258:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721218688:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126606.595625:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721218688:12345-192.168.203.2@tcp:4:cat.0 Request processed in 7364us (7661us total) trans 21474840233 rc 0/0 00000100:00100000:1.0:1746126606.595633:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1682 00002000:00100000:1.0:1746126606.595638:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2199551) req@ffff88008f1e1880 x1830945721218688/t21474840233(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/448 e 0 to 0 dl 1746126617 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.595645:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1880 with x1830945721218688 ext(2097152->2199551) 00010000:00010000:1.0:1746126606.595652:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611f63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2555903] (req 2097152->2199551) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce00 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.595660:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009379a800/0xb50e825867611f63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2555903] (req 2097152->2199551) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce00 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00002000:00010000:1.0:1746126606.595665:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e1880 00000100:00100000:0.0:1746126606.609046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.609151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.609814:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721219200 00000100:00100000:0.0:1746126606.609817:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721219200 00000100:00100000:0.0:1746126606.611689:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8801 00000100:00100000:0.0:1746126606.611700:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+233:31009:x1830945721219200:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126606.611718:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126606.611733:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3600/0xb50e825867612004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ce4d expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.611817:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611844:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611852:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611863:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611868:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611873:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611953:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e825867612019 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611960:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e825867612019 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.611966:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e825867612019 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126606.611972:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126606.612041:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612047:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612053:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612058:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e2400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126606.612061:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612066:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612075:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126606.612077:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126606.612080:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612085:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2400/0xb50e82586761200b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612099:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612104:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612108:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612112:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e3400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126606.612114:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612119:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612141:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8300) 00010000:00010000:0.0:1746126606.612143:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126606.612146:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612150:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e825867612012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126606.612180:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3600/0xb50e825867612004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce4d expref: 236 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.612189:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e825867612019 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce4d expref: 235 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.612195:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126606.612197:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126606.612199:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2800, rc 0) 00000100:00100000:0.0:1746126606.612240:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+235:31009:x1830945721219200:12345-192.168.203.2@tcp:101:cat.0 Request processed in 544us (3021us total) trans 8589942952 rc 0/0 00000100:00100000:0.0:1746126606.612246:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8801 00000100:00100000:0.0:1746126606.618001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.618039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.619224:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721219584 00000100:00100000:1.0:1746126606.619228:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721219584 00000100:00100000:1.0:1746126606.619257:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3691 00000100:00100000:1.0:1746126606.619261:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+234:31009:x1830945721219584:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126606.619396:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+235:31009:x1830945721219584:12345-192.168.203.2@tcp:35:cat.0 Request processed in 133us (1355us total) trans 8589942953 rc 0/0 00000100:00100000:1.0:1746126606.619404:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3691 00000100:00100000:0.0:1746126606.626242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.630428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.631136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.631157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.631194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.631670:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721220480 00000100:00100000:0.0:1746126606.631675:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721220480 00002000:00100000:0.0:1746126606.631693:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e9fc000 x1830945721220480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126606.631701:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fc000 with x1830945721220480 ext(2097152->3145727) 00002000:00010000:0.0:1746126606.631705:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9fc000 00000100:00100000:0.0:1746126606.631718:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7418 00000100:00100000:0.0:1746126606.631723:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721220480:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126606.646470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.655021:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721220480:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23293us (23823us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126606.655031:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7418 00002000:00100000:1.0:1746126606.655041:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e9fc000 x1830945721220480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.655048:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fc000 with x1830945721220480 ext(2097152->3145727) 00010000:00010000:1.0:1746126606.655056:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b391e00/0xb50e825867611efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdb3 expref: 20 pid: 8438 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.655066:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b391e00/0xb50e825867611efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdb3 expref: 20 pid: 8438 timeout: 828 lvb_type: 0 00002000:00010000:1.0:1746126606.655071:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9fc000 00000100:00100000:0.0:1746126606.655665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.655681:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721220864 00000100:00100000:0.0:1746126606.655686:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721220864 00000100:00100000:0.0:1746126606.655711:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12932 00000100:00100000:0.0:1746126606.655717:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:31009:x1830945721220864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126606.655728:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126606.655740:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ce70 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.655758:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e825867611f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce1c expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.655764:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126606.655765:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126606.655768:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 32 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.655789:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e825867611f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1642495) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce1c expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.655797:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e825867611f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1642495) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce1c expref: 19 pid: 10890 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126606.655810:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721277696:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126606.655871:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.655899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.669166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.669201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.669239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.669566:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721221248 00000100:00100000:1.0:1746126606.669569:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721221248 00010000:00010000:1.0:1746126606.669584:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b391e00/0xb50e825867611efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdb3 expref: 21 pid: 8438 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.669601:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6735 00000100:00100000:1.0:1746126606.669606:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721221248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.669617:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.669633:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b391e00/0xb50e825867611efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdb3 expref: 21 pid: 8438 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.669641:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b391e00/0xb50e825867611efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdb3 expref: 21 pid: 8438 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.669654:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b391e00/0xb50e825867611efa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdb3 expref: 21 pid: 8438 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.669667:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.669668:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.669672:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 29 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.669679:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 29 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.669702:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 29 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.669713:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721277824:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126606.669760:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.671594:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721277824:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126606.671610:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.671645:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721221248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2038us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.671654:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6735 00000100:00100000:0.0:1746126606.679368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.683070:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721221504 00000100:00100000:1.0:1746126606.683081:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721221504 00002000:00100000:1.0:1746126606.683119:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e9880 x1830945721221504/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.683140:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9880 with x1830945721221504 ext(2097152->3145727) 00002000:00010000:1.0:1746126606.683145:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9880 00000100:00100000:1.0:1746126606.683176:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7419 00000100:00100000:1.0:1746126606.683183:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721221504:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126606.703415:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721222016 00000100:00100000:1.0:1746126606.703423:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721222016 00000100:00100000:1.0:1746126606.703459:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8802 00000100:00100000:1.0:1746126606.703466:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31011:x1830945721222016:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126606.703486:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.703500:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2800/0xb50e825867612051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ce7e expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126606.703553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126606.703579:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703589:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703598:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703608:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703614:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703618:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703692:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2e00/0xb50e825867612066 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703699:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2e00/0xb50e825867612066 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703704:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2e00/0xb50e825867612066 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126606.703711:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126606.703779:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703784:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703789:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703793:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecf2a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126606.703796:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703801:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703809:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126606.703812:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126606.703815:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703819:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2a00/0xb50e825867612058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703861:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703866:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703869:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703873:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecf2c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126606.703875:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703880:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703885:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5200) 00010000:00010000:1.0:1746126606.703887:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126606.703888:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703892:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2c00/0xb50e82586761205f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.703919:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2800/0xb50e825867612051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce7e expref: 22 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.703931:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecf2e00/0xb50e825867612066 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce7e expref: 21 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.703936:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126606.703938:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126606.703939:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecf2e00, rc 0) 00000100:00100000:1.0:1746126606.703975:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31011:x1830945721222016:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 510us (632us total) trans 8589942954 rc 0/0 00000100:00100000:1.0:1746126606.703981:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8802 00000100:00100000:1.0:1746126606.704301:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721221504:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21117us (24938us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126606.704309:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7419 00002000:00100000:1.0:1746126606.704315:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e9880 x1830945721221504/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.704323:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9880 with x1830945721221504 ext(2097152->3145727) 00002000:00010000:1.0:1746126606.704327:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9880 00000100:00100000:1.0:1746126606.704338:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721221760 00000100:00100000:1.0:1746126606.704341:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721221760 00002000:00100000:1.0:1746126606.704358:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3952640->3956735) req@ffff8801367ead80 x1830945721221760/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.704363:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ead80 with x1830945721221760 ext(3952640->3956735) 00002000:00010000:1.0:1746126606.704366:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ead80 00000100:00100000:1.0:1746126606.704375:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7420 00000100:00100000:1.0:1746126606.704380:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721221760:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126606.704499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126606.704712:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.704714:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.704720:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 30 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.704727:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 30 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.704751:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 30 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126606.704762:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721277952:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126606.704813:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.707888:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721221760:12345-192.168.203.2@tcp:3:cat.0 Request processed in 3500us (4327us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126606.707898:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7420 00002000:00100000:1.0:1746126606.707904:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3952640->3956735) req@ffff8801367ead80 x1830945721221760/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/4536 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.707912:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ead80 with x1830945721221760 ext(3952640->3956735) 00002000:00010000:1.0:1746126606.707916:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ead80 00000100:00100000:1.0:1746126606.707985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.715779:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721277952:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126606.715798:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126606.715875:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721222144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 11225us (11375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.715884:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6736 00000100:00100000:1.0:1746126606.736640:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721222656 00000100:00100000:1.0:1746126606.736644:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721222656 00002000:00100000:1.0:1746126606.736667:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093af7800 x1830945721222656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.736675:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7800 with x1830945721222656 ext(1048576->2097151) 00002000:00010000:1.0:1746126606.736679:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af7800 00000100:00100000:1.0:1746126606.736689:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721222784 00000100:00100000:1.0:1746126606.736691:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721222784 00002000:00100000:1.0:1746126606.736699:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093af7100 x1830945721222784/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.736705:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7100 with x1830945721222784 ext(1048576->2097151) 00002000:00010000:1.0:1746126606.736707:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af7100 00000100:00100000:1.0:1746126606.736715:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7421 00000100:00100000:1.0:1746126606.736720:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721222656:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126606.736972:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7422 00000100:00100000:0.0:1746126606.736978:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721222784:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126606.750660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.750931:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721223040 00000100:00100000:1.0:1746126606.750933:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721222656:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14210us (14655us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126606.750939:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721223040 00000100:00100000:1.0:1746126606.750944:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7421 00002000:00100000:1.0:1746126606.750953:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093af7800 x1830945721222656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126606.750962:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7800 with x1830945721222656 ext(1048576->2097151) 00002000:00010000:1.0:1746126606.750966:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af7800 00002000:00100000:3.0:1746126606.750967:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3268608->3956735) req@ffff8801367eaa00 x1830945721223040/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126606.750975:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eaa00 with x1830945721223040 ext(3268608->3956735) 00010000:00010000:3.0:1746126606.750983:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.750995:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00002000:00010000:3.0:1746126606.751007:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801367eaa00 00000100:00100000:3.0:1746126606.751020:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1684 00000100:00100000:3.0:1746126606.751026:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721223040:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126606.759439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.767553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.773071:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721223040:12345-192.168.203.2@tcp:4:cat.0 Request processed in 22037us (22409us total) trans 17179873074 rc 0/0 00000100:00100000:3.0:1746126606.773083:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1684 00002000:00100000:3.0:1746126606.773092:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3268608->3956735) req@ffff8801367eaa00 x1830945721223040/t17179873074(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/448 e 0 to 0 dl 1746126617 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126606.773100:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eaa00 with x1830945721223040 ext(3268608->3956735) 00010000:00010000:3.0:1746126606.773109:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.773120:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00002000:00010000:3.0:1746126606.773138:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801367eaa00 00000100:00100000:0.0:1746126606.783549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.783687:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721223552 00000100:00100000:3.0:1746126606.783698:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721223552 00010000:00010000:3.0:1746126606.783734:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.783788:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6737 00000100:00100000:3.0:1746126606.783795:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721223552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126606.783811:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746126606.785088:0:11130:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126605 -> 1746126606 00002000:00010000:3.0:1746126606.785093:0:11130:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126605 -> 1746126606 00010000:00010000:3.0:1746126606.785102:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.785114:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.785144:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b390400/0xb50e82586761203c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3268608->18446744073709551615] (req 3268608->3956735) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce69 expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.785170:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.785172:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.785178:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5a00/0xb50e825867612074 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce85 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.785184:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5a00/0xb50e825867612074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce85 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.785216:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5a00/0xb50e825867612074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce85 expref: 22 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.785225:0:11130:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5a00/0xb50e825867612074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce85 expref: 22 pid: 20294 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.785236:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721278336:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126606.785336:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.789518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.790180:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721278336:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126606.790195:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126606.790378:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721223552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6582us (6838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.790386:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6737 00000100:00100000:0.0:1746126606.793883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.801033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.801239:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721224192 00000100:00100000:3.0:1746126606.801247:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721224192 00002000:00100000:3.0:1746126606.801282:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e8000 x1830945721224192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126606.801291:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8000 with x1830945721224192 ext(2097152->3145727) 00002000:00010000:3.0:1746126606.801296:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e8000 00000100:00100000:3.0:1746126606.803225:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7424 00000100:00100000:3.0:1746126606.803239:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721224192:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:0.0:1746126606.806490:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746126606.812270:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721224192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9033us (11242us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126606.812277:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7424 00002000:00100000:3.0:1746126606.812283:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e8000 x1830945721224192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126606.812290:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8000 with x1830945721224192 ext(2097152->3145727) 00002000:00010000:3.0:1746126606.812293:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e8000 00000100:00100000:0.0:1746126606.820769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.825760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.826364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.827782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.831357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.831814:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721224832 00000100:00100000:3.0:1746126606.831820:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721224832 00000100:00100000:3.0:1746126606.832149:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12940 00000100:00100000:3.0:1746126606.832156:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721224832:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126606.832171:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126606.832185:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d925800/0xb50e82586761209e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ceaf expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126606.832224:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721278720:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126606.832680:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.835674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.835821:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721225088 00000100:00100000:3.0:1746126606.835846:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721225088 00002000:00100000:3.0:1746126606.835880:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3395584->3399679) req@ffff88012d919180 x1830945721225088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/0 e 0 to 0 dl 1746126617 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126606.835890:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919180 with x1830945721225088 ext(3395584->3399679) 00010000:00010000:3.0:1746126606.835898:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5e00/0xb50e82586761207b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3395584->18446744073709551615] (req 3395584->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce8c expref: 25 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.835910:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5e00/0xb50e82586761207b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3395584->18446744073709551615] (req 3395584->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce8c expref: 25 pid: 20294 timeout: 828 lvb_type: 0 00002000:00010000:3.0:1746126606.835916:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d919180 00000100:00100000:3.0:1746126606.835930:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1686 00000100:00100000:3.0:1746126606.835935:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721225088:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126606.836062:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721225088:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 126us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126606.836067:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1686 00002000:00100000:3.0:1746126606.836072:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3395584->3399679) req@ffff88012d919180 x1830945721225088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:367/0 lens 488/4536 e 0 to 0 dl 1746126617 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126606.836084:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919180 with x1830945721225088 ext(3395584->3399679) 00010000:00010000:3.0:1746126606.836088:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5e00/0xb50e82586761207b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3395584->18446744073709551615] (req 3395584->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce8c expref: 25 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.836096:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5e00/0xb50e82586761207b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3395584->18446744073709551615] (req 3395584->3919871) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce8c expref: 25 pid: 20294 timeout: 828 lvb_type: 0 00002000:00010000:3.0:1746126606.836101:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d919180 00002000:00010000:3.0:1746126606.836727:0:4642:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126605 -> 1746126606 00000100:00100000:3.0:1746126606.836738:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721278720:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126606.836758:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d925800/0xb50e82586761209e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceaf expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.836767:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d925800/0xb50e82586761209e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceaf expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.837499:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d925800, rc 0) 00000100:00100000:3.0:1746126606.837531:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721224832:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5375us (6179us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126606.837538:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12940 00000100:00100000:0.0:1746126606.839650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.839713:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721225216 00000100:00100000:3.0:1746126606.839720:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721225216 00000100:00100000:3.0:1746126606.839984:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12941 00000100:00100000:3.0:1746126606.839992:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721225216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126606.840005:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126606.840020:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d925600/0xb50e8258676120a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ceb6 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126606.840062:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721278848:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126606.840145:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.842537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.843267:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721278848:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126606.843290:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d925600/0xb50e8258676120a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceb6 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.843300:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d925600/0xb50e8258676120a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceb6 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.843308:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d925600, rc 0) 00000100:00100000:3.0:1746126606.843342:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721225216:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3352us (3698us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126606.843348:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12941 00000100:00100000:0.0:1746126606.850468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.850526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.850791:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721225984 00000100:00100000:3.0:1746126606.850800:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721225984 00000100:00100000:3.0:1746126606.850877:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3692 00000100:00100000:3.0:1746126606.850885:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31011:x1830945721225984:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126606.851588:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31011:x1830945721225984:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 702us (1059us total) trans 8589942955 rc 0/0 00000100:00100000:3.0:1746126606.851615:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3692 00000100:00100000:0.0:1746126606.867697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.873894:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721278976:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126606.873916:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.873974:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721226112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3649us (6287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.873985:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6739 00000100:00100000:0.0:1746126606.884766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.898487:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721226368:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13326us (13719us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126606.898499:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7425 00002000:00100000:0.0:1746126606.898511:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d91b800 x1830945721226368/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:367/0 lens 488/440 e 0 to 0 dl 1746126617 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126606.898521:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b800 with x1830945721226368 ext(3145728->4194303) 00002000:00010000:0.0:1746126606.898527:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91b800 00000100:00100000:0.0:1746126606.927702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.927801:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721226496 00000100:00100000:1.0:1746126606.927809:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721226496 00000100:00100000:1.0:1746126606.927899:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8803 00000100:00100000:1.0:1746126606.927906:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31016:x1830945721226496:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126606.927924:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.927939:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2600/0xb50e8258676120ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cebd expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.927983:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.927994:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928001:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928011:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928015:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928024:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928108:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928116:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390600/0xb50e825867611e83 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd5f expref: 234 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.928122:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.928158:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390600/0xb50e825867611e83 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd5f expref: 234 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.928168:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390600/0xb50e825867611e83 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd5f expref: 234 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.928179:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721279104:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.928247:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.930815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.930914:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721279104:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.930931:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:3.0:1746126606.930991:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721226752 00000100:00100000:3.0:1746126606.930995:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721226752 00000100:00100000:3.0:1746126606.931023:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3693 00000100:00100000:3.0:1746126606.931029:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+235:26823:x1830945721226752:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126606.932458:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+236:26823:x1830945721226752:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 1424us (1644us total) trans 8589942956 rc 0/0 00000100:00100000:3.0:1746126606.932466:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3693 00000100:00100000:0.0:1746126606.935631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126606.937240:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937248:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126606.937284:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126606.937287:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126606.937300:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937309:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937316:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937321:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937326:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937331:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afa2800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126606.937334:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937339:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937348:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126606.937350:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126606.937353:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937357:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2800/0xb50e8258676120b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937880:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937887:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937892:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937895:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afa2a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126606.937897:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937901:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937908:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8800) 00010000:00010000:1.0:1746126606.937909:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126606.937911:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937916:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e8258676120ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.937943:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2600/0xb50e8258676120ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cebd expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.937952:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cebd expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.937957:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126606.937958:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126606.937960:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afa2c00, rc 0) 00000100:00100000:1.0:1746126606.937999:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31016:x1830945721226496:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 10093us (10304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.938005:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8803 00000100:00100000:0.0:1746126606.944101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.944138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.944149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.944271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.944425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.944450:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227008 00000100:00100000:3.0:1746126606.944456:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227008 00000100:00100000:3.0:1746126606.944488:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227264 00000100:00100000:3.0:1746126606.944489:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227264 00000100:00100000:3.0:1746126606.944498:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227520 00000100:00100000:3.0:1746126606.944499:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227520 00000100:00100000:3.0:1746126606.944505:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227136 00000100:00100000:3.0:1746126606.944507:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227136 00000100:00100000:3.0:1746126606.944515:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12942 00000100:00100000:3.0:1746126606.944520:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721227008:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126606.944533:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126606.944546:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cec4 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.944563:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944565:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944572:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944584:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944592:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f551e00, rc 0) 00000100:00100000:3.0:1746126606.944625:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721227008:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 105us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.944631:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12942 00000100:00100000:3.0:1746126606.944642:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12943 00000100:00100000:3.0:1746126606.944645:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721227264:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126606.944650:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126606.944658:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ced2 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.944668:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944669:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944673:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944681:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944687:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f551600, rc 0) 00000100:00100000:3.0:1746126606.944699:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721227264:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 53us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.944703:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12943 00000100:00100000:3.0:1746126606.944711:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12944 00000100:00100000:3.0:1746126606.944714:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721227520:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126606.944719:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126606.944724:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f551800/0xb50e8258676120d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cee0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.944731:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944733:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944736:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f551800/0xb50e8258676120d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee0 expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944744:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f551800/0xb50e8258676120d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee0 expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944750:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f551800, rc 0) 00000100:00100000:3.0:1746126606.944759:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721227520:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 44us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.944763:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12944 00000100:00100000:3.0:1746126606.944769:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12945 00000100:00100000:3.0:1746126606.944772:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721227136:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126606.944776:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126606.944781:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cecb expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.944789:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944790:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.944793:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944801:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126606.944806:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f551a00, rc 0) 00000100:00100000:3.0:1746126606.944815:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721227136:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 42us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.944822:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12945 00000100:00100000:1.0:1746126606.945290:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227392 00000100:00100000:1.0:1746126606.945294:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227392 00000100:00100000:1.0:1746126606.945308:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12946 00000100:00100000:1.0:1746126606.945313:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721227392:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126606.945318:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.945325:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afa2e00/0xb50e8258676120e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ced9 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.945334:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.945336:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.945340:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afa2e00/0xb50e8258676120e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced9 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.945348:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afa2e00/0xb50e8258676120e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced9 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.945354:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afa2e00, rc 0) 00000100:00100000:1.0:1746126606.945371:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721227392:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 59us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.945376:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12946 00000100:00100000:0.0:1746126606.946188:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227648 00000100:00100000:0.0:1746126606.946192:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227648 00000100:00100000:0.0:1746126606.946210:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12947 00000100:00100000:0.0:1746126606.946224:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721227648:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126606.946230:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126606.946239:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cee7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.946249:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.946250:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.946254:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee7 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126606.946262:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee7 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126606.946269:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd5200, rc 0) 00000100:00100000:0.0:1746126606.946302:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721227648:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 77us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.946306:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12947 00000100:00100000:0.0:1746126606.950585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.951617:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721227904 00000100:00100000:1.0:1746126606.951624:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721227904 00000100:00100000:1.0:1746126606.951777:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8804 00000100:00100000:1.0:1746126606.951784:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31016:x1830945721227904:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126606.951801:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.951816:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3000/0xb50e8258676120f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ceee expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.951905:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.951917:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cebd expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.951923:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.951947:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cebd expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.951957:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2c00/0xb50e8258676120c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cebd expref: 8 pid: 20362 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.951967:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721279232:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.952039:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.954240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.954272:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721279232:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.954290:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.954627:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.954633:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126606.954645:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126606.954748:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3000/0xb50e8258676120f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceee expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.954771:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceee expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.954776:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126606.954778:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126606.954780:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afa3400, rc 0) 00000100:00100000:1.0:1746126606.954814:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31016:x1830945721227904:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3030us (4237us total) trans 8589942957 rc 0/0 00000100:00100000:1.0:1746126606.954820:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8804 00000100:00100000:0.0:1746126606.956487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.956568:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721228288 00000100:00100000:1.0:1746126606.956574:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721228288 00000100:00100000:1.0:1746126606.956658:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8805 00000100:00100000:1.0:1746126606.956666:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31016:x1830945721228288:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126606.956680:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.956682:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746126606.956698:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa3400/0xb50e8258676120f9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ceee expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.956710:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126606.956712:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126606.956720:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2600/0xb50e825867612107 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cef5 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.956785:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e82586761210e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.956799:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e82586761210e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126606.956806:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e82586761210e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126606.956814:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126606.957099:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2600/0xb50e825867612107 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cef5 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.957109:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2a00/0xb50e82586761210e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cef5 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.957115:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126606.957117:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126606.957119:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afa2a00, rc 0) 00000100:00100000:1.0:1746126606.957691:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31016:x1830945721228288:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 1025us (1207us total) trans 8589942958 rc 0/0 00000100:00100000:1.0:1746126606.957697:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8805 00000100:00100000:0.0:1746126606.960238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.960420:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721228416 00000100:00100000:1.0:1746126606.960427:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721228416 00000100:00100000:1.0:1746126606.960468:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8806 00000100:00100000:1.0:1746126606.960474:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31016:x1830945721228416:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126606.960490:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126606.960504:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2400/0xb50e82586761211c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cefc expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.960549:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2400/0xb50e82586761211c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cefc expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.960560:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2400/0xb50e82586761211c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cefc expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.960573:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126606.960576:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126606.960578:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afa2400, rc 0) 00000100:00100000:1.0:1746126606.960622:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31016:x1830945721228416:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 147us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.960627:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8806 00000100:00100000:0.0:1746126606.962704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.962738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.962762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.963928:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.964371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.964399:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721228544 00000100:00100000:1.0:1746126606.964407:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721228544 00000100:00100000:1.0:1746126606.964440:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721228672 00000100:00100000:1.0:1746126606.964442:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721228672 00000100:00100000:1.0:1746126606.964454:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721228800 00000100:00100000:1.0:1746126606.964455:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721228800 00000100:00100000:1.0:1746126606.964465:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721228928 00000100:00100000:1.0:1746126606.964466:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721228928 00000100:00100000:1.0:1746126606.964478:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12948 00000100:00100000:1.0:1746126606.964484:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721228544:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126606.964519:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964535:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964542:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964554:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 32 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964560:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.964562:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.964565:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964588:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 32 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964599:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 32 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.964610:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721279360:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.964675:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964683:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 9 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.964690:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721279488:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.964707:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964718:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 16 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.964725:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721279616:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.964753:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.964772:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12949 00000100:00100000:1.0:1746126606.964777:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721228672:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126606.964794:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a45ca200/0xb50e82586761212a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964804:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 32 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964811:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964817:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e4e00/0xb50e825867612090 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cea1 expref: 23 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964822:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.964823:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.964824:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45ca200/0xb50e82586761212a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964855:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4e4e00/0xb50e825867612090 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cea1 expref: 23 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964862:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4e4e00/0xb50e825867612090 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cea1 expref: 23 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.964871:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721279744:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.964892:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964898:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.964905:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721279872:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.964921:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 32 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964928:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 32 pid: 20294 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.964935:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721280000:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.964945:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126606.964957:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12950 00000100:00100000:1.0:1746126606.964961:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721228800:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126606.964974:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964986:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.964992:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.964998:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 32 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.965003:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.965004:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.965006:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.965017:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 32 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.965024:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 32 pid: 8438 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.965030:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721280128:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.965047:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126606.965054:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.965066:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721280256:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.965079:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.965086:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 23 pid: 4640 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.965092:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721280384:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.965100:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126606.966012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.975970:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.976003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.976022:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721229440 00000100:00100000:0.0:1746126606.976028:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721229440 00010000:00010000:0.0:1746126606.976056:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e4e00/0xb50e825867612090 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cea1 expref: 24 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.976076:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721229696 00000100:00100000:0.0:1746126606.976077:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721229696 00010000:00010000:0.0:1746126606.976085:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 33 pid: 20294 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126606.976098:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6742 00000100:00100000:0.0:1746126606.976104:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721229440:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.976114:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.976142:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e4e00/0xb50e825867612090 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cea1 expref: 24 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.976152:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4e4e00/0xb50e825867612090 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cea1 expref: 24 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.976171:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.976202:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721229440:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.976208:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6742 00000100:00100000:0.0:1746126606.976242:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6743 00000100:00100000:0.0:1746126606.976247:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721229696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.976253:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.976259:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 33 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.976267:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f01fa00/0xb50e825867612043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce70 expref: 33 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.976276:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.976287:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721229696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 40us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.976291:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6743 00000100:00100000:0.0:1746126606.976316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.976327:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721229312 00000100:00100000:0.0:1746126606.976329:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721229312 00010000:00010000:0.0:1746126606.976339:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 11 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.976351:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6744 00000100:00100000:0.0:1746126606.976354:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721229312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.976361:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.976371:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 11 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.976378:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 11 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.976389:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.976400:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721229312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 45us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.976404:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6744 00000100:00100000:0.0:1746126606.976440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.976447:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721229824 00000100:00100000:0.0:1746126606.976450:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721229824 00010000:00010000:0.0:1746126606.976458:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 33 pid: 8438 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126606.976469:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6745 00000100:00100000:0.0:1746126606.976473:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721229824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.976478:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.976485:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 33 pid: 8438 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.976493:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 33 pid: 8438 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.976502:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.976513:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721229824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.976518:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6745 00000100:00100000:0.0:1746126606.976542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.976550:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721229568 00000100:00100000:0.0:1746126606.976552:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721229568 00010000:00010000:0.0:1746126606.976560:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 12 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.976575:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6746 00000100:00100000:0.0:1746126606.976579:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721229568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.976585:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.976591:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 12 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.976598:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f551a00/0xb50e8258676120dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cecb expref: 12 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.976608:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.976671:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e4ba800/0xb50e825867611ea6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd7b expref: 32 pid: 8438 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.976685:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721280128:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.976700:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721279360:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.976708:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f551e00/0xb50e8258676120c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cec4 expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.976716:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721279488:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.977765:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721279616:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.977780:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.977817:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721280256:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126606.977875:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721280384:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126606.977889:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.981352:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.981358:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a45ca200/0xb50e82586761212a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.981370:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45ca200/0xb50e82586761212a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.981502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126606.981645:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.981678:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721229568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5097us (5135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.981687:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6746 00000100:00100000:3.0:1746126606.982209:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721280512:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126606.982217:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721280640:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126606.982222:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721280768:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126606.982238:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.982346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.982371:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721230208 00000100:00100000:0.0:1746126606.982376:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721230208 00010000:00010000:0.0:1746126606.982392:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 33 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.982420:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6747 00000100:00100000:0.0:1746126606.982425:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721230208:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.982434:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.982445:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 33 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.982454:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 33 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.982466:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009379b400/0xb50e825867611df7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd0b expref: 33 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.982476:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126606.982488:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721230208:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 64us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.982493:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6747 00000100:00100000:1.0:1746126606.982652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.984284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.984308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.984327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.984340:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721231488 00000100:00100000:0.0:1746126606.984344:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721231488 00000100:00100000:3.0:1746126606.984347:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721231360 00000100:00100000:3.0:1746126606.984355:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721231360 00010000:00010000:0.0:1746126606.984361:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5800/0xb50e825867612082 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce93 expref: 32 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.984373:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5400/0xb50e825867612089 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce9a expref: 32 pid: 4642 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126606.984376:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721231616 00000100:00100000:0.0:1746126606.984378:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721231616 00010000:00010000:0.0:1746126606.984385:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5000/0xb50e82586761204a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce77 expref: 23 pid: 20294 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.984391:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6750 00000100:00100000:3.0:1746126606.984396:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721231488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126606.984410:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126606.984423:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5800/0xb50e825867612082 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce93 expref: 32 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.984431:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5800/0xb50e825867612082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce93 expref: 32 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.984448:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126606.984471:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721231488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.985592:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6750 00000100:00100000:3.0:1746126606.985609:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6751 00000100:00100000:3.0:1746126606.985615:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721231360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126606.985624:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126606.985636:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5400/0xb50e825867612089 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce9a expref: 30 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.985644:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5400/0xb50e825867612089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce9a expref: 30 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.985657:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5400/0xb50e825867612089 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce9a expref: 30 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.985670:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126606.985692:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721231360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.985698:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6751 00000100:00100000:3.0:1746126606.985708:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6752 00000100:00100000:3.0:1746126606.985713:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721231616:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126606.985719:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126606.985726:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5000/0xb50e82586761204a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce77 expref: 23 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.985734:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5000/0xb50e82586761204a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce77 expref: 23 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.985745:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4e5000/0xb50e82586761204a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce77 expref: 23 pid: 20294 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746126606.985753:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126606.985767:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721231616:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 54us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.985772:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6752 00000100:00100000:1.0:1746126606.985908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.985932:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721231744 00000100:00100000:1.0:1746126606.985936:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721231744 00010000:00010000:1.0:1746126606.985951:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4200/0xb50e825867612035 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce62 expref: 32 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746126606.985964:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6753 00000100:00100000:1.0:1746126606.985968:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721231744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.985974:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.985985:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4200/0xb50e825867612035 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce62 expref: 32 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.985992:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4200/0xb50e825867612035 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce62 expref: 32 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.986003:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4200/0xb50e825867612035 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce62 expref: 32 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.986013:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.986028:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721231744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.986032:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6753 00000100:00100000:0.0:1746126606.986046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.986060:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721229952 00000100:00100000:1.0:1746126606.986063:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721229952 00010000:00010000:1.0:1746126606.986073:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.986074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126606.986084:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721230464 00000100:00100000:1.0:1746126606.986085:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721230464 00010000:00010000:1.0:1746126606.986092:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4800/0xb50e82586761202e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce5b expref: 31 pid: 4640 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.986092:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6754 00000100:00100000:0.0:1746126606.986098:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721229952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.986105:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126606.986106:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6755 00000100:00100000:1.0:1746126606.986110:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721230464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126606.986115:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.986117:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.986135:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4800/0xb50e82586761202e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce5b expref: 31 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.986135:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.986141:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4800/0xb50e82586761202e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce5b expref: 31 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.986147:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f551600/0xb50e8258676120cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ced2 expref: 10 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.986150:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4800/0xb50e82586761202e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce5b expref: 31 pid: 4640 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746126606.986155:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126606.986163:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.986164:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.986167:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126606.986170:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721229952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 73us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126606.986174:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126606.986175:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6754 00010000:00010000:1.0:1746126606.986191:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.986207:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721230464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.986212:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6755 00010000:00010000:3.0:1746126606.986359:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986367:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986384:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986390:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986396:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986402:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4e5e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126606.986405:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986411:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986424:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.986430:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e5e00/0xb50e825867612138 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126606.986489:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721228928:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 20998us (22562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126606.986496:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12951 00000100:00100000:0.0:1746126606.986635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.986676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.988460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126606.992268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.993232:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721230080 00000100:00100000:3.0:1746126606.993240:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721230080 00000100:00100000:0.0:1746126606.993257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126606.993269:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 15 pid: 20294 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746126606.993540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.993628:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721230592 00000100:00100000:3.0:1746126606.993631:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721230592 00000100:00100000:1.0:1746126606.993634:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721230976 00000100:00100000:1.0:1746126606.993638:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721230976 00010000:00010000:3.0:1746126606.993643:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867611f32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdcf expref: 30 pid: 8436 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.993646:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721231232 00000100:00100000:1.0:1746126606.993648:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721231232 00000100:00100000:0.0:1746126606.993653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.993661:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721231872 00010000:00010000:1.0:1746126606.993661:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee7 expref: 9 pid: 8436 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746126606.993663:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721231872 00010000:00010000:3.0:1746126606.993670:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4ba600/0xb50e825867611ffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce46 expref: 16 pid: 4642 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126606.993670:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6758 00000100:00100000:1.0:1746126606.993677:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6759 00000100:00100000:0.0:1746126606.993677:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721230080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126606.993682:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721230592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746126606.993685:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6760 00010000:00010000:1.0:1746126606.993688:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126606.993688:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126606.993689:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721231232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126606.993698:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.993703:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867611f32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdcf expref: 30 pid: 8436 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.993703:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 16 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746126606.993706:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee7 expref: 9 pid: 8436 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.993713:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867611f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdcf expref: 30 pid: 8436 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.993713:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 16 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746126606.993714:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee7 expref: 9 pid: 8436 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746126606.993730:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd5200/0xb50e8258676120eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cee7 expref: 9 pid: 8436 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746126606.993730:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867611f32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdcf expref: 30 pid: 8436 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126606.993730:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3200/0xb50e825867611dd4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccef expref: 16 pid: 20294 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746126606.993740:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.993740:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126606.993740:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.993741:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126606.993741:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126606.993745:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867612146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.993745:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.993751:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867612146 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.993751:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126606.993767:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126606.993773:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721230592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 91us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.993778:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6759 00000100:00100000:0.0:1746126606.993784:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721230080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 108us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126606.993789:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6758 00000100:00100000:1.0:1746126606.993792:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6761 00000100:00100000:1.0:1746126606.993795:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721231872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.993800:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.993805:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e4ba600/0xb50e825867611ffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce46 expref: 14 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.993811:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e4ba600/0xb50e825867611ffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce46 expref: 14 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.993818:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4ba600/0xb50e825867611ffd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ce46 expref: 14 pid: 4642 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.993837:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.993839:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.993841:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4400/0xb50e82586761213f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.993847:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4e4400/0xb50e82586761213f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.993916:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126606.993927:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126606.993967:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721231232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 276us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.993967:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721231872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 170us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.993972:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6761 00000100:00100000:3.0:1746126606.993975:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6760 00010000:00010000:1.0:1746126606.993987:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.993993:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994004:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994009:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994018:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994022:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009afa2000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126606.994024:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994029:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994041:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994046:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009afa2000/0xb50e825867612123 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.994078:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721228544:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 29594us (31378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.994084:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12948 00010000:00010000:1.0:1746126606.994106:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 22 pid: 4640 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126606.994119:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6762 00000100:00100000:1.0:1746126606.994133:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721230976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126606.994141:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126606.994149:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 22 pid: 4640 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.994157:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 22 pid: 4640 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.994167:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c40fa00/0xb50e825867611e98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd6d expref: 22 pid: 4640 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126606.994174:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.994176:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126606.994179:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994184:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994195:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126606.994204:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994210:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994221:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994227:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994233:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994887:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45cb000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126606.994891:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994897:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994911:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126606.994916:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a45cb000/0xb50e825867612131 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126606.994950:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721228800:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 29987us (32185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.994955:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12950 00000100:00100000:1.0:1746126606.994977:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721230976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 853us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126606.994982:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6762 00000100:00100000:0.0:1746126606.998966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126606.999062:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232128 00000100:00100000:3.0:1746126606.999070:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232128 00000100:00100000:3.0:1746126606.999116:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8807 00000100:00100000:3.0:1746126606.999123:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31016:x1830945721232128:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:3.0:1746126606.999169:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126606.999191:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa2400/0xb50e82586761211c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cefc expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999203:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126606.999207:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126606.999227:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126606.999237:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccbe expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999243:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5000/0xb50e825867611d95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cccc expref: 234 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999249:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4c00/0xb50e825867611d9c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccd3 expref: 20 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999255:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999260:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 234 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999265:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126606.999289:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 234 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999298:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 234 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.999311:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282048:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126606.999383:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999391:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 20 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.999398:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282176:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126606.999422:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4c00/0xb50e825867611d9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccd3 expref: 20 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999428:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4c00/0xb50e825867611d9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccd3 expref: 20 pid: 20362 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.999435:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282304:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126606.999454:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5000/0xb50e825867611d95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cccc expref: 234 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999461:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5000/0xb50e825867611d95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cccc expref: 234 pid: 14548 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.999468:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282432:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126606.999702:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccbe expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126606.999714:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccbe expref: 20 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126606.999721:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282560:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126606.999739:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800936090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.006391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.006641:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282048:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.006651:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282176:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.007196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.007542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.007603:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282304:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.007610:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282432:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.007883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.008196:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232384 00000100:00100000:1.0:1746126607.008202:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232384 00000100:00100000:0.0:1746126607.008423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.008435:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232256 00000100:00100000:0.0:1746126607.008437:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232256 00010000:00010000:0.0:1746126607.008458:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 235 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126607.008479:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232512 00000100:00100000:0.0:1746126607.008481:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232512 00010000:00010000:0.0:1746126607.008488:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a5000/0xb50e825867611d95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cccc expref: 236 pid: 14548 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126607.008495:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232640 00000100:00100000:0.0:1746126607.008497:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232640 00010000:00010000:0.0:1746126607.008504:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b1a4c00/0xb50e825867611d9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccd3 expref: 22 pid: 20362 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126607.008511:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232768 00000100:00100000:0.0:1746126607.008513:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232768 00010000:00010000:0.0:1746126607.008519:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccbe expref: 23 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746126607.008528:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6763 00000100:00100000:0.0:1746126607.008533:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:1963:x1830945721232256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.009684:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce18400/0xb50e825867611d87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ccbe expref: 20 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746126607.009695:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721282560:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.009719:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.009800:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.009806:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 234 pid: 15560 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126607.009817:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 234 pid: 15560 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126607.009877:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 19 pid: 15560 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746126607.009893:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6767 00000100:00100000:1.0:1746126607.009899:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721232384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.009905:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.009908:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 19 pid: 15560 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126607.009984:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01f600/0xb50e825867611f16 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cdba expref: 234 pid: 15560 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126607.010030:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 19 pid: 15560 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746126607.010044:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ee00/0xb50e825867611ec9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cd89 expref: 19 pid: 15560 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746126607.010096:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.010099:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.010105:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.010111:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126607.010179:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126607.010181:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.010203:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721232384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 305us (3818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.010208:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6767 00010000:00010000:0.0:1746126607.010447:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.010464:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:1963:x1830945721232256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1930us (3269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.010470:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6763 00010000:00010000:3.0:1746126607.010611:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126607.010617:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000040:00080000:3.0:1746126607.011070:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2563, 88 off217392 00000004:00080000:3.0:1746126607.011076:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728925248309ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.011107:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2668, 88 off226728 00000004:00080000:3.0:1746126607.011112:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728925284421ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.011164:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2669, 88 off226816 00000004:00080000:3.0:1746126607.011167:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728925340109ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.011179:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2564, 88 off217480 00000004:00080000:3.0:1746126607.011181:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728925354044ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.011187:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2565, 88 off217568 00000004:00080000:3.0:1746126607.011189:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728925361689ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.011195:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2670, 88 off226904 00000004:00080000:3.0:1746126607.011197:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728925369162ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.011205:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2671, 88 off226992 00000004:00080000:3.0:1746126607.011207:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728925379330ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.013751:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2566, 88 off217656 00000004:00080000:3.0:1746126607.013760:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728927931872ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.014054:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2672, 88 off227080 00000004:00080000:3.0:1746126607.014057:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728928229886ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.014071:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2567, 88 off217744 00000004:00080000:3.0:1746126607.014074:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728928246080ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.014080:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2673, 88 off227168 00000004:00080000:3.0:1746126607.014082:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728928254471ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.014092:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2568, 88 off217832 00000004:00080000:3.0:1746126607.014094:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728928267032ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.014101:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2674, 88 off227256 00000004:00080000:3.0:1746126607.014103:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728928275443ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.014113:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2569, 88 off217920 00000004:00080000:3.0:1746126607.014115:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728928288082ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126607.014122:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2675, 88 off227344 00000004:00080000:3.0:1746126607.014133:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728928305277ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.014145:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2676, 88 off227432 00000004:00080000:3.0:1746126607.014147:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728928319807ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126607.014156:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2570, 88 off218008 00000004:00080000:3.0:1746126607.014159:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728928331290ns, next at 687927188999ns, rc = 0 00000001:00080000:1.0:1746126607.048200:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942952 is committed 00000001:00080000:1.0:1746126607.048218:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942936 is committed 00000001:00080000:1.0:1746126607.048222:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942958 is committed 00000001:00080000:1.0:1746126607.048229:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942954 is committed 00000001:00080000:1.0:1746126607.048232:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942953 is committed 00000001:00080000:1.0:1746126607.048248:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942959 is committed 00000004:00080000:1.0:1746126607.048251:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1956 committed 00000004:00080000:1.0:1746126607.048258:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2059 committed 00000004:00080000:1.0:1746126607.048261:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2058 committed 00000004:00080000:1.0:1746126607.048263:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1955 committed 00000004:00080000:1.0:1746126607.048264:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2057 committed 00000004:00080000:1.0:1746126607.048265:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1954 committed 00000004:00080000:1.0:1746126607.048267:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2056 committed 00000004:00080000:1.0:1746126607.048268:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1953 committed 00000004:00080000:1.0:1746126607.048269:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2055 committed 00000004:00080000:1.0:1746126607.048270:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1952 committed 00000004:00080000:1.0:1746126607.048272:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2054 committed 00000004:00080000:1.0:1746126607.048273:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2053 committed 00000004:00080000:1.0:1746126607.048274:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1951 committed 00000004:00080000:1.0:1746126607.048275:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1950 committed 00000004:00080000:1.0:1746126607.048277:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2052 committed 00000004:00080000:1.0:1746126607.048278:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2051 committed 00000004:00080000:1.0:1746126607.048280:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1949 committed 00000001:00080000:1.0:1746126607.048283:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942956 is committed 00000001:00080000:1.0:1746126607.048287:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942955 is committed 00000004:00010000:3.0:1746126607.048520:0:15560:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e9fd880 reply state ffff88008fd1c400 transno 8589942959 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126607.048530:0:15560:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746126607.048604:0:15560:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746126607.048618:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31016:x1830945721232128:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 49491us (49654us total) trans 8589942959 rc 0/0 00000100:00100000:3.0:1746126607.048626:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8807 00000100:00100000:3.0:1746126607.048715:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.048755:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048788:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.048802:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048811:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.048823:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048860:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.048876:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048889:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746126607.048893:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721282688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.048907:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048917:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.048928:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048937:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.048948:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048957:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.048968:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.048982:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721282944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.048994:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049003:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.049013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049022:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.049033:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049041:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721284480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.049052:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049060:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1746126607.049063:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721282816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.049074:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049080:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.049091:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049098:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.049107:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049113:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721284352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.049134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.049152:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283072 00000100:00100000:3.0:1746126607.049157:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283072 00000100:00100000:3.0:1746126607.049179:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283584 00000100:00100000:3.0:1746126607.049181:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283584 00000100:00100000:3.0:1746126607.049187:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284096 00000100:00100000:3.0:1746126607.049189:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284096 00000100:00100000:3.0:1746126607.049197:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284608 00000100:00100000:3.0:1746126607.049198:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284608 00000100:00100000:3.0:1746126607.049204:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282688 00000100:00100000:3.0:1746126607.049205:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282688 00000100:00100000:3.0:1746126607.049210:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283200 00000100:00100000:3.0:1746126607.049211:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283200 00000100:00100000:3.0:1746126607.049217:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283712 00000100:00100000:3.0:1746126607.049218:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283712 00000100:00100000:3.0:1746126607.049225:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12954 00000100:00100000:3.0:1746126607.049229:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3296:x1830945721283072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.049375:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3296:x1830945721283072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (619us total) trans 21474840234 rc 0/0 00000100:00100000:3.0:1746126607.049381:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12954 00000100:00100000:3.0:1746126607.049389:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284224 00000100:00100000:3.0:1746126607.049391:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284224 00000100:00100000:3.0:1746126607.049398:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282944 00000100:00100000:3.0:1746126607.049400:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282944 00000100:00100000:3.0:1746126607.049406:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283456 00000100:00100000:3.0:1746126607.049407:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283456 00000100:00100000:3.0:1746126607.049413:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283968 00000100:00100000:3.0:1746126607.049414:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283968 00000100:00100000:3.0:1746126607.049420:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284480 00000100:00100000:3.0:1746126607.049421:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284480 00000100:00100000:3.0:1746126607.049426:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282816 00000100:00100000:3.0:1746126607.049427:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282816 00000100:00100000:3.0:1746126607.049432:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283328 00000100:00100000:3.0:1746126607.049434:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283328 00000100:00100000:3.0:1746126607.049439:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283840 00000100:00100000:3.0:1746126607.049441:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283840 00000100:00100000:3.0:1746126607.049445:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284352 00000100:00100000:3.0:1746126607.049447:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284352 00000100:00100000:3.0:1746126607.049454:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12955 00000100:00100000:3.0:1746126607.049458:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721283584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.049531:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830945721283584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (727us total) trans 21474840235 rc 0/0 00000100:00100000:3.0:1746126607.049536:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12955 00000100:00100000:3.0:1746126607.049545:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12956 00000100:00100000:3.0:1746126607.049550:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721284096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.049644:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830945721284096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (819us total) trans 17179873076 rc 0/0 00000100:00100000:3.0:1746126607.049649:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12956 00000100:00100000:3.0:1746126607.049657:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12957 00000100:00100000:3.0:1746126607.049661:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d44b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721284608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.049727:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d44b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830945721284608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (849us total) trans 17179873077 rc 0/0 00000100:00100000:3.0:1746126607.049732:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12957 00000100:00100000:3.0:1746126607.049821:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12958 00000100:00100000:3.0:1746126607.049847:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721282688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.049921:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830945721282688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (1013us total) trans 21474840236 rc 0/0 00000100:00100000:3.0:1746126607.049925:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12958 00000100:00100000:3.0:1746126607.049933:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12959 00000100:00100000:3.0:1746126607.049937:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721283200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.050002:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830945721283200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1072us total) trans 21474840237 rc 0/0 00000100:00100000:3.0:1746126607.050006:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12959 00000100:00100000:3.0:1746126607.050014:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12960 00000100:00100000:3.0:1746126607.050018:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721283712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.050091:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830945721283712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1140us total) trans 17179873078 rc 0/0 00000100:00100000:3.0:1746126607.050096:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12960 00000100:00100000:3.0:1746126607.050104:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12961 00000100:00100000:3.0:1746126607.050107:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721284224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126607.050184:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746126607.050187:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126607.050188:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746126607.050190:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126607.050191:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746126607.050209:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830945721284224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1240us total) trans 17179873079 rc 0/0 00000100:00100000:3.0:1746126607.050213:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12961 00000100:00100000:3.0:1746126607.050221:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12962 00000100:00100000:3.0:1746126607.050225:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3295:x1830945721282944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.050301:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3295:x1830945721282944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1306us total) trans 21474840238 rc 0/0 00000100:00100000:3.0:1746126607.050306:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12962 00000100:00100000:3.0:1746126607.050315:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12963 00000100:00100000:3.0:1746126607.050319:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3295:x1830945721283456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.050390:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3295:x1830945721283456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1375us total) trans 21474840239 rc 0/0 00000100:00100000:3.0:1746126607.050394:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12963 00000100:00100000:3.0:1746126607.050403:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12964 00000100:00100000:3.0:1746126607.050407:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3295:x1830945721283968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.050478:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3295:x1830945721283968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1443us total) trans 17179873080 rc 0/0 00000100:00100000:3.0:1746126607.050482:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12964 00000100:00100000:3.0:1746126607.050490:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12965 00000100:00100000:3.0:1746126607.050494:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3295:x1830945721284480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.050556:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3295:x1830945721284480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1502us total) trans 17179873081 rc 0/0 00000100:00100000:3.0:1746126607.050561:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12965 00000100:00100000:3.0:1746126607.050568:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12966 00000100:00100000:3.0:1746126607.050572:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3295:x1830945721282816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.050642:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3295:x1830945721282816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1566us total) trans 21474840240 rc 0/0 00000100:00100000:3.0:1746126607.050646:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12966 00000100:00100000:3.0:1746126607.050654:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12967 00000100:00100000:3.0:1746126607.050658:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3295:x1830945721283328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.050722:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3295:x1830945721283328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1629us total) trans 21474840241 rc 0/0 00000100:00100000:3.0:1746126607.050726:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12967 00000100:00100000:3.0:1746126607.050739:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12968 00000100:00100000:3.0:1746126607.050743:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3295:x1830945721283840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.050815:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3295:x1830945721283840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1706us total) trans 17179873082 rc 0/0 00000100:00100000:3.0:1746126607.050823:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12968 00000100:00100000:3.0:1746126607.050856:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12969 00000100:00100000:3.0:1746126607.050860:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3295:x1830945721284352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.050929:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3295:x1830945721284352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1804us total) trans 17179873083 rc 0/0 00000100:00100000:3.0:1746126607.050934:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12969 00000100:00080000:3.0:1746126607.050957:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746126607.050961:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746126607.050985:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56a00/2, rc 0, transno 21474840240 00000100:00100000:3.0:1746126607.050990:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721282816:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.050997:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f57b80/2, rc 0, transno 21474840241 00000100:00100000:3.0:1746126607.050999:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051006:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f137480/2, rc 0, transno 17179873082 00000100:00100000:3.0:1746126607.051013:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051020:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091da1f80/2, rc 0, transno 17179873083 00000100:00100000:3.0:1746126607.051023:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721284352:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051028:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55c00/2, rc 0, transno 21474840238 00000100:00100000:3.0:1746126607.051031:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721282944:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051036:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f57480/2, rc 0, transno 21474840239 00000100:00100000:3.0:1746126607.051038:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051044:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f137b80/2, rc 0, transno 17179873080 00000100:00100000:3.0:1746126607.051046:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721283968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051052:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091da0e00/2, rc 0, transno 17179873081 00000100:00100000:3.0:1746126607.051055:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721284480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051094:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54000/2, rc 0, transno 21474840236 00000100:00100000:3.0:1746126607.051097:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721282688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051103:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55f80/2, rc 0, transno 21474840237 00000100:00100000:3.0:1746126607.051105:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283200:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051110:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f136a00/2, rc 0, transno 17179873078 00000100:00100000:3.0:1746126607.051112:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051117:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f135500/2, rc 0, transno 17179873079 00000100:00100000:3.0:1746126607.051119:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051136:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56300/2, rc 0, transno 21474840234 00000100:00100000:3.0:1746126607.051139:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051144:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55880/2, rc 0, transno 21474840235 00000100:00100000:3.0:1746126607.051146:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721283584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.051152:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f136300/2, rc 0, transno 17179873076 00000100:00100000:3.0:1746126607.051154:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.051159:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091da1180/2, rc 0, transno 17179873077 00000100:00100000:3.0:1746126607.051160:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.051165:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746126607.051170:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.051189:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.051217:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284736 00000100:00100000:3.0:1746126607.051221:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284736 00000100:00100000:3.0:1746126607.051237:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12970 00000100:00100000:3.0:1746126607.051240:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3296:x1830945721284736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.051318:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721284736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (128us total) trans 17179873084 rc 0/0 00000100:00100000:3.0:1746126607.051323:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12970 00000004:00080000:3.0:1746126607.051341:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5c00/2, rc 0, transno 17179873084 00000100:00100000:3.0:1746126607.051343:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721284736:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746126607.052015:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.052024:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.052031:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.052036:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f551000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126607.052040:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.052046:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.052189:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.052192:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126607.052196:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126607.052201:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f551000/0xb50e82586761214d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126607.055231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.055300:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721232896 00000100:00100000:3.0:1746126607.055308:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721232896 00000100:00100000:3.0:1746126607.055714:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8808 00000100:00100000:3.0:1746126607.055723:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31016:x1830945721232896:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126607.055744:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.055760:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4200/0xb50e825867612154 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf03 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.055807:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4200/0xb50e825867612154 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf03 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.055819:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4200/0xb50e825867612154 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf03 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.057251:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.057255:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126607.057258:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e4200, rc 0) 00000100:00100000:3.0:1746126607.057401:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31016:x1830945721232896:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 1677us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.057408:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8808 00000100:00100000:0.0:1746126607.066054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.074285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.075860:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721233280 00000100:00100000:3.0:1746126607.075870:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721233280 00000100:00100000:3.0:1746126607.075917:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3694 00000100:00100000:3.0:1746126607.075924:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31016:x1830945721233280:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:3.0:1746126607.076106:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31016:x1830945721233280:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 182us (1827us total) trans 8589942960 rc 0/0 00000100:00100000:3.0:1746126607.076112:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3694 00000100:00100000:1.0:1746126607.081048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.081183:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721233536 00000100:00100000:0.0:1746126607.081190:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721233536 00000100:00100000:0.0:1746126607.081228:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3695 00000100:00100000:0.0:1746126607.081251:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31016:x1830945721233536:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:0.0:1746126607.081733:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31016:x1830945721233536:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 498us (690us total) trans 8589942961 rc 0/0 00000100:00100000:0.0:1746126607.081740:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3695 00000100:00100000:3.0:1746126607.130424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.130907:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721234304 00000100:00100000:1.0:1746126607.130915:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721234304 00000100:00100000:1.0:1746126607.130948:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3696 00000100:00100000:1.0:1746126607.130956:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31025:x1830945721234304:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126607.131104:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31025:x1830945721234304:12345-192.168.203.2@tcp:35:cat.0 Request processed in 148us (868us total) trans 8589942964 rc 0/0 00000100:00100000:1.0:1746126607.131110:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3696 00000100:00100000:0.0:1746126607.134097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.139367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.140992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.141013:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721235200 00000100:00100000:3.0:1746126607.141020:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721235200 00000100:00100000:0.0:1746126607.141035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.141061:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8812 00000100:00100000:3.0:1746126607.141068:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31023:x1830945721235200:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:0.0:1746126607.141076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126607.141090:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126607.141095:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721234688 00000100:00100000:0.0:1746126607.141098:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721234688 00010000:00010000:3.0:1746126607.141105:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bf800/0xb50e8258676121af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf26 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.141122:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12971 00000100:00100000:0.0:1746126607.141138:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721234688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.141145:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.141156:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd5a00/0xb50e8258676121b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf1f expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.141173:0:17475:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c709, atime: 0x6813c709, ctime: 0x6813c709, blocks: 0x7a1 00010000:00010000:0.0:1746126607.141184:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.141186:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.141193:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd5a00/0xb50e8258676121b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf1f expref: 14 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.141194:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141205:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edd5a00/0xb50e8258676121b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf1f expref: 14 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.141207:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141214:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141214:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd5a00, rc 0) 00010000:00010000:3.0:1746126607.141224:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141228:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141232:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126607.141249:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721234688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 112us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.141255:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12971 00000100:00100000:0.0:1746126607.141272:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721234816 00000100:00100000:0.0:1746126607.141274:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721234816 00010000:00010000:0.0:1746126607.141287:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e825867612193 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf11 expref: 12 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.141301:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126607.141302:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721234944 00000100:00100000:0.0:1746126607.141303:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721234944 00010000:00010000:3.0:1746126607.141307:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141311:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4200/0xb50e825867612154 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf03 expref: 9 pid: 15560 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.141312:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126607.141317:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:0.0:1746126607.141326:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6768 00000100:00100000:0.0:1746126607.141330:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721234816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.141338:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.141341:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e825867612193 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf11 expref: 12 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.141349:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e825867612193 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf11 expref: 13 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.141361:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.141365:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e8258676121a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.141371:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e8258676121a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.141375:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126607.141380:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141385:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126607.141389:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721234816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 58us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126607.141390:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141394:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5a9a000 already unused, calling callback (ffffffffa136e690) 00000100:00100000:0.0:1746126607.141394:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6768 00010000:00010000:3.0:1746126607.141396:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141401:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126607.141402:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6769 00010000:00010000:3.0:1746126607.141406:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:0.0:1746126607.141407:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721234944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.141408:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746126607.141410:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141413:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.141414:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a000/0xb50e8258676121cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141416:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4200/0xb50e825867612154 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf03 expref: 9 pid: 15560 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.141425:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141427:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4200/0xb50e825867612154 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf03 expref: 9 pid: 15560 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.141429:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141432:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141435:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.141436:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a53be400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.141437:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141437:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e8258676121a8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.141441:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141443:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e8258676121a8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.141445:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126607.141446:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126607.141447:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e8258676121a8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.141448:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141451:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be400/0xb50e8258676121bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126607.141458:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126607.141461:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141465:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141468:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126607.141469:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721234944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 61us (393us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126607.141471:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5a9a400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.141473:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126607.141473:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6769 00010000:00010000:3.0:1746126607.141477:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141481:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135613600) 00010000:00010000:3.0:1746126607.141483:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126607.141484:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141487:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a9a400/0xb50e8258676121c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.141509:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bf800/0xb50e8258676121af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf26 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.141514:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bf800/0xb50e8258676121af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf26 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.141520:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53bf800, rc 0) 00000100:00100000:3.0:1746126607.141541:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31023:x1830945721235200:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 475us (553us total) trans 8589942965 rc 301/301 00000100:00100000:3.0:1746126607.141546:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8812 00000100:00100000:0.0:1746126607.145217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.145237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.145248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.145260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.145281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.145299:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721235328 00000100:00100000:0.0:1746126607.145305:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721235328 00000100:00100000:0.0:1746126607.145333:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12972 00000100:00100000:0.0:1746126607.145340:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721235328:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.145352:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.145364:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf2d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.145380:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c70e, atime: 0x6813c70e, ctime: 0x6813c70e, blocks: 0x821 00010000:00010000:0.0:1746126607.145393:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145394:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145400:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf2d expref: 22 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145412:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf2d expref: 22 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145420:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd5000, rc 0) 00000100:00100000:0.0:1746126607.145452:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721235328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 113us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.145456:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12972 00000100:00100000:0.0:1746126607.145467:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721235456 00000100:00100000:0.0:1746126607.145469:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721235456 00000100:00100000:0.0:1746126607.145481:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721235584 00000100:00100000:0.0:1746126607.145482:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721235584 00000100:00100000:0.0:1746126607.145491:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721235712 00000100:00100000:0.0:1746126607.145492:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721235712 00000100:00100000:0.0:1746126607.145500:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721235840 00000100:00100000:0.0:1746126607.145501:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721235840 00000100:00100000:0.0:1746126607.145510:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12973 00000100:00100000:0.0:1746126607.145514:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721235456:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.145519:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.145526:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf34 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.145539:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c70d, atime: 0x6813c70a, ctime: 0x6813c70d, blocks: 0x81f 00010000:00010000:0.0:1746126607.145551:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145553:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145557:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145565:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145570:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1000, rc 0) 00000100:00100000:0.0:1746126607.145586:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721235456:12345-192.168.203.2@tcp:101:cat.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.145590:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12973 00000100:00100000:0.0:1746126607.145598:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12974 00000100:00100000:0.0:1746126607.145603:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721235584:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.145608:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.145616:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf3b expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.145626:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c70e, atime: 0x6813c70a, ctime: 0x6813c70e, blocks: 0x821 00010000:00010000:0.0:1746126607.145633:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145634:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145637:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145644:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145650:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1e00, rc 0) 00000100:00100000:0.0:1746126607.145663:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721235584:12345-192.168.203.2@tcp:101:cat.0 Request processed in 61us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.145668:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12974 00000100:00100000:0.0:1746126607.145676:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12975 00000100:00100000:0.0:1746126607.145681:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721235712:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.145686:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.145692:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf42 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.145701:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c70e, atime: 0x6813c70e, ctime: 0x6813c70d, blocks: 0x1641 00010000:00010000:0.0:1746126607.145707:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145709:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145712:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145719:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145725:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1400, rc 0) 00000100:00100000:0.0:1746126607.145737:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721235712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 57us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.145741:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12975 00000100:00100000:0.0:1746126607.145750:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12976 00000100:00100000:0.0:1746126607.145754:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721235840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.145760:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.145766:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b1800/0xb50e8258676121f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf49 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.145774:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c70e, atime: 0x6813c70e, ctime: 0x6813c70e, blocks: 0x1029 00010000:00010000:0.0:1746126607.145780:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145781:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.145785:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b1800/0xb50e8258676121f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf49 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145792:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b1800/0xb50e8258676121f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf49 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.145798:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1800, rc 0) 00000100:00100000:0.0:1746126607.145811:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721235840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 57us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.145816:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12976 00000100:00100000:1.0:1746126607.153119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.153492:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721236096 00000100:00100000:3.0:1746126607.153500:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721236096 00000100:00100000:3.0:1746126607.153530:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8813 00000100:00100000:3.0:1746126607.153537:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31028:x1830945721236096:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.153551:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.154134:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4e00/0xb50e8258676121fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf50 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.154215:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154226:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154235:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154245:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154250:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154255:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154334:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154343:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154348:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126607.154355:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126607.154443:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154449:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154456:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154460:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4e5600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.154462:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154467:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154475:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.154477:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746126607.154480:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154484:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e5600/0xb50e825867612211 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154493:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154496:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154500:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154503:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4e4600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.154504:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154508:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154516:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126607.154517:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126607.154519:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154522:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4600/0xb50e825867612203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154527:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154530:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154534:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154537:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4e4a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.154539:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154542:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154546:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135613c00) 00010000:00010000:3.0:1746126607.154547:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126607.154548:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154551:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4a00/0xb50e82586761220a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.154578:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4e00/0xb50e8258676121fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf50 expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.154585:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4e00/0xb50e8258676121fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf50 expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.154592:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e4e00, rc 0) 00000100:00100000:3.0:1746126607.156176:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31028:x1830945721236096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2638us (3388us total) trans 8589942967 rc 301/301 00000100:00100000:3.0:1746126607.156182:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8813 00000100:00100000:1.0:1746126607.168581:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721236480 00000100:00100000:1.0:1746126607.168590:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721236480 00000100:00100000:1.0:1746126607.168624:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3697 00000100:00100000:1.0:1746126607.168631:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:31028:x1830945721236480:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126607.168784:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:31028:x1830945721236480:12345-192.168.203.2@tcp:35:cat.0 Request processed in 153us (1300us total) trans 8589942968 rc 0/0 00000100:00100000:1.0:1746126607.168791:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3697 00000001:00080000:1.0:1746126607.177841:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942961 is committed 00000001:00080000:1.0:1746126607.177853:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942964 is committed 00000001:00080000:1.0:1746126607.177858:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942966 is committed 00000004:00080000:1.0:1746126607.177861:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1964 committed 00000004:00080000:1.0:1746126607.177867:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2068 committed 00000004:00080000:1.0:1746126607.177871:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2067 committed 00000004:00080000:1.0:1746126607.177874:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1963 committed 00000004:00080000:1.0:1746126607.177876:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2066 committed 00000004:00080000:1.0:1746126607.177878:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1962 committed 00000004:00080000:1.0:1746126607.177879:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2065 committed 00000004:00080000:1.0:1746126607.177881:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1961 committed 00000004:00080000:1.0:1746126607.177882:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2064 committed 00000004:00080000:1.0:1746126607.177883:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1960 committed 00000004:00080000:1.0:1746126607.177884:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2063 committed 00000004:00080000:1.0:1746126607.177886:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2062 committed 00000004:00080000:1.0:1746126607.177887:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1959 committed 00000004:00080000:1.0:1746126607.177888:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1958 committed 00000004:00080000:1.0:1746126607.177890:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2061 committed 00000004:00080000:1.0:1746126607.177891:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2060 committed 00000004:00080000:1.0:1746126607.177892:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1957 committed 00000001:00080000:1.0:1746126607.177899:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942965 is committed 00000100:00100000:3.0:1746126607.178559:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721285504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.178592:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.178607:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721286016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.178618:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.178631:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746126607.178635:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721285632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.178646:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.178655:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721286144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.178664:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.178682:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721285504 00000100:00100000:3.0:1746126607.178688:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721285504 00000100:00100000:3.0:1746126607.178709:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721286016 00000100:00100000:3.0:1746126607.178711:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721286016 00000100:00100000:3.0:1746126607.178719:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721285632 00000100:00100000:3.0:1746126607.178720:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721285632 00000100:00100000:3.0:1746126607.178728:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721286144 00000100:00100000:3.0:1746126607.178729:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721286144 00000100:00100000:3.0:1746126607.178739:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12977 00000100:00100000:3.0:1746126607.178745:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+71:3296:x1830945721285504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126607.178951:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746126607.178954:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126606 -> 1746126606 00002000:00010000:3.0:1746126607.178956:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126606 -> 1746126606 00002000:00010000:3.0:1746126607.178958:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126606 -> 1746126606 00002000:00010000:3.0:1746126607.178959:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746126607.179265:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721286656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126607.179293:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126607.179303:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721287168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126607.179312:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126607.179319:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746126607.179322:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721286528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126607.179332:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126607.179340:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721287040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126607.179352:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126607.180634:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b163100/2, rc 0, transno 21474840246 00000100:00100000:1.0:1746126607.180639:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721286656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.180674:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12991 00000100:00100000:3.0:1746126607.180681:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3297:x1830945721286528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126607.180694:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12992 00000100:00100000:3.0:1746126607.180698:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3297:x1830945721287040:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126607.180727:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4380/2, rc 0, transno 17179873087 00000100:00100000:3.0:1746126607.180734:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721285632:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.180742:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6680/2, rc 0, transno 17179873088 00000100:00100000:3.0:1746126607.180746:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721286144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126607.180751:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6a00/2, rc 0, transno 17179873086 00000100:00100000:3.0:1746126607.180753:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721286016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.180771:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3296:x1830945721285504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2026us (2179us total) trans 17179873085 rc 0/0 00000100:00100000:3.0:1746126607.180775:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12977 00000004:00080000:3.0:1746126607.180793:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6d80/2, rc 0, transno 17179873085 00000100:00100000:3.0:1746126607.180795:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721285504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126607.181193:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721287296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126607.181216:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126607.181273:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287296 00000100:00100000:3.0:1746126607.181277:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287296 00000100:00100000:3.0:1746126607.181294:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12993 00000100:00100000:3.0:1746126607.181298:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3294:x1830945721287296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126607.181400:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:3294:x1830945721287296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (182us total) trans 17179873093 rc 0/0 00000100:00100000:3.0:1746126607.181405:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12993 00000004:00080000:1.0:1746126607.181523:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134c3f800/2, rc 0, transno 17179873093 00000100:00100000:1.0:1746126607.181527:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721287296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126607.182050:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b162680/2, rc 0, transno 21474840247 00000100:00100000:0.0:1746126607.182054:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721287168:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126607.182330:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:3.0:1746126607.182333:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126606 -> 1746126606 00002000:00010000:3.0:1746126607.182335:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126606 -> 1746126606 00002000:00010000:3.0:1746126607.182336:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126605 -> 1746126605 00002000:00010000:3.0:1746126607.182338:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5697 -> 5697 00000100:00100000:3.0:1746126607.182360:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3297:x1830945721286528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1680us (3026us total) trans 21474840248 rc 0/0 00000100:00100000:3.0:1746126607.182365:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12991 00000100:00100000:3.0:1746126607.182440:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3297:x1830945721287040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1741us (3087us total) trans 21474840249 rc 0/0 00000100:00100000:3.0:1746126607.182444:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12992 00000100:00100000:1.0:1746126607.182526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.182573:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721236608 00000100:00100000:3.0:1746126607.182576:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721236608 00000100:00100000:3.0:1746126607.182594:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8815 00000100:00100000:3.0:1746126607.182599:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31028:x1830945721236608:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.182609:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.182620:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465e00/0xb50e825867612226 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf5e expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.182670:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.182681:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.182694:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126607.182710:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126607.182713:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126607.182723:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126607.182739:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465e00/0xb50e825867612226 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 228 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.182749:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 227 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.182755:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.182758:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126607.182760:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e465c00, rc 0) 00000100:00100000:3.0:1746126607.182796:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:31028:x1830945721236608:12345-192.168.203.2@tcp:101:cat.0 Request processed in 196us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.182801:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8815 00000004:00080000:0.0:1746126607.182961:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b160000/2, rc 0, transno 21474840248 00000100:00100000:0.0:1746126607.182966:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721286528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126607.182978:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b162d80/2, rc 0, transno 21474840249 00000100:00100000:0.0:1746126607.182981:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721287040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126607.194519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.194542:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721236736 00000100:00100000:1.0:1746126607.194548:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721236736 00000100:00100000:1.0:1746126607.194577:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3698 00000100:00100000:1.0:1746126607.194583:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31025:x1830945721236736:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:1.0:1746126607.194672:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31025:x1830945721236736:12345-192.168.203.2@tcp:49:cat.0 Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.194678:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3698 00000100:00100000:0.0:1746126607.194722:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721285120:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126607.194749:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e8258676121a1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf18 expref: 226 pid: 20362 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746126607.194764:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e8258676121a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf18 expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.194779:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba1200, rc 0) 00000100:00100000:0.0:1746126607.194798:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:31024:x1830945721234560:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 60252us (60708us total) trans 8589942966 rc 0/0 00000100:00100000:0.0:1746126607.194814:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8811 00000100:00100000:1.0:1746126607.196163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.196189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.196203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.196216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.196228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.196247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.196304:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721236864 00000100:00100000:0.0:1746126607.196309:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721236864 00000100:00100000:0.0:1746126607.196333:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721237120 00000100:00100000:0.0:1746126607.196334:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721237120 00000100:00100000:0.0:1746126607.196345:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721237376 00000100:00100000:0.0:1746126607.196346:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721237376 00000100:00100000:0.0:1746126607.196355:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721236992 00000100:00100000:0.0:1746126607.196356:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721236992 00000100:00100000:0.0:1746126607.196363:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721237248 00000100:00100000:0.0:1746126607.196365:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721237248 00000100:00100000:0.0:1746126607.196381:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721237504 00000100:00100000:0.0:1746126607.196382:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721237504 00000100:00100000:3.0:1746126607.196388:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12994 00000100:00100000:3.0:1746126607.196400:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d44b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721236864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.196411:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.196423:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf65 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.196440:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.196442:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.196449:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf65 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.196460:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf65 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.196467:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e464e00, rc 0) 00000100:00100000:3.0:1746126607.196495:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d44b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721236864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 100us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.196895:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12994 00000100:00100000:0.0:1746126607.196904:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12995 00000100:00100000:0.0:1746126607.196911:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721237120:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.196918:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.196927:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf73 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.196939:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.196941:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.196945:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 32 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.196956:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 32 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.196963:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35e00, rc 0) 00000100:00100000:3.0:1746126607.196981:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12996 00000100:00100000:0.0:1746126607.196982:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721237120:12345-192.168.203.2@tcp:101:cat.0 Request processed in 72us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.196986:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721237376:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126607.196987:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12995 00010000:00010000:3.0:1746126607.196992:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126607.196997:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12997 00010000:00010000:3.0:1746126607.196998:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf81 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.197002:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721236992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.197006:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.197007:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.197008:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.197013:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35400/0xb50e825867612249 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf6c expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.197015:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.197021:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.197022:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.197023:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.197026:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35400/0xb50e825867612249 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf6c expref: 32 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.197030:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e465e00, rc 0) 00010000:00010000:0.0:1746126607.197034:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35400/0xb50e825867612249 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf6c expref: 32 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.197040:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35400, rc 0) 00000100:00100000:3.0:1746126607.197046:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721237376:12345-192.168.203.2@tcp:101:cat.0 Request processed in 60us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.197054:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12996 00000100:00100000:0.0:1746126607.197055:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721236992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 53us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.197060:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12997 00000100:00100000:3.0:1746126607.197063:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12998 00000100:00100000:3.0:1746126607.197067:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721237248:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126607.197070:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12999 00010000:00010000:3.0:1746126607.197072:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126607.197075:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721237504:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.197078:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf7a expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.197080:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.197086:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.197086:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35800/0xb50e825867612257 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf88 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.197087:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.197091:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.197094:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.197096:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.197098:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.197100:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35800/0xb50e825867612257 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf88 expref: 32 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.197104:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b0e00, rc 0) 00010000:00010000:0.0:1746126607.197108:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35800/0xb50e825867612257 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf88 expref: 32 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.197114:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35800, rc 0) 00000100:00100000:3.0:1746126607.197118:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721237248:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.197132:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12998 00000100:00100000:0.0:1746126607.197140:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721237504:12345-192.168.203.2@tcp:101:cat.0 Request processed in 64us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.197145:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12999 00000001:00080000:3.0:1746126607.199052:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873056 is committed 00000001:00080000:3.0:1746126607.199081:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873008 is committed 00000001:00080000:3.0:1746126607.199087:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873064 is committed 00000001:00080000:3.0:1746126607.199110:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873051 is committed 00000001:00080000:3.0:1746126607.199120:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873030 is committed 00000001:00080000:3.0:1746126607.199150:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873075 is committed 00000001:00080000:3.0:1746126607.199164:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873069 is committed 00000001:00080000:3.0:1746126607.199170:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873050 is committed 00000001:00080000:3.0:1746126607.199186:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873084 is committed 00000001:00080000:3.0:1746126607.199200:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873074 is committed 00000100:00100000:0.0:1746126607.199463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.204211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.214917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.214956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.215371:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721237888 00000100:00100000:3.0:1746126607.215379:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721237888 00010000:00010000:3.0:1746126607.215407:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf2d expref: 8 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.215445:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6771 00000100:00100000:3.0:1746126607.215451:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721237888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.215466:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.215487:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf2d expref: 8 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.215497:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf2d expref: 8 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.215515:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd5000/0xb50e8258676121d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf2d expref: 8 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.215528:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.215529:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.215536:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.215542:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.215569:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.215580:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721287680:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126607.215637:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.217016:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721238144 00000100:00100000:0.0:1746126607.217023:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721238144 00002000:00100000:0.0:1746126607.217051:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012b161c00 x1830945721238144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.217061:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161c00 with x1830945721238144 ext(0->1048575) 00002000:00010000:0.0:1746126607.217065:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b161c00 00000100:00100000:0.0:1746126607.217079:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7426 00000100:00100000:0.0:1746126607.217085:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721238144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.224179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.224415:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721287680:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126607.224424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126607.224429:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.224470:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1964:x1830945721237888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9018us (9559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.224478:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6771 00000100:00100000:1.0:1746126607.225994:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721238400 00000100:00100000:1.0:1746126607.226001:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721238400 00002000:00100000:1.0:1746126607.226033:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009bb2d500 x1830945721238400/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.226042:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830945721238400 ext(0->1048575) 00002000:00010000:1.0:1746126607.226047:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:1.0:1746126607.226064:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721238656 00000100:00100000:1.0:1746126607.226066:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721238656 00002000:00100000:1.0:1746126607.226076:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1126400->1130495) req@ffff88009bb2f800 x1830945721238656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.226082:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f800 with x1830945721238656 ext(1126400->1130495) 00002000:00010000:1.0:1746126607.226085:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2f800 00000100:00100000:1.0:1746126607.226096:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7427 00000100:00100000:1.0:1746126607.226101:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721238400:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.226937:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7428 00000100:00100000:1.0:1746126607.226943:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721238656:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.227013:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721238656:12345-192.168.203.2@tcp:3:cat.0 Request processed in 70us (2590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126607.227018:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7428 00002000:00100000:1.0:1746126607.227023:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1126400->1130495) req@ffff88009bb2f800 x1830945721238656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.227030:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f800 with x1830945721238656 ext(1126400->1130495) 00002000:00010000:1.0:1746126607.227033:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2f800 00000100:00100000:0.0:1746126607.234083:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721238144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16990us (19118us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126607.234093:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7426 00002000:00100000:0.0:1746126607.234103:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012b161c00 x1830945721238144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.234112:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161c00 with x1830945721238144 ext(0->1048575) 00002000:00010000:0.0:1746126607.234116:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b161c00 00000100:00100000:3.0:1746126607.253271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.253562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.253589:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721238912 00000100:00100000:3.0:1746126607.253595:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721238912 00002000:00100000:3.0:1746126607.253632:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1273856->1277951) req@ffff880134c3c380 x1830945721238912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.253640:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3c380 with x1830945721238912 ext(1273856->1277951) 00002000:00010000:3.0:1746126607.253644:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3c380 00000100:00100000:3.0:1746126607.253657:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721239168 00000100:00100000:3.0:1746126607.253659:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721239168 00002000:00100000:3.0:1746126607.253667:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1126399) req@ffff880134c3d180 x1830945721239168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.253673:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d180 with x1830945721239168 ext(1048576->1126399) 00002000:00010000:3.0:1746126607.253675:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3d180 00000100:00100000:3.0:1746126607.253691:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7429 00000100:00100000:3.0:1746126607.253696:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721238912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.253848:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721238912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 150us (582us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126607.253853:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7429 00002000:00100000:3.0:1746126607.253858:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1273856->1277951) req@ffff880134c3c380 x1830945721238912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.253864:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3c380 with x1830945721238912 ext(1273856->1277951) 00002000:00010000:3.0:1746126607.253867:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3c380 00000100:00100000:3.0:1746126607.253878:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7430 00000100:00100000:3.0:1746126607.253883:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721239168:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.254845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.254869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.254882:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721239424 00000100:00100000:0.0:1746126607.254885:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721239424 00002000:00100000:0.0:1746126607.254901:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1277952->2097151) req@ffff88009bb2c700 x1830945721239424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.254908:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830945721239424 ext(1277952->2097151) 00002000:00010000:0.0:1746126607.254911:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2c700 00000100:00100000:0.0:1746126607.254919:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721239680 00000100:00100000:0.0:1746126607.254920:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721239680 00002000:00100000:0.0:1746126607.254927:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008e723480 x1830945721239680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.254932:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e723480 with x1830945721239680 ext(1048576->2097151) 00002000:00010000:0.0:1746126607.254935:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e723480 00000100:00100000:0.0:1746126607.254942:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7431 00000100:00100000:0.0:1746126607.254946:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721239424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.255008:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7432 00000100:00100000:0.0:1746126607.255012:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721239680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.255726:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721238400:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29622us (31550us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126607.255733:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7427 00002000:00100000:1.0:1746126607.255739:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009bb2d500 x1830945721238400/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.255746:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830945721238400 ext(0->1048575) 00002000:00010000:1.0:1746126607.255749:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:3.0:1746126607.261219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.261339:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721239168:12345-192.168.203.2@tcp:3:cat.0 Request processed in 7453us (7774us total) trans 0 rc 77824/77824 00000100:00100000:3.0:1746126607.261348:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7430 00002000:00100000:3.0:1746126607.261357:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1126399) req@ffff880134c3d180 x1830945721239168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 77824/77824 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.261365:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d180 with x1830945721239168 ext(1048576->1126399) 00002000:00010000:3.0:1746126607.261370:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3d180 00000100:00100000:1.0:1746126607.262213:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721239936 00000100:00100000:1.0:1746126607.262221:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721239936 00000100:00100000:1.0:1746126607.262254:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3699 00000100:00100000:1.0:1746126607.262261:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+225:31024:x1830945721239936:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126607.262402:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:31024:x1830945721239936:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 141us (1189us total) trans 8589942969 rc 0/0 00000100:00100000:1.0:1746126607.262408:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3699 00000100:00100000:3.0:1746126607.268666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.268691:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240192 00000100:00100000:3.0:1746126607.268698:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240192 00002000:00100000:3.0:1746126607.268729:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880134c3e300 x1830945721240192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.268738:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3e300 with x1830945721240192 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.268743:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3e300 00000100:00100000:3.0:1746126607.268760:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7433 00000100:00100000:3.0:1746126607.268766:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721240192:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.271226:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721239424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16273us (16376us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746126607.271236:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7431 00002000:00100000:1.0:1746126607.271245:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1277952->2097151) req@ffff88009bb2c700 x1830945721239424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.271253:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830945721239424 ext(1277952->2097151) 00002000:00010000:1.0:1746126607.271258:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2c700 00000100:00100000:3.0:1746126607.285335:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240320 00000100:00100000:3.0:1746126607.285344:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240320 00000100:00100000:3.0:1746126607.285386:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13001 00000100:00100000:3.0:1746126607.285392:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31025:x1830945721240320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.285405:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.285417:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf96 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.285440:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 21 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.285447:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126607.285448:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126607.285451:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 8 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.285472:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 21 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.285481:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 21 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.285490:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721287808:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.285554:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126607.292491:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721240192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23717us (23823us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126607.292503:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7433 00002000:00100000:1.0:1746126607.292514:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880134c3e300 x1830945721240192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.292522:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3e300 with x1830945721240192 ext(1048576->2097151) 00002000:00010000:1.0:1746126607.292528:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3e300 00000100:00100000:1.0:1746126607.297441:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721239680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 42419us (42562us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126607.297452:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7432 00002000:00100000:1.0:1746126607.297462:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008e723480 x1830945721239680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.297477:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e723480 with x1830945721239680 ext(1048576->2097151) 00002000:00010000:1.0:1746126607.297482:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e723480 00000100:00100000:0.0:1746126607.298766:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721287808:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.298788:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 8 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.299219:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cd600, rc 0) 00000100:00100000:0.0:1746126607.299254:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31025:x1830945721240320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 13861us (16294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.299261:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13001 00000100:00100000:1.0:1746126607.299289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.299306:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240448 00000100:00100000:1.0:1746126607.299311:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240448 00002000:00100000:1.0:1746126607.299340:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1126400->1277951) req@ffff8801367e8e00 x1830945721240448/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.299347:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8e00 with x1830945721240448 ext(1126400->1277951) 00010000:00010000:1.0:1746126607.299352:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 20 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.299362:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 20 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746126607.299368:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801367e8e00 00000100:00100000:1.0:1746126607.299381:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1689 00000100:00100000:1.0:1746126607.299387:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721240448:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126607.304078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.304329:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240576 00000100:00100000:0.0:1746126607.304336:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240576 00000100:00100000:0.0:1746126607.304366:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13002 00000100:00100000:0.0:1746126607.304373:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31023:x1830945721240576:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126607.304385:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.304399:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cf9d expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.304421:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.304428:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 21 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.304434:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.304435:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.304438:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 9 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.304462:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 21 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.304470:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 21 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.304481:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721287936:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.304546:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.304554:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.304561:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721288064:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.304579:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.307796:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721240448:12345-192.168.203.2@tcp:4:cat.0 Request processed in 8402us (8500us total) trans 17179873094 rc 0/0 00000100:00100000:0.0:1746126607.307806:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1689 00002000:00100000:0.0:1746126607.307814:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1126400->1277951) req@ffff8801367e8e00 x1830945721240448/t17179873094(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/448 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.307846:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8e00 with x1830945721240448 ext(1126400->1277951) 00010000:00010000:0.0:1746126607.307855:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 22 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.307865:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 22 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746126607.307871:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801367e8e00 00000100:00100000:0.0:1746126607.313364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.313389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.313459:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e722d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721287936:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.313468:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721288064:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.313490:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 9 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.313503:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35c00, rc 0) 00000100:00100000:0.0:1746126607.313537:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31023:x1830945721240576:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9164us (9465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.313544:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13002 00000100:00100000:0.0:1746126607.313569:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240832 00000100:00100000:0.0:1746126607.313573:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240832 00010000:00010000:0.0:1746126607.313589:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.313602:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240704 00000100:00100000:0.0:1746126607.313604:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240704 00010000:00010000:0.0:1746126607.313612:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 22 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.313624:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6772 00000100:00100000:0.0:1746126607.313629:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721240832:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.313639:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.313655:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.313663:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.313690:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b1000/0xb50e8258676121e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf34 expref: 9 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.313698:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.313712:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721240832:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.313717:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6772 00000100:00100000:0.0:1746126607.313725:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6773 00000100:00100000:0.0:1746126607.313729:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721240704:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.313734:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.313741:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 22 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.313752:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 22 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.313761:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb1000/0xb50e82586761225e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1277951) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf8f expref: 22 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.314027:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.314030:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.314036:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314044:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314066:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.314075:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721288192:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126607.314115:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.314158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.314223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.314257:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721240960 00000100:00100000:0.0:1746126607.314260:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721240960 00010000:00010000:0.0:1746126607.314273:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 22 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.314292:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6774 00000100:00100000:0.0:1746126607.314295:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721240960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.314301:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.314308:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 22 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.314316:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 22 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.314326:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e82586761223b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf73 expref: 22 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.314334:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.314335:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.314339:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314344:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314358:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.314364:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721288320:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126607.314383:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.314438:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721241088 00000100:00100000:0.0:1746126607.314441:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721241088 00000100:00100000:0.0:1746126607.314463:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8816 00000100:00100000:0.0:1746126607.314468:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31031:x1830945721241088:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126607.314481:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.314491:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093dfc400/0xb50e825867612273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfa4 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314526:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314535:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314543:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314554:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314559:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314564:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314637:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314645:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314650:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126607.314681:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126607.314684:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126607.314693:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314700:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314704:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314708:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314712:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314716:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec07c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126607.314720:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314724:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314731:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126607.314733:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126607.314736:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314739:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07c00/0xb50e82586761227a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314747:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314752:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314756:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314759:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec06a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126607.314761:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314766:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314770:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8aa00) 00010000:00010000:0.0:1746126607.314772:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126607.314774:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314778:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06a00/0xb50e825867612281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126607.314796:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093dfc400/0xb50e825867612273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314803:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.314808:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.314810:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126607.314812:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec06c00, rc 0) 00000100:00100000:0.0:1746126607.314851:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31031:x1830945721241088:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 382us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.314857:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8816 00000100:00100000:0.0:1746126607.320516:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e722300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721288192:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126607.320533:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.320572:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721240704:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6840us (7180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.320579:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6773 00000100:00100000:0.0:1746126607.320697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.320720:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d99500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721288320:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126607.320730:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.320746:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721240960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6450us (6589us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.320751:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6774 00000100:00100000:0.0:1746126607.320767:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721241216 00000100:00100000:0.0:1746126607.320772:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721241216 00000100:00100000:0.0:1746126607.320792:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13003 00000100:00100000:0.0:1746126607.320797:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31023:x1830945721241216:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126607.320809:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.320822:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfab expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.320863:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.320871:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 31 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.320882:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.320884:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.320886:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 17 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.320906:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 31 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.320916:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 31 pid: 4640 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.320927:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721288448:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.320982:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.320990:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.320996:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721288576:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.321011:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.325323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.325342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.326470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.326561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:3.0:1746126607.326608:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126607.326632:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13004 00000100:00100000:3.0:1746126607.326640:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1966:x1830945721241344:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126607.326652:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.326664:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cde00/0xb50e82586761229d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfb2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.326681:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.326683:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.326689:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cde00/0xb50e82586761229d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb2 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.326699:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cde00/0xb50e82586761229d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb2 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.326708:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cde00, rc 0) 00000100:00100000:1.0:1746126607.326787:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13006 00000100:00100000:1.0:1746126607.326797:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721241600:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126607.326803:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.326808:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e40d400/0xb50e8258676122a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfc0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126607.326850:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721288704:192.168.203.2@tcp:106: 00000100:00080000:3.0:1746126607.327294:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746126607.327304:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721241344:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 666us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.327309:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13004 00000100:00100000:1.0:1746126607.327457:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aace40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.327555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.327566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.327579:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721241856 00000100:00100000:0.0:1746126607.327579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.327583:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721241856 00000100:00100000:0.0:1746126607.327589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.327598:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721241984 00000100:00100000:0.0:1746126607.327599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.327600:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721241984 00000100:00100000:3.0:1746126607.327611:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13008 00000100:00100000:3.0:1746126607.327615:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721241856:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:0.0:1746126607.327619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126607.327621:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.327627:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfce expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.327634:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13009 00000100:00100000:0.0:1746126607.327640:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721241984:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126607.327641:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.327643:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.327646:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.327647:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.327652:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfd5 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.327656:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.327662:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cca00, rc 0) 00010000:00010000:0.0:1746126607.327662:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.327663:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.327667:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfd5 expref: 10 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.327675:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfd5 expref: 10 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.327682:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35e00, rc 0) 00000100:00100000:3.0:1746126607.327683:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721241856:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.327688:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13008 00000100:00100000:0.0:1746126607.327697:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721241984:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.327702:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721242240 00000100:00100000:0.0:1746126607.327702:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13009 00000100:00100000:3.0:1746126607.327705:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721242240 00000100:00100000:0.0:1746126607.327717:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721242496 00000100:00100000:0.0:1746126607.327720:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721242496 00002000:00100000:3.0:1746126607.327724:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880098d9a680 x1830945721242240/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.327731:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d9a680 with x1830945721242240 ext(2097152->3145727) 00002000:00100000:0.0:1746126607.327733:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880098d9b480 x1830945721242496/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746126607.327735:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098d9a680 00000100:00100000:3.0:1746126607.327744:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721242752 00000100:00100000:3.0:1746126607.327746:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721242752 00002000:00100000:0.0:1746126607.327746:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d9b480 with x1830945721242496 ext(3145728->4194303) 00002000:00010000:0.0:1746126607.327749:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098d9b480 00002000:00100000:3.0:1746126607.327755:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880098d98700 x1830945721242752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746126607.327759:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721243008 00002000:00100000:3.0:1746126607.327760:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d98700 with x1830945721242752 ext(2097152->3145727) 00000100:00100000:0.0:1746126607.327761:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721243008 00002000:00010000:3.0:1746126607.327762:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098d98700 00000100:00100000:3.0:1746126607.327770:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7434 00002000:00100000:0.0:1746126607.327772:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880098d9a300 x1830945721243008/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746126607.327774:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721242240:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:0.0:1746126607.327778:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d9a300 with x1830945721243008 ext(3145728->4194303) 00002000:00010000:0.0:1746126607.327780:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098d9a300 00000100:00100000:0.0:1746126607.327791:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7435 00000100:00100000:0.0:1746126607.327796:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721242496:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.328006:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7436 00000100:00100000:0.0:1746126607.328011:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721242752:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.329030:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7437 00000100:00100000:3.0:1746126607.329036:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721243008:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.335244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.335263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.335273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.335284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.335317:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721243264 00000100:00100000:1.0:1746126607.335323:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721243264 00002000:00100000:1.0:1746126607.335352:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9fea00 x1830945721243264/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.335360:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fea00 with x1830945721243264 ext(1048576->2097151) 00002000:00010000:1.0:1746126607.335365:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9fea00 00000100:00100000:1.0:1746126607.335377:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721243520 00000100:00100000:1.0:1746126607.335379:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721243520 00000100:00100000:3.0:1746126607.335382:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721243776 00000100:00100000:3.0:1746126607.335387:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721243776 00002000:00100000:1.0:1746126607.335389:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1851391) req@ffff88009e9fd180 x1830945721243520/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.335395:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fd180 with x1830945721243520 ext(1048576->1851391) 00002000:00010000:1.0:1746126607.335398:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9fd180 00002000:00100000:3.0:1746126607.335403:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e9ffb80 x1830945721243776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746126607.335409:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7438 00002000:00100000:3.0:1746126607.335410:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9ffb80 with x1830945721243776 ext(1048576->2097151) 00000100:00100000:1.0:1746126607.335415:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721243264:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:3.0:1746126607.335417:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 18 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.335428:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 18 pid: 4642 timeout: 829 lvb_type: 1 00002000:00010000:3.0:1746126607.335434:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9ffb80 00000100:00100000:3.0:1746126607.335684:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1690 00000100:00100000:3.0:1746126607.335691:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721243776:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126607.336180:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721243904 00000100:00100000:0.0:1746126607.336183:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721243904 00010000:00010000:0.0:1746126607.336199:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 36 pid: 4640 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.336214:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6775 00000100:00100000:0.0:1746126607.336219:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721243904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.336227:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.336237:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 36 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.336247:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 36 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.336266:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.336300:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721243904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 81us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.336305:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6775 00010000:00010000:0.0:1746126607.336398:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b0e00/0xb50e825867612250 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf7a expref: 35 pid: 4640 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.336412:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721288448:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.336422:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721288576:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.336442:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 18 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.336451:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35200, rc 0) 00000100:00100000:0.0:1746126607.336472:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31023:x1830945721241216:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15674us (15775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.336477:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13003 00002000:00010000:0.0:1746126607.338690:0:4642:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126605 -> 1746126607 00002000:00010000:0.0:1746126607.338694:0:4642:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126602 -> 1746126607 00002000:00010000:0.0:1746126607.338695:0:4642:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126605 -> 1746126607 00000100:00100000:0.0:1746126607.338708:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721288704:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126607.338732:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e40d400/0xb50e8258676122a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfc0 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.338743:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e40d400/0xb50e8258676122a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfc0 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.338751:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e40d400, rc 0) 00000100:00100000:0.0:1746126607.338789:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721241600:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 11994us (12320us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126607.338795:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13006 00000100:00100000:3.0:1746126607.343644:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721242240:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15860us (16055us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.343655:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7434 00002000:00100000:3.0:1746126607.343665:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880098d9a680 x1830945721242240/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.343674:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d9a680 with x1830945721242240 ext(2097152->3145727) 00002000:00010000:3.0:1746126607.343679:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098d9a680 00000100:00100000:0.0:1746126607.346267:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721242496:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18464us (18670us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126607.346277:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7435 00002000:00100000:0.0:1746126607.346286:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880098d9b480 x1830945721242496/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.346294:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d9b480 with x1830945721242496 ext(3145728->4194303) 00002000:00010000:0.0:1746126607.346299:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098d9b480 00000100:00100000:0.0:1746126607.349553:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721244160 00000100:00100000:0.0:1746126607.349561:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721244160 00000100:00100000:0.0:1746126607.349601:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8817 00000100:00100000:0.0:1746126607.349608:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31031:x1830945721244160:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126607.349624:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.349638:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099f8fc00/0xb50e8258676122c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfdc expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.349711:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.349722:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.349734:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.349739:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.349763:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.349772:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 8 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.349783:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721288832:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.349879:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.349886:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 225 pid: 14547 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.349894:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721288960:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.349913:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.350220:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721243008:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21182us (22599us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.350228:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7437 00002000:00100000:3.0:1746126607.350235:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880098d9a300 x1830945721243008/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.350242:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d9a300 with x1830945721243008 ext(3145728->4194303) 00002000:00010000:3.0:1746126607.350246:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098d9a300 00000100:00100000:0.0:1746126607.352095:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721288832:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.352106:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721288960:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.352134:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126607.353761:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721242752:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25745us (26156us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.353770:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7436 00002000:00100000:3.0:1746126607.353778:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880098d98700 x1830945721242752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.353786:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d98700 with x1830945721242752 ext(2097152->3145727) 00002000:00010000:3.0:1746126607.353791:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098d98700 00000100:00100000:0.0:1746126607.355521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.355605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.355644:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721244416 00000100:00100000:0.0:1746126607.355650:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721244416 00010000:00010000:0.0:1746126607.355671:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 226 pid: 14547 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.355686:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721244288 00000100:00100000:0.0:1746126607.355687:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721244288 00010000:00010000:0.0:1746126607.355694:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 9 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.355704:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6776 00000100:00100000:0.0:1746126607.355708:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+226:1964:x1830945721244416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.355716:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.355721:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 226 pid: 14547 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.355728:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 226 pid: 14547 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.355744:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e465c00/0xb50e82586761222d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf5e expref: 226 pid: 14547 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.355754:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.355758:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.355767:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.355771:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.355791:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+225:1964:x1830945721244416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.355796:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6776 00000100:00100000:0.0:1746126607.355844:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6777 00000100:00100000:0.0:1746126607.355849:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721244288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.355855:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.355858:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 9 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.355864:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 9 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.355874:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06c00/0xb50e825867612288 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfa4 expref: 9 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.355882:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.355885:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.355890:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.355896:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.355914:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.355928:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721244288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.355933:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6777 00010000:00010000:0.0:1746126607.355954:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126607.355960:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126607.355973:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126607.356077:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f8fc00/0xb50e8258676122c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfdc expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.356089:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfdc expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.356094:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126607.356096:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126607.356098:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d33f000, rc 0) 00000100:00100000:0.0:1746126607.356119:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31031:x1830945721244160:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6512us (8033us total) trans 8589942970 rc 0/0 00000100:00100000:0.0:1746126607.356138:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8817 00000100:00100000:3.0:1746126607.364190:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721243520:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 28377us (28918us total) trans 0 rc 802816/802816 00000100:00100000:3.0:1746126607.364200:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7439 00002000:00100000:3.0:1746126607.364209:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1851391) req@ffff88009e9fd180 x1830945721243520/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 802816/802816 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.364217:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fd180 with x1830945721243520 ext(1048576->1851391) 00002000:00010000:3.0:1746126607.364222:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9fd180 00000100:00100000:3.0:1746126607.373221:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721243776:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 37524us (37940us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.373232:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1690 00002000:00100000:3.0:1746126607.373243:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e9ffb80 x1830945721243776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.373252:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9ffb80 with x1830945721243776 ext(1048576->2097151) 00010000:00010000:3.0:1746126607.373261:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.373273:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00002000:00010000:3.0:1746126607.373279:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9ffb80 00000100:00100000:0.0:1746126607.373390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.373405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.373422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.373446:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721244672 00000100:00100000:0.0:1746126607.373449:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721244672 00000100:00100000:3.0:1746126607.373456:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721244800 00000100:00100000:3.0:1746126607.373458:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721244800 00000100:00100000:0.0:1746126607.373470:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13010 00000100:00100000:3.0:1746126607.373474:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13011 00000100:00100000:0.0:1746126607.373475:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721244672:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126607.373479:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721244800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.373485:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.373485:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.373495:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e8258676122dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cff1 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.373495:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e8258676122d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfea expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.373508:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.373516:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e8258676122dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cff1 expref: 32 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.373524:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e8258676122dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cff1 expref: 32 pid: 23766 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126607.373527:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721289088:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.373530:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cc400, rc 0) 00000100:00100000:3.0:1746126607.373550:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721244800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 70us (126us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.373555:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13011 00000100:00100000:0.0:1746126607.373564:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126607.375086:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721243264:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 39670us (39845us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126607.375093:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7438 00002000:00100000:1.0:1746126607.375098:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9fea00 x1830945721243264/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.375105:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fea00 with x1830945721243264 ext(1048576->2097151) 00002000:00010000:1.0:1746126607.375110:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9fea00 00000100:00100000:3.0:1746126607.376142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.376181:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721244928 00000100:00100000:3.0:1746126607.376186:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721244928 00000100:00100000:3.0:1746126607.376209:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8818 00000100:00100000:3.0:1746126607.376214:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31031:x1830945721244928:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126607.376226:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.376238:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd000/0xb50e8258676122ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cff8 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.376292:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.376301:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfdc expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.376306:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.376326:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfdc expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.376334:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfdc expref: 9 pid: 14548 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.376343:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721289216:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.376388:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.376427:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721289088:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.376445:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e8258676122d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfea expref: 22 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.376454:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e8258676122d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfea expref: 22 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.376461:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edef200, rc 0) 00000100:00100000:3.0:1746126607.376476:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721244672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3001us (3070us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.376481:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13010 00000100:00100000:3.0:1746126607.378573:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721289216:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.378588:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126607.382961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.383033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.383055:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721245056 00000100:00100000:3.0:1746126607.383061:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721245056 00010000:00010000:3.0:1746126607.383088:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33f000/0xb50e8258676122c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfdc expref: 10 pid: 14548 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.383108:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721245184 00000100:00100000:3.0:1746126607.383110:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721245184 00010000:00010000:3.0:1746126607.383120:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.383667:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6779 00000100:00100000:3.0:1746126607.383672:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721245184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.383681:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.383698:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.383705:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.383718:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b1e00/0xb50e8258676121e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf3b expref: 17 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.383728:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.383730:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.383735:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.383742:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.383766:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.383777:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721289344:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126607.386603:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09300 going to sleep for 11 seconds 00010000:00010000:3.0:1746126607.386632:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.386640:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126607.386676:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126607.386680:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126607.386691:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.386720:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd000/0xb50e8258676122ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cff8 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.386734:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e8258676122f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cff8 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.386741:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.386743:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126607.386745:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cc600, rc 0) 00000100:00100000:3.0:1746126607.386777:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31031:x1830945721244928:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 10562us (10636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.386783:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8818 00000100:00100000:0.0:1746126607.389531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.389562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.389582:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721245568 00000100:00100000:0.0:1746126607.389589:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721245568 00000100:00100000:0.0:1746126607.389619:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13013 00000100:00100000:0.0:1746126607.389626:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31025:x1830945721245568:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.389639:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.389652:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4cfff expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.389676:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 18 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.389683:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126607.389685:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126607.389687:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 18 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.389711:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 18 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.389724:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 18 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.389735:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721289472:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.389799:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a446c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126607.390044:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721245440 00000100:00100000:1.0:1746126607.390048:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721245440 00002000:00100000:1.0:1746126607.390078:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008e722a00 x1830945721245440/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.390086:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722a00 with x1830945721245440 ext(4194304->4976639) 00002000:00010000:1.0:1746126607.390089:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e722a00 00000100:00100000:1.0:1746126607.390100:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7440 00000100:00100000:1.0:1746126607.390105:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721245440:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.400117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.400165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.400676:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721289344:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126607.400688:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.400706:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721245184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 17035us (17674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.400794:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721289472:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126607.400811:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 18 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.400821:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edee200, rc 0) 00000100:00100000:1.0:1746126607.400864:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31025:x1830945721245568:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11239us (11301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.400871:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13013 00000100:00100000:0.0:1746126607.401162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.401231:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721245440:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11125us (11704us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126607.401238:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7440 00002000:00100000:1.0:1746126607.401245:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008e722a00 x1830945721245440/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.401253:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722a00 with x1830945721245440 ext(4194304->4976639) 00002000:00010000:1.0:1746126607.401257:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e722a00 00000100:00100000:1.0:1746126607.401269:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721246080 00000100:00100000:1.0:1746126607.401272:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721246080 00002000:00100000:1.0:1746126607.401287:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1531904->1535999) req@ffff88012b192680 x1830945721246080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.401293:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192680 with x1830945721246080 ext(1531904->1535999) 00010000:00010000:1.0:1746126607.401298:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 18 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.401310:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 18 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746126607.401316:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b192680 00000100:00100000:1.0:1746126607.401328:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1691 00000100:00100000:1.0:1746126607.401334:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721246080:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126607.401345:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6779 00000100:00100000:1.0:1746126607.401435:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721246080:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 101us (272us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126607.401440:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1691 00002000:00100000:1.0:1746126607.401445:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1531904->1535999) req@ffff88012b192680 x1830945721246080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.401452:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192680 with x1830945721246080 ext(1531904->1535999) 00010000:00010000:1.0:1746126607.401456:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 17 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.401464:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 17 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746126607.401473:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b192680 00000100:00100000:0.0:1746126607.408374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.408683:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721289600:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.408699:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0800/0xb50e8258676122ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d006 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.408713:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0800/0xb50e8258676122ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d006 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.408721:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d8e0800, rc 0) 00000100:00100000:1.0:1746126607.408787:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721246464 00000100:00100000:1.0:1746126607.408793:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721246464 00000100:00100000:1.0:1746126607.408858:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3700 00000100:00100000:1.0:1746126607.408866:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31023:x1830945721246464:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126607.409298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.409375:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721245696:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 8989us (9265us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.409380:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13014 00000100:00100000:1.0:1746126607.409520:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31023:x1830945721246464:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 655us (1152us total) trans 8589942971 rc 0/0 00000100:00100000:1.0:1746126607.409527:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3700 00000100:00100000:1.0:1746126607.409603:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721246592 00000100:00100000:1.0:1746126607.409607:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721246592 00002000:00100000:1.0:1746126607.409626:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1535999) req@ffff88012b193b80 x1830945721246592/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.409635:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b193b80 with x1830945721246592 ext(1048576->1535999) 00010000:00010000:1.0:1746126607.409642:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 9 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.409652:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 9 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746126607.409657:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b193b80 00000100:00100000:1.0:1746126607.409996:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1692 00000100:00100000:1.0:1746126607.410004:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721246592:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126607.412411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.413644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.413984:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721246848 00000100:00100000:3.0:1746126607.413989:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721246848 00000100:00100000:3.0:1746126607.414012:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13016 00000100:00100000:3.0:1746126607.414018:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721246848:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.414031:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.414045:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cda00/0xb50e82586761230d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d01b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.414084:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721289856:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126607.414152:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.414769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.414850:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721246720 00000100:00100000:3.0:1746126607.414853:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721246720 00000100:00100000:3.0:1746126607.414871:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13017 00000100:00100000:3.0:1746126607.414875:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721246720:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.414882:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.414891:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612329 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d014 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.414918:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721289984:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126607.414948:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.417728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.419284:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721289984:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.419308:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612329 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d014 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.419318:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612329 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d014 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.419327:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cdc00, rc 0) 00000100:00100000:3.0:1746126607.419738:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721246720:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4860us (4967us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.419745:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13017 00000100:00100000:3.0:1746126607.419780:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721289856:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.419793:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cda00/0xb50e82586761230d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d01b expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.419801:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cda00/0xb50e82586761230d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d01b expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.419808:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cda00, rc 0) 00000100:00100000:0.0:1746126607.420292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.420359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.420391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.420623:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721246848:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6605us (8216us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.420628:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13016 00000100:00100000:3.0:1746126607.420639:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13019 00000100:00100000:3.0:1746126607.420644:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721247744:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126607.420664:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd000/0xb50e825867612353 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.420673:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.420678:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126607.420680:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126607.420682:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd000/0xb50e825867612353 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.420695:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.420703:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.420711:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721290368:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.420741:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09300 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.420754:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13020 00000100:00100000:3.0:1746126607.420759:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721248000:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126607.420772:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.420782:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.420789:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.420794:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.420799:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.420800:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.420802:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.420815:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.420822:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 12 pid: 4640 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.420848:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721290496:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.420875:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126607.421398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.421438:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721247616 00000100:00100000:0.0:1746126607.421441:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721247616 00000100:00100000:0.0:1746126607.421460:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13021 00000100:00100000:0.0:1746126607.421466:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721247616:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126607.421480:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.421490:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.421497:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0c00/0xb50e8258676122e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfe3 expref: 20 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.422265:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 9 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.422270:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.422271:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.422273:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.422291:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 9 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.422298:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 9 pid: 23766 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.422306:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721291008:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.422331:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0c00/0xb50e8258676122e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfe3 expref: 20 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.422338:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0c00/0xb50e8258676122e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfe3 expref: 20 pid: 20294 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.422344:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721291136:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126607.422361:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 7 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.422368:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 7 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.422373:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721291264:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126607.422383:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.422414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.422454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.422483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126607.422616:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 8 pid: 10890 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.422629:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721290624:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.422664:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.422671:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 10 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.422677:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721291392:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.422698:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.422712:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721247872 00000100:00100000:3.0:1746126607.422715:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721247872 00000100:00100000:3.0:1746126607.422729:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721248128 00000100:00100000:3.0:1746126607.422731:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721248128 00000100:00100000:1.0:1746126607.422844:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13022 00000100:00100000:1.0:1746126607.422854:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721247872:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126607.422872:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.422880:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126607.422883:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 10 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.422887:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746126607.422889:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.422913:0:4642:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 10 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.422922:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.423349:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721248256 00000100:00100000:3.0:1746126607.423353:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721248256 00000100:00100000:1.0:1746126607.423363:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721246592:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 13360us (14065us total) trans 21474840250 rc 0/0 00010000:00010000:3.0:1746126607.423368:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e1800/0xb50e82586761231b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d022 expref: 10 pid: 14548 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746126607.423370:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1692 00002000:00100000:1.0:1746126607.423376:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1535999) req@ffff88012b193b80 x1830945721246592/t21474840250(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/448 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.423384:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b193b80 with x1830945721246592 ext(1048576->1535999) 00010000:00010000:1.0:1746126607.423388:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 11 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.423394:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6780 00010000:00010000:1.0:1746126607.423397:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 11 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.423399:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721248256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1746126607.423403:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b193b80 00010000:00010000:3.0:1746126607.423406:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.423410:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e1800/0xb50e82586761231b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d022 expref: 10 pid: 14548 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.423418:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e1800/0xb50e82586761231b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d022 expref: 10 pid: 14548 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.423432:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e1800/0xb50e82586761231b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d022 expref: 10 pid: 14548 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.423486:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.423491:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e87200/0xb50e825867612345 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.423497:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e87200/0xb50e825867612345 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.423502:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e87200/0xb50e825867612345 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126607.423515:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.423532:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721248256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 132us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.423537:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6780 00000100:00100000:3.0:1746126607.425526:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721290368:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.425541:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd000/0xb50e825867612353 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126607.425595:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721291008:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126607.425602:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721291136:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126607.425607:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721291264:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126607.425618:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.429152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.429188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.429353:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721248384 00000100:00100000:1.0:1746126607.429360:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721248384 00002000:00100000:1.0:1746126607.429402:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1851392->2097151) req@ffff880093df5880 x1830945721248384/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.429411:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5880 with x1830945721248384 ext(1851392->2097151) 00010000:00010000:1.0:1746126607.429418:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 8 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.429428:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 8 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746126607.429434:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093df5880 00000100:00100000:1.0:1746126607.429464:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1693 00000100:00100000:1.0:1746126607.429472:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721248384:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126607.429564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.431298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.431320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.431353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.431411:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721249536 00000100:00100000:1.0:1746126607.431416:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721249536 00010000:00010000:1.0:1746126607.431433:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 13 pid: 4640 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746126607.431450:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721249792 00000100:00100000:1.0:1746126607.431452:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721249792 00010000:00010000:1.0:1746126607.431462:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b1800/0xb50e8258676121f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf49 expref: 10 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746126607.431474:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6783 00000100:00100000:1.0:1746126607.431480:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721249536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.431486:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.431495:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 13 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.431503:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 13 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.431514:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e465e00/0xb50e825867612242 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf81 expref: 13 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.431560:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.431580:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721291648:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126607.431582:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+12:1964:x1830945721249536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 102us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.431587:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6783 00000100:00100000:3.0:1746126607.431588:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721291776:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.431593:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721291904:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.431605:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126607.431617:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721249664 00000100:00100000:1.0:1746126607.431619:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721249664 00010000:00010000:1.0:1746126607.431629:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfd5 expref: 11 pid: 17475 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746126607.431650:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6785 00000100:00100000:1.0:1746126607.431655:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721249664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.431661:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.431670:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfd5 expref: 11 pid: 17475 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.431683:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfd5 expref: 11 pid: 17475 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.431703:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676122b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfd5 expref: 11 pid: 17475 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.431712:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.431726:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721249664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.431731:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6785 00000100:00100000:1.0:1746126607.434860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.435159:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721248768 00000100:00100000:1.0:1746126607.435190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.435192:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721248768 00000100:00100000:1.0:1746126607.435204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435223:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435246:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.435262:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721249152 00000100:00100000:1.0:1746126607.435265:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721249152 00010000:00010000:1.0:1746126607.435284:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cd600/0xb50e825867612265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf96 expref: 9 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746126607.435301:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721249408 00000100:00100000:1.0:1746126607.435303:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721249408 00010000:00010000:1.0:1746126607.435313:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 10 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746126607.435320:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721248640 00010000:00010000:0.0:1746126607.435342:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 10 pid: 23766 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.435352:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721249280 00000100:00100000:0.0:1746126607.435354:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721249280 00010000:00010000:0.0:1746126607.435363:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 9 pid: 10890 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.435370:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250048 00000100:00100000:0.0:1746126607.435372:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250048 00010000:00010000:0.0:1746126607.435379:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e82586761228f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfab expref: 11 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.435387:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6787 00000100:00100000:0.0:1746126607.435390:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721249408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.435395:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.435405:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 11 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.435414:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 11 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.435430:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b1400/0xb50e8258676121ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf42 expref: 11 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.435442:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.435471:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721249408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 79us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.435490:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721248640 00010000:00010000:1.0:1746126607.435503:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf65 expref: 12 pid: 4640 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746126607.435870:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6787 00000100:00100000:1.0:1746126607.435892:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6788 00000100:00100000:1.0:1746126607.435899:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721248768:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.435905:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.435913:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 10 pid: 23766 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.435921:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 10 pid: 23766 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.435931:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f8fa00/0xb50e825867612296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfb9 expref: 10 pid: 23766 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.435939:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.435956:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721248768:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 58us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.435961:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6788 00000100:00100000:1.0:1746126607.435971:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6789 00000100:00100000:1.0:1746126607.435976:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721248896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126607.435976:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6790 00000100:00100000:0.0:1746126607.435981:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721249280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.435983:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.435987:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.435989:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0c00/0xb50e8258676122e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfe3 expref: 22 pid: 20294 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.435993:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 9 pid: 10890 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.435996:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0c00/0xb50e8258676122e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfe3 expref: 22 pid: 20294 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436003:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 9 pid: 10890 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.436007:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0c00/0xb50e8258676122e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfe3 expref: 22 pid: 20294 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436012:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cca00/0xb50e8258676122b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfce expref: 9 pid: 10890 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.436014:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.436015:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436018:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.436019:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436019:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436022:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436025:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436027:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436042:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126607.436044:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.436056:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721248896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 81us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.436056:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721249280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 75us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.436061:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6790 00000100:00100000:0.0:1746126607.436070:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6791 00000100:00100000:0.0:1746126607.436074:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721249920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.436080:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.436088:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a35800/0xb50e825867612257 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf88 expref: 21 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436094:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a35800/0xb50e825867612257 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf88 expref: 21 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436104:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35800/0xb50e825867612257 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf88 expref: 21 pid: 4642 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436113:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436114:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436116:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436131:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436143:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.436157:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721249920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.436161:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6791 00000100:00100000:0.0:1746126607.436170:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6793 00000100:00100000:0.0:1746126607.436174:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+12:1966:x1830945721248640:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126607.436179:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126607.436186:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf65 expref: 12 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436193:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf65 expref: 12 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436202:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e464e00/0xb50e825867612234 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf65 expref: 12 pid: 4640 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746126607.436213:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436214:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436216:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436221:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436232:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126607.436244:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+11:1966:x1830945721248640:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.436249:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6793 00010000:00010000:0.0:1746126607.436262:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436268:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436282:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126607.436288:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6789 00010000:00010000:0.0:1746126607.436288:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436293:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436302:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4cc000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126607.436305:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436311:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436319:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436321:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436324:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc000/0xb50e82586761235a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436327:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436337:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436342:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436347:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.436351:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb61000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126607.436353:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.436354:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721248000:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 15596us (15963us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126607.436359:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.436360:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13020 00010000:00010000:1.0:1746126607.436367:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.436370:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250304 00010000:00010000:1.0:1746126607.436371:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb61000/0xb50e825867612361 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.436372:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250304 00000100:00100000:0.0:1746126607.436386:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13024 00000100:00100000:0.0:1746126607.436389:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+11:31028:x1830945721250304:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:1.0:1746126607.436398:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721247616:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 14933us (15001us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126607.436398:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126607.436403:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13021 00010000:00010000:0.0:1746126607.436406:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e82586761237d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d030 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.436416:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c70e, atime: 0x6813c70e, ctime: 0x6813c70d, blocks: 0x163f 00010000:00010000:0.0:1746126607.436425:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436426:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.436430:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e82586761237d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d030 expref: 12 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436438:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e82586761237d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d030 expref: 12 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436445:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edef200, rc 0) 00000100:00100000:0.0:1746126607.436458:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+12:31028:x1830945721250304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 68us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.436463:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13024 00010000:00010000:0.0:1746126607.436476:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436482:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436492:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436497:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.436503:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437060:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437072:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437084:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437088:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437093:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437098:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0c9e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126607.437100:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437106:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437115:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.437120:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e82586761236f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.437179:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721248128:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 14043us (14724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.437185:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13023 00010000:00010000:0.0:1746126607.437660:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e86000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126607.437663:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.437670:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.437679:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.437684:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e86000/0xb50e82586761234c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126607.437725:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721247488:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 17223us (17432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.437731:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13018 00000100:00100000:0.0:1746126607.438331:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721248384:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 8860us (9185us total) trans 17179873095 rc 0/0 00000100:00100000:0.0:1746126607.438337:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1693 00002000:00100000:0.0:1746126607.438345:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1851392->2097151) req@ffff880093df5880 x1830945721248384/t17179873095(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/448 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.438352:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5880 with x1830945721248384 ext(1851392->2097151) 00010000:00010000:0.0:1746126607.438357:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 8 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.438365:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 8 pid: 20294 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746126607.438375:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093df5880 00000100:00100000:1.0:1746126607.442426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.442440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.444166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.444620:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250432 00000100:00100000:0.0:1746126607.444626:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250432 00000100:00100000:1.0:1746126607.444634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.444687:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250688 00000100:00100000:3.0:1746126607.444690:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250688 00000100:00100000:1.0:1746126607.444693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.444706:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250944 00000100:00100000:3.0:1746126607.444708:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250944 00000100:00100000:1.0:1746126607.444710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.444716:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250560 00000100:00100000:3.0:1746126607.444717:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250560 00000100:00100000:3.0:1746126607.444729:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721250816 00000100:00100000:3.0:1746126607.444730:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721250816 00000100:00100000:3.0:1746126607.444740:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13025 00000100:00100000:1.0:1746126607.444740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.444746:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+13:1966:x1830945721250432:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:1.0:1746126607.444757:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13026 00010000:00010000:3.0:1746126607.444759:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126607.444766:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721250688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126607.444772:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.444775:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d037 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.444779:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f131000/0xb50e82586761238b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d045 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126607.444792:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c709, atime: 0x6813c709, ctime: 0x6813c709, blocks: 0x7a1 00010000:00010000:3.0:1746126607.444800:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.444802:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.444808:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126607.444816:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721292160:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.444819:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.444841:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53bfa00, rc 0) 00000100:00100000:3.0:1746126607.444870:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+14:1966:x1830945721250432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 124us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.444875:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13025 00000100:00100000:1.0:1746126607.444880:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.444886:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13027 00000100:00100000:3.0:1746126607.444890:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721250944:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.444895:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.444902:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d053 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126607.444913:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c70e, atime: 0x6813c70e, ctime: 0x6813c70e, blocks: 0x1029 00010000:00010000:3.0:1746126607.444920:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.444922:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.444925:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d053 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.444933:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d053 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.444939:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cca00, rc 0) 00000100:00100000:3.0:1746126607.444957:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721250944:12345-192.168.203.2@tcp:101:cat.0 Request processed in 66us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.444957:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721251200 00000100:00100000:1.0:1746126607.444960:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721251200 00000100:00100000:3.0:1746126607.444961:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13027 00000100:00100000:3.0:1746126607.444970:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13028 00000100:00100000:3.0:1746126607.444974:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721250560:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.444979:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746126607.444982:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008e3aaa00 x1830945721251200/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746126607.444987:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d03e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746126607.444990:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aaa00 with x1830945721251200 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.444996:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c70e, atime: 0x6813c70e, ctime: 0x6813c70e, blocks: 0x821 00010000:00010000:1.0:1746126607.444996:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 8 pid: 4642 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.445004:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.445005:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.445005:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 8 pid: 4642 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.445008:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d03e expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746126607.445011:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e3aaa00 00010000:00010000:3.0:1746126607.445016:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d03e expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.445022:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cda00, rc 0) 00000100:00100000:1.0:1746126607.445027:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1694 00000100:00100000:1.0:1746126607.445032:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721251200:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126607.445035:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721250560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 61us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.445039:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13028 00000100:00100000:3.0:1746126607.445047:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13029 00000100:00100000:3.0:1746126607.445050:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+13:1966:x1830945721250816:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.445054:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.445059:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cdc00/0xb50e8258676123a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d04c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.445066:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.445072:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cdc00/0xb50e8258676123a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d04c expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.445078:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cdc00/0xb50e8258676123a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d04c expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.445085:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cdc00, rc 0) 00000100:00100000:3.0:1746126607.445096:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+13:1966:x1830945721250816:12345-192.168.203.2@tcp:101:cat.0 Request processed in 46us (402us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.445100:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13029 00010000:00010000:0.0:1746126607.447917:0:17475:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff88008e3a8e00 x1830945721292160) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746126607.447943:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35c00/0xb50e82586761226c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf9d expref: 7 pid: 20294 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746126607.447954:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721292160:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126607.447980:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f131000/0xb50e82586761238b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d045 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.447989:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f131000/0xb50e82586761238b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d045 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.448005:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f131000, rc 0) 00000100:00100000:0.0:1746126607.448047:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721250688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3283us (5604us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126607.448054:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13026 00000100:00100000:0.0:1746126607.452815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.452986:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721251584 00000100:00100000:1.0:1746126607.452993:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721251584 00002000:00100000:1.0:1746126607.453024:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff880093df4380 x1830945721251584/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.453032:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4380 with x1830945721251584 ext(4972544->4976639) 00002000:00010000:1.0:1746126607.453036:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df4380 00000100:00100000:1.0:1746126607.453062:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7441 00000100:00100000:1.0:1746126607.453068:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721251584:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.453199:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721251584:12345-192.168.203.2@tcp:3:cat.0 Request processed in 131us (392us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126607.453204:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7441 00002000:00100000:1.0:1746126607.453209:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff880093df4380 x1830945721251584/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.453220:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4380 with x1830945721251584 ext(4972544->4976639) 00002000:00010000:1.0:1746126607.453223:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df4380 00000100:00100000:0.0:1746126607.458352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.458452:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721251712 00000100:00100000:3.0:1746126607.458459:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721251712 00000100:00100000:3.0:1746126607.458495:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:3.0:1746126607.458501:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1965:x1830945721251712:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1746126607.458565:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1965:x1830945721251712:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.458570:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:0.0:1746126607.461693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.462557:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721252480 00000100:00100000:0.0:1746126607.462559:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721252480 00000100:00100000:0.0:1746126607.462572:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13032 00000100:00100000:0.0:1746126607.462575:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721252352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.462581:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.462588:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef65c00/0xb50e8258676123b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d076 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.462596:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.462603:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65c00/0xb50e8258676123b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d076 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.462609:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65c00/0xb50e8258676123b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d076 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.462619:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65c00, rc 0) 00000100:00100000:0.0:1746126607.462630:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721252352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 55us (196us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126607.462634:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13032 00000100:00100000:0.0:1746126607.462643:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13034 00000100:00100000:0.0:1746126607.462646:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721251968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.462650:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.462654:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d061 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.462662:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.462663:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.462667:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.462675:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.462681:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65800, rc 0) 00000100:00100000:0.0:1746126607.462692:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721251968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 45us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.464040:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13034 00000100:00100000:0.0:1746126607.464055:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13035 00000100:00100000:0.0:1746126607.464062:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721252224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.464070:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.464080:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d06f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126607.464097:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c70f, atime: 0x6813c70f, ctime: 0x6813c70f, blocks: 0x81f 00010000:00010000:0.0:1746126607.464105:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.464106:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.464110:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.464118:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.464140:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb60600, rc 0) 00000100:00100000:0.0:1746126607.464159:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721252224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 98us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.464163:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13035 00000100:00100000:0.0:1746126607.464172:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13036 00000100:00100000:0.0:1746126607.464176:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721252480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126607.464181:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126607.464187:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d07d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126607.464195:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.464196:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126607.464199:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.464206:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126607.464211:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb61200, rc 0) 00000100:00100000:0.0:1746126607.464222:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721252480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 46us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126607.464227:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13036 00000100:00100000:0.0:1746126607.465686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.465742:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721252736 00000100:00100000:3.0:1746126607.465749:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721252736 00010000:00010000:3.0:1746126607.465772:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 10 pid: 4642 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.465801:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6795 00000100:00100000:3.0:1746126607.465806:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721252736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.465816:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.465844:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 10 pid: 4642 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.465852:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 10 pid: 4642 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.465865:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008edee200/0xb50e8258676122f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cfff expref: 10 pid: 4642 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.466065:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.466067:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.466070:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.466077:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.466384:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.466413:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721252736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 607us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.466419:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6795 00000100:00100000:0.0:1746126607.466897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126607.466962:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.466973:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.466991:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.466997:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.467003:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.467009:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b896800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126607.467012:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.467019:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.467029:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.467035:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b896800/0xb50e825867612368 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126607.467083:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1964:x1830945721247872:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 44232us (44667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.467089:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13022 00000100:00100000:3.0:1746126607.467256:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721252864 00000100:00100000:3.0:1746126607.467260:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721252864 00010000:00010000:3.0:1746126607.467274:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d053 expref: 22 pid: 8437 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.467304:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6796 00000100:00100000:3.0:1746126607.467309:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721252864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.467319:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.469453:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d053 expref: 22 pid: 8437 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.469476:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d053 expref: 22 pid: 8437 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.469493:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cca00/0xb50e825867612392 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d053 expref: 22 pid: 8437 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746126607.469508:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.469510:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.469515:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.469521:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.469551:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.469562:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721292416:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126607.469655:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.474320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.474747:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721253120 00000100:00100000:3.0:1746126607.474752:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721253120 00002000:00100000:3.0:1746126607.474785:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880135ed3b80 x1830945721253120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.474793:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed3b80 with x1830945721253120 ext(2097152->3145727) 00002000:00010000:3.0:1746126607.474797:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ed3b80 00000100:00100000:3.0:1746126607.474817:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7442 00000100:00100000:3.0:1746126607.474822:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721253120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.477320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.478272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.483244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.483726:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721253888 00000100:00100000:1.0:1746126607.483733:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721253888 00000100:00100000:1.0:1746126607.483766:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3701 00000100:00100000:1.0:1746126607.483772:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31031:x1830945721253888:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1746126607.483949:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31031:x1830945721253888:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 177us (706us total) trans 8589942974 rc 0/0 00000100:00100000:1.0:1746126607.483955:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3701 00000100:00100000:0.0:1746126607.488159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.490449:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721253120:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15623us (16132us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.490457:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7442 00002000:00100000:3.0:1746126607.490465:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880135ed3b80 x1830945721253120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.490474:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed3b80 with x1830945721253120 ext(2097152->3145727) 00002000:00010000:3.0:1746126607.490479:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ed3b80 00000100:00100000:0.0:1746126607.500758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.500849:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721254400 00000100:00100000:1.0:1746126607.500856:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721254400 00000100:00100000:1.0:1746126607.501446:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13037 00000100:00100000:1.0:1746126607.501454:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31025:x1830945721254400:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126607.501469:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.501483:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d08b expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.501508:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.501516:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126607.501517:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126607.501520:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d08b expref: 10 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.501546:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.501561:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 20 pid: 17475 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746126607.501572:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721292544:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126607.501647:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801300d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.501859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.501903:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721254528 00000100:00100000:3.0:1746126607.501908:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721254528 00002000:00100000:3.0:1746126607.501934:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (4026368->4030463) req@ffff880092208000 x1830945721254528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.501941:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208000 with x1830945721254528 ext(4026368->4030463) 00010000:00010000:3.0:1746126607.501947:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.501956:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 829 lvb_type: 0 00002000:00010000:3.0:1746126607.501961:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092208000 00000100:00100000:3.0:1746126607.503035:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1695 00000100:00100000:3.0:1746126607.503049:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721254528:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126607.503223:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721254528:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 179us (1363us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126607.503235:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1695 00002000:00100000:3.0:1746126607.503241:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (4026368->4030463) req@ffff880092208000 x1830945721254528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.503249:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208000 with x1830945721254528 ext(4026368->4030463) 00010000:00010000:3.0:1746126607.503255:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.503272:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d8e0400/0xb50e8258676123a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d05a expref: 21 pid: 17475 timeout: 829 lvb_type: 0 00002000:00010000:3.0:1746126607.503277:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092208000 00000100:00100000:0.0:1746126607.506052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.507589:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721292544:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126607.507616:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d08b expref: 10 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.507627:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57e3a00, rc 0) 00000100:00100000:1.0:1746126607.509959:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31025:x1830945721254400:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8498us (9201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.509969:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13037 00000100:00100000:0.0:1746126607.510736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.511053:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721255040 00000100:00100000:3.0:1746126607.511061:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721255040 00000100:00100000:3.0:1746126607.511104:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3703 00000100:00100000:3.0:1746126607.511110:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31033:x1830945721255040:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126607.511274:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:31033:x1830945721255040:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 163us (539us total) trans 8589942976 rc 0/0 00000100:00100000:3.0:1746126607.511281:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3703 00000100:00100000:0.0:1746126607.521109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.532415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.532459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.532501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.533165:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7445 00000100:00100000:1.0:1746126607.533177:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721255680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.533471:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7446 00000100:00100000:3.0:1746126607.533477:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721255936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.547439:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721255936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13956us (14931us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.547446:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7446 00002000:00100000:3.0:1746126607.547452:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009220ad80 x1830945721255936/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.547459:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220ad80 with x1830945721255936 ext(3145728->4194303) 00002000:00010000:3.0:1746126607.547462:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009220ad80 00000100:00100000:1.0:1746126607.554268:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721255680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21087us (21799us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126607.554278:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7445 00002000:00100000:1.0:1746126607.554289:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009220b480 x1830945721255680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.554297:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b480 with x1830945721255680 ext(3145728->4194303) 00002000:00010000:1.0:1746126607.554302:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b480 00000100:00100000:0.0:1746126607.562295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.562935:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256064 00000100:00100000:1.0:1746126607.562943:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256064 00000100:00100000:1.0:1746126607.562985:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13038 00000100:00100000:1.0:1746126607.562991:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721256064:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126607.563005:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.563022:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2e00/0xb50e8258676123df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d092 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126607.563042:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c70f, atime: 0x6813c70a, ctime: 0x6813c70f, blocks: 0x81d 00010000:00010000:1.0:1746126607.563056:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.563058:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.563065:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2e00/0xb50e8258676123df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d092 expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.563078:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2e00/0xb50e8258676123df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d092 expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.563087:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57e2e00, rc 0) 00000100:00100000:1.0:1746126607.563137:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721256064:12345-192.168.203.2@tcp:101:cat.0 Request processed in 143us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.563143:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13038 00000100:00100000:0.0:1746126607.567332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.567590:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721256320 00000100:00100000:1.0:1746126607.567598:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721256320 00002000:00100000:1.0:1746126607.567634:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092209880 x1830945721256320/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126607.567644:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209880 with x1830945721256320 ext(4194304->4976639) 00002000:00010000:1.0:1746126607.567649:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092209880 00000100:00100000:1.0:1746126607.567676:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7447 00000100:00100000:1.0:1746126607.567683:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721256320:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.651612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.698135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.703084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.703139:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257088 00000100:00100000:1.0:1746126607.703146:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257088 00000100:00100000:1.0:1746126607.703188:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3704 00000100:00100000:1.0:1746126607.703193:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:31043:x1830945721257088:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126607.703499:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:31043:x1830945721257088:12345-192.168.203.2@tcp:35:cat.0 Request processed in 305us (421us total) trans 8589942979 rc 0/0 00000100:00100000:1.0:1746126607.703505:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3704 00000100:00100000:0.0:1746126607.705497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.705531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.705562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.706629:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257472 00000100:00100000:1.0:1746126607.706632:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257472 00000100:00100000:1.0:1746126607.706662:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13039 00000100:00100000:1.0:1746126607.706668:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d44b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721257216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126607.706681:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.706695:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0a7 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.706713:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.706715:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.706722:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a7 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.706735:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a7 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.706744:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57e2800, rc 0) 00000100:00100000:1.0:1746126607.706781:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d44b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721257216:12345-192.168.203.2@tcp:101:cat.0 Request processed in 113us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.706786:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13039 00000100:00100000:1.0:1746126607.706924:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13040 00000100:00100000:1.0:1746126607.706930:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721257344:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126607.706937:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.706945:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2c00/0xb50e825867612433 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0ae expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.706956:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.706957:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.706960:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2c00/0xb50e825867612433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ae expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.706968:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2c00/0xb50e825867612433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ae expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.706975:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57e2c00, rc 0) 00000100:00100000:1.0:1746126607.706989:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+14:1965:x1830945721257344:12345-192.168.203.2@tcp:101:cat.0 Request processed in 60us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.706993:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13040 00000100:00100000:1.0:1746126607.707002:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13041 00000100:00100000:1.0:1746126607.707007:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721257472:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126607.707011:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.707017:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0b5 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.707025:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.707026:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.707029:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0b5 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.707035:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0b5 expref: 24 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126607.707041:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57e3200, rc 0) 00000100:00100000:1.0:1746126607.707050:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721257472:12345-192.168.203.2@tcp:101:cat.0 Request processed in 44us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.707054:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13041 00000100:00100000:0.0:1746126607.718946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.718981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.719005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.719062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.719151:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257984 00000100:00100000:3.0:1746126607.719160:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257984 00002000:00100000:3.0:1746126607.719193:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009220a680 x1830945721257984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.719202:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220a680 with x1830945721257984 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.719206:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220a680 00000100:00100000:3.0:1746126607.719220:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721257728 00000100:00100000:3.0:1746126607.719222:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721257728 00002000:00100000:3.0:1746126607.719233:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092209c00 x1830945721257728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.719239:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209c00 with x1830945721257728 ext(0->1048575) 00002000:00010000:3.0:1746126607.719242:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092209c00 00000100:00100000:3.0:1746126607.719263:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721258240 00000100:00100000:3.0:1746126607.719265:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721258240 00002000:00100000:3.0:1746126607.719275:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880092208700 x1830945721258240/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.719281:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208700 with x1830945721258240 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.719284:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092208700 00000100:00100000:3.0:1746126607.719297:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721258496 00000100:00100000:3.0:1746126607.719299:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721258496 00002000:00100000:3.0:1746126607.719309:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800924c6300 x1830945721258496/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.719315:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6300 with x1830945721258496 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.719317:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c6300 00000100:00100000:3.0:1746126607.719328:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7448 00000100:00100000:3.0:1746126607.719333:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721257984:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.720592:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7449 00000100:00100000:3.0:1746126607.720598:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721257728:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.721434:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7450 00000100:00100000:1.0:1746126607.721446:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721258240:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.736202:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721257984:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16859us (17255us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.736212:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7448 00002000:00100000:3.0:1746126607.736222:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009220a680 x1830945721257984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.736230:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220a680 with x1830945721257984 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.736234:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220a680 00000100:00100000:0.0:1746126607.752940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.753246:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721258880 00000100:00100000:1.0:1746126607.753254:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721258880 00000100:00100000:3.0:1746126607.754256:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721258752 00000100:00100000:3.0:1746126607.754261:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721258752 00000100:00100000:3.0:1746126607.754298:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8824 00000100:00100000:3.0:1746126607.754306:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+230:31045:x1830945721258752:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126607.754324:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.754338:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd600/0xb50e825867612441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0bc expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754410:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.754422:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84800/0xb50e8258676123fb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d099 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754429:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85000/0xb50e82586761241e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a0 expref: 231 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754434:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.754459:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85000/0xb50e82586761241e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a0 expref: 231 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754470:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85000/0xb50e82586761241e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a0 expref: 231 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.754480:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721292800:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.754565:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84800/0xb50e8258676123fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d099 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754573:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84800/0xb50e8258676123fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d099 expref: 10 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.754580:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721292928:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.754597:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.754851:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13042 00000100:00100000:3.0:1746126607.754857:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31040:x1830945721258880:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126607.754865:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.754874:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e82586761244f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0c3 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754887:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2e00/0xb50e8258676123df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d092 expref: 11 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.754894:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2c00/0xb50e825867612433 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ae expref: 15 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.754899:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.754902:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.754904:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e82586761244f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1253376->1966079] (req 1253376->1966079) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0c3 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.754917:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2c00/0xb50e825867612433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ae expref: 15 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.754924:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2c00/0xb50e825867612433 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ae expref: 15 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.754931:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721293056:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.757414:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2e00/0xb50e8258676123df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d092 expref: 11 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.757437:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57e2e00/0xb50e8258676123df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d092 expref: 11 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.757451:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721293184:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126607.757897:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721292800:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126607.757907:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721292928:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126607.757923:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:3.0:1746126607.757999:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.761547:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721293056:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.761556:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721293184:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.761575:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e82586761244f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1253376->1966079] (req 1253376->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0c3 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.761586:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cc400, rc 0) 00000100:00100000:3.0:1746126607.761604:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31040:x1830945721258880:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6747us (8706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.761611:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13042 00000100:00100000:3.0:1746126607.761647:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6799 00000100:00100000:3.0:1746126607.761657:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721259008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.761664:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.761668:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84800/0xb50e8258676123fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d099 expref: 11 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.761675:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84800/0xb50e8258676123fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d099 expref: 11 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.761685:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84800/0xb50e8258676123fb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d099 expref: 11 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.761696:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.761699:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.761958:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.761965:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.761981:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.761996:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721259008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 343us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.762001:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6799 00010000:00010000:3.0:1746126607.762048:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.762055:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126607.762068:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126607.762178:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd600/0xb50e825867612441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 232 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.762187:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 231 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.762193:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.762195:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126607.762196:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cce00, rc 0) 00000100:00100000:3.0:1746126607.762216:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+231:31045:x1830945721258752:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7912us (9278us total) trans 8589942980 rc 0/0 00000100:00100000:3.0:1746126607.762221:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8824 00000100:00100000:0.0:1746126607.764541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.769939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.770173:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721259648 00000100:00100000:3.0:1746126607.770182:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721259648 00002000:00100000:3.0:1746126607.770217:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31f:0x0] (1253376->1257471) req@ffff8800924c4700 x1830945721259648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.770225:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4700 with x1830945721259648 ext(1253376->1257471) 00002000:00010000:3.0:1746126607.770229:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c4700 00000100:00100000:3.0:1746126607.770242:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7452 00000100:00100000:3.0:1746126607.770248:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721259648:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126607.770361:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721259648:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 113us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126607.770369:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7452 00002000:00100000:3.0:1746126607.770374:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31f:0x0] (1253376->1257471) req@ffff8800924c4700 x1830945721259648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.770380:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4700 with x1830945721259648 ext(1253376->1257471) 00002000:00010000:3.0:1746126607.770382:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c4700 00000100:00100000:0.0:1746126607.778623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.778694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.778916:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721259776 00000100:00100000:3.0:1746126607.778920:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721259776 00000100:00100000:3.0:1746126607.778949:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13043 00000100:00100000:3.0:1746126607.778953:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+13:31043:x1830945721259776:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.778961:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.778973:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd800/0xb50e82586761245d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0ca expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.778992:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e82586761244f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0c3 expref: 10 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.779305:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126607.779307:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126607.779311:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd800/0xb50e82586761245d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ca expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.779336:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e82586761244f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1966079) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0c3 expref: 10 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.779346:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cc400/0xb50e82586761244f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0c3 expref: 10 pid: 23766 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.779362:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721293440:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.780266:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.785635:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721293440:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.785661:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd800/0xb50e82586761245d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ca expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.785675:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cd800, rc 0) 00000100:00100000:3.0:1746126607.785723:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+14:31043:x1830945721259776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6767us (7030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.785730:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13043 00000100:00100000:0.0:1746126607.787134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.787181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.787231:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721260544 00000100:00100000:1.0:1746126607.787237:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721260544 00000100:00100000:1.0:1746126607.787284:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3705 00000100:00100000:1.0:1746126607.787292:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31040:x1830945721260544:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126607.787451:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31040:x1830945721260544:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 159us (269us total) trans 8589942981 rc 0/0 00000100:00100000:1.0:1746126607.787459:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3705 00000100:00100000:0.0:1746126607.804240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126607.807227:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126607.810672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.813658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.817800:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721261056 00000100:00100000:3.0:1746126607.817811:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721261056 00000100:00100000:3.0:1746126607.817945:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13044 00000100:00100000:3.0:1746126607.817952:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:31045:x1830945721261056:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126607.817966:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.817980:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0d1 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.818004:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.818012:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a7 expref: 25 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.818021:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.818023:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.818026:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1171456->1748991] (req 1171456->1748991) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.818058:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a7 expref: 25 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.818069:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a7 expref: 25 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.818081:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721293696:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.818495:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.818504:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 9 pid: 8436 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.818512:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721293824:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.818532:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.825048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.825069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.825434:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6803 00000100:00100000:1.0:1746126607.825451:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721261184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.825463:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.825482:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 10 pid: 8436 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.825492:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 10 pid: 8436 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.825513:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.825544:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721261184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.826452:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6803 00000100:00100000:3.0:1746126607.826515:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721261440 00000100:00100000:3.0:1746126607.826519:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721261440 00000100:00100000:3.0:1746126607.826549:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8825 00000100:00100000:3.0:1746126607.826555:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31049:x1830945721261440:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.826569:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.826581:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e82586761246b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0d8 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.826655:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826666:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826674:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826684:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826689:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826694:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826777:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826784:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826790:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126607.826798:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126607.826882:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826888:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826894:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826899:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4cd200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.826902:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826908:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826915:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126607.826918:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126607.826921:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826926:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cd200/0xb50e825867612472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826938:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826943:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826947:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826951:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4cde00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126607.826953:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826956:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826964:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4300) 00010000:00010000:3.0:1746126607.826966:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126607.826968:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826971:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cde00/0xb50e825867612479 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126607.826998:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc600/0xb50e82586761246b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d8 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.827006:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d8 expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.827011:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.827013:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126607.827015:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cc000, rc 0) 00000100:00100000:3.0:1746126607.827040:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31049:x1830945721261440:12345-192.168.203.2@tcp:101:cat.0 Request processed in 484us (1705us total) trans 8589942982 rc 0/0 00000100:00100000:3.0:1746126607.827045:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8825 00010000:00010000:3.0:1746126607.827074:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57e2800/0xb50e82586761242c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0a7 expref: 26 pid: 4642 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.827086:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721293696:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.827095:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb60600/0xb50e8258676123ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d06f expref: 9 pid: 8436 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.827106:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721293824:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.827132:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.827139:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cdc00, rc 0) 00000100:00100000:3.0:1746126607.827155:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+25:31045:x1830945721261056:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9204us (13501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.827160:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13044 00000100:00100000:0.0:1746126607.827543:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+14:1965:x1830945721260928:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15346us (16872us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126607.827550:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7454 00002000:00100000:0.0:1746126607.827557:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800924c5180 x1830945721260928/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126607.827564:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c5180 with x1830945721260928 ext(1048576->2097151) 00002000:00010000:0.0:1746126607.827568:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c5180 00000100:00100000:0.0:1746126607.829418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.840273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.841137:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721262080 00000100:00100000:3.0:1746126607.841146:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721262080 00000100:00100000:3.0:1746126607.841193:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3706 00000100:00100000:3.0:1746126607.841200:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31049:x1830945721262080:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126607.841354:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31049:x1830945721262080:12345-192.168.203.2@tcp:35:cat.0 Request processed in 155us (1088us total) trans 8589942983 rc 0/0 00000100:00100000:3.0:1746126607.841359:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3706 00000100:00100000:0.0:1746126607.842687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.842718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.842895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.843018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.843507:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7457 00000100:00100000:1.0:1746126607.843518:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721262464:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.844659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.844676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.844706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.844761:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721262848 00000100:00100000:3.0:1746126607.844766:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721262848 00002000:00100000:3.0:1746126607.844787:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800924c6680 x1830945721262848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.844794:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6680 with x1830945721262848 ext(3145728->4194303) 00002000:00010000:3.0:1746126607.844798:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c6680 00000100:00100000:3.0:1746126607.844810:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721263360 00000100:00100000:3.0:1746126607.844812:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721263360 00002000:00100000:3.0:1746126607.844821:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1744896->1748991) req@ffff8800924c4a80 x1830945721263360/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.844846:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4a80 with x1830945721263360 ext(1744896->1748991) 00002000:00010000:3.0:1746126607.844849:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4a80 00000100:00100000:3.0:1746126607.844861:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7459 00000100:00100000:3.0:1746126607.844866:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721262848:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.846036:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7460 00000100:00100000:3.0:1746126607.846045:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721263360:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.846134:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721263360:12345-192.168.203.2@tcp:3:cat.0 Request processed in 91us (1475us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126607.846139:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7460 00002000:00100000:3.0:1746126607.846145:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1744896->1748991) req@ffff8800924c4a80 x1830945721263360/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/4536 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.846151:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4a80 with x1830945721263360 ext(1744896->1748991) 00002000:00010000:3.0:1746126607.846154:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4a80 00000100:00100000:3.0:1746126607.846173:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721263488 00000100:00100000:3.0:1746126607.846176:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721263488 00000100:00100000:3.0:1746126607.846199:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721263616 00000100:00100000:3.0:1746126607.846201:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721263616 00000100:00100000:3.0:1746126607.846217:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13045 00000100:00100000:3.0:1746126607.846222:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721263488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.846231:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.846244:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4ccc00/0xb50e82586761248e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0df expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.846282:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721294080:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126607.846329:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.846421:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13046 00000100:00100000:3.0:1746126607.846427:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721263616:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.846434:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.846443:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0e6 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.846454:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.846456:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.846463:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0e6 expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.846476:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0e6 expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.846485:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4cd200, rc 0) 00000100:00100000:3.0:1746126607.846502:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721263616:12345-192.168.203.2@tcp:101:cat.0 Request processed in 76us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.846507:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13046 00000100:00100000:3.0:1746126607.858284:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721294080:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.858315:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ccc00/0xb50e82586761248e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0df expref: 10 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.858330:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ccc00/0xb50e82586761248e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0df expref: 10 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.858361:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ccc00, rc 0) 00000100:00100000:3.0:1746126607.858416:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721263488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 12193us (13737us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.858425:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13045 00000100:00100000:3.0:1746126607.866194:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721262848:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21326us (23174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.866199:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7459 00002000:00100000:3.0:1746126607.866204:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800924c6680 x1830945721262848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.866210:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6680 with x1830945721262848 ext(3145728->4194303) 00002000:00010000:3.0:1746126607.866213:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c6680 00000100:00100000:1.0:1746126607.874930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.874976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.874997:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721264000 00000100:00100000:1.0:1746126607.875000:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721264128 00000100:00100000:1.0:1746126607.875004:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721264128 00000100:00100000:3.0:1746126607.875005:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721264000 00002000:00100000:1.0:1746126607.875034:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008e3a9880 x1830945721264128/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.875035:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008e3aa300 x1830945721264000/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.875042:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aa300 with x1830945721264000 ext(0->1048575) 00002000:00100000:1.0:1746126607.875042:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9880 with x1830945721264128 ext(1048576->2097151) 00002000:00010000:3.0:1746126607.875047:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3aa300 00002000:00010000:1.0:1746126607.875047:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9880 00000100:00100000:1.0:1746126607.875064:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7461 00000100:00100000:3.0:1746126607.875070:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7462 00000100:00100000:1.0:1746126607.875071:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721264128:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.875075:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721264000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126607.888383:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721264000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13298us (13450us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126607.888393:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7462 00002000:00100000:3.0:1746126607.888402:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008e3aa300 x1830945721264000/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:368/0 lens 488/440 e 0 to 0 dl 1746126618 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.888410:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aa300 with x1830945721264000 ext(0->1048575) 00002000:00010000:3.0:1746126607.888416:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3aa300 00000100:00100000:0.0:1746126607.896683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.897086:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7463 00000100:00100000:3.0:1746126607.897094:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+14:1965:x1830945721264384:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126607.902651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.912801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.913068:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721264640 00000100:00100000:3.0:1746126607.913073:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721264640 00002000:00100000:3.0:1746126607.913103:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1171456->1748991) req@ffff88009ee38700 x1830945721264640/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/0 e 0 to 0 dl 1746126618 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.913110:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38700 with x1830945721264640 ext(1171456->1748991) 00010000:00010000:3.0:1746126607.913117:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 24 pid: 23766 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.913137:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 24 pid: 23766 timeout: 829 lvb_type: 0 00002000:00010000:3.0:1746126607.913142:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee38700 00000100:00100000:3.0:1746126607.913158:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1698 00000100:00100000:3.0:1746126607.913165:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721264640:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126607.914055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.914459:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721264896 00000100:00100000:1.0:1746126607.914463:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721264896 00000100:00100000:1.0:1746126607.914489:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8826 00000100:00100000:1.0:1746126607.914494:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31052:x1830945721264896:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126607.914506:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126607.914520:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e8258676124a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d0f4 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.915128:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915138:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915146:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915157:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915161:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915165:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915296:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915304:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915309:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126607.915316:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126607.915376:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915381:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915386:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915390:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b1a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126607.915393:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915398:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915406:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126607.915409:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126607.915411:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915416:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1a00/0xb50e8258676124aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915437:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915441:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915449:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915452:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b0000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126607.915454:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915458:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915462:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8aa00) 00010000:00010000:1.0:1746126607.915464:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126607.915465:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915469:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b0000/0xb50e8258676124b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126607.915497:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e8258676124a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0f4 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.915505:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0f4 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.915509:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126607.915511:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126607.915512:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1e00, rc 0) 00000100:00100000:1.0:1746126607.915543:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31052:x1830945721264896:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1049us (1489us total) trans 8589942984 rc 0/0 00000100:00100000:1.0:1746126607.915549:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8826 00000100:00100000:0.0:1746126607.924802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.924924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.926153:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721265152 00000100:00100000:3.0:1746126607.926158:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721265152 00000100:00100000:3.0:1746126607.926184:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 674 00000100:00100000:3.0:1746126607.926190:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721265152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126607.926197:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126607.926213:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0f4 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.926229:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126607.926232:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126607.926258:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721265152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 68us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.926264:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 674 00000100:00100000:3.0:1746126607.934043:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721264640:12345-192.168.203.2@tcp:4:cat.0 Request processed in 20866us (21236us total) trans 17179873097 rc 0/0 00000100:00100000:3.0:1746126607.934056:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1698 00002000:00100000:3.0:1746126607.934068:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1171456->1748991) req@ffff88009ee38700 x1830945721264640/t17179873097(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:368/0 lens 488/448 e 0 to 0 dl 1746126618 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126607.934076:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38700 with x1830945721264640 ext(1171456->1748991) 00010000:00010000:3.0:1746126607.934086:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 26 pid: 23766 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.934101:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 26 pid: 23766 timeout: 829 lvb_type: 0 00002000:00010000:3.0:1746126607.934107:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee38700 00000100:00100000:1.0:1746126607.934736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.935004:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721265280 00000100:00100000:3.0:1746126607.935010:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721265280 00000100:00100000:3.0:1746126607.935035:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13049 00000100:00100000:3.0:1746126607.935041:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721265280:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126607.935050:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.935062:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06600/0xb50e8258676124cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d102 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126607.935101:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721294464:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126607.935171:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126607.945702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.945869:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721265408 00000100:00100000:1.0:1746126607.945876:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721265408 00010000:00010000:1.0:1746126607.945908:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 28 pid: 23766 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746126607.945948:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6805 00000100:00100000:1.0:1746126607.945955:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721265408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.945968:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.945984:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 28 pid: 23766 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.945994:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 28 pid: 23766 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126607.946013:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.946015:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126607.946112:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 9 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.946128:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 9 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126607.946157:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 9 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126607.946168:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721294592:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126607.946247:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746126607.946326:0:17475:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff8800a4f55500 x1830945721294464) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 28 pid: 23766 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126607.946341:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cdc00/0xb50e825867612464 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1171456->1748991) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d1 expref: 28 pid: 23766 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.946353:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721294464:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126607.946372:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06600/0xb50e8258676124cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d102 expref: 27 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.946380:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06600/0xb50e8258676124cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d102 expref: 27 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.946386:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f06600, rc 0) 00000100:00100000:3.0:1746126607.946407:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721265280:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11366us (11675us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126607.946413:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13049 00000100:00100000:0.0:1746126607.959388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.959431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.959604:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7465 00000100:00100000:3.0:1746126607.959609:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721265920:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126607.960450:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721294592:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126607.960470:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.960506:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721265408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 14552us (14810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.960513:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6805 00000100:00100000:0.0:1746126607.968019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.970344:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721266048 00000100:00100000:3.0:1746126607.970352:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721266048 00000100:00100000:3.0:1746126607.970394:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13050 00000100:00100000:3.0:1746126607.970400:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31052:x1830945721266048:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126607.970413:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126607.970426:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e8258676124d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d109 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.970450:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e82586761237d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d030 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.970458:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.970464:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.970465:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126607.970468:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e8258676124d4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3235840->3760127] (req 3235840->3760127) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d109 expref: 15 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.970490:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126607.970499:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 15 pid: 8436 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746126607.970508:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721294720:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.970580:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e82586761237d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d030 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.970592:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008edef200/0xb50e82586761237d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d030 expref: 13 pid: 10890 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126607.970599:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721294848:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.970613:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126607.978143:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721294720:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126607.978153:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721294848:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.978176:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e8258676124d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3235840->3760127] (req 3235840->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d109 expref: 14 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.978191:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbcb800, rc 0) 00000100:00100000:3.0:1746126607.978218:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31052:x1830945721266048:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7818us (10205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.978224:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13050 00000100:00100000:0.0:1746126607.983725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.983808:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721266176 00000100:00100000:1.0:1746126607.983816:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721266176 00010000:00010000:1.0:1746126607.983876:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 13 pid: 8436 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746126607.983907:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6806 00000100:00100000:1.0:1746126607.983917:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721266176:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126607.983929:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126607.983944:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 13 pid: 8436 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.983978:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 13 pid: 8436 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.983995:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb61200/0xb50e8258676123d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d07d expref: 13 pid: 8436 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746126607.984021:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126607.984057:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721266176:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126607.984066:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6806 00000100:00100000:0.0:1746126607.987180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.987657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126607.991947:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721295104:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126607.992047:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fda00/0xb50e8258676124db lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d110 expref: 13 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126607.992062:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fda00, rc 0) 00000100:00100000:3.0:1746126607.992100:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31049:x1830945721266432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3667us (4442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126607.992108:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13051 00000100:00100000:0.0:1746126607.994025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126607.996466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.996852:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267072 00000100:00100000:1.0:1746126607.996859:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267072 00000100:00100000:0.0:1746126607.996879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126607.997234:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3707 00000100:00100000:1.0:1746126607.997241:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31052:x1830945721267072:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126607.997454:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31052:x1830945721267072:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 213us (992us total) trans 8589942985 rc 0/0 00000100:00100000:1.0:1746126607.997460:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3707 00000100:00100000:1.0:1746126608.013490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.013512:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267584 00000100:00100000:1.0:1746126608.013518:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267584 00000100:00100000:0.0:1746126608.013520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.013559:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267456 00000100:00100000:1.0:1746126608.013562:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267456 00000100:00100000:3.0:1746126608.013610:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8827 00000100:00100000:3.0:1746126608.013617:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31056:x1830945721267584:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126608.013632:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.013645:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca600/0xb50e8258676124e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d11e expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.013762:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8828 00000100:00100000:1.0:1746126608.013767:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:31055:x1830945721267456:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126608.013777:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.013785:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e8258676124e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d117 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.013868:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013879:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013886:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013896:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013902:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013907:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013984:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013992:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.013998:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.014010:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126608.014073:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014079:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014084:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014089:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b1800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.014092:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014097:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014105:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126608.014108:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.014111:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014116:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1800/0xb50e8258676124f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014148:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014153:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014157:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014160:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b1000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.014162:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014166:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014171:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8aa00) 00010000:00010000:1.0:1746126608.014173:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.014175:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014179:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1000/0xb50e8258676124f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.014208:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e8258676124e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d117 expref: 234 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.014221:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d117 expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.014226:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.014228:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126608.014230:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1e00, rc 0) 00000100:00100000:1.0:1746126608.014266:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+233:31055:x1830945721267456:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 498us (745us total) trans 8589942986 rc 0/0 00000100:00100000:1.0:1746126608.014271:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8828 00010000:00010000:3.0:1746126608.014388:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e82586761250c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014395:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e82586761250c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014457:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e82586761250c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014467:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867612513 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014472:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867612513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014477:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867612513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014519:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e82586761251a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014526:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 232 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.014532:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e82586761251a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.014554:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 232 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.014563:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 232 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126608.014573:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721295232:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.014633:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.016510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.016556:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721267840 00000100:00100000:1.0:1746126608.016561:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721267840 00000100:00100000:1.0:1746126608.016599:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3708 00000100:00100000:1.0:1746126608.016605:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+233:31055:x1830945721267840:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126608.016754:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+234:31055:x1830945721267840:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 148us (247us total) trans 8589942987 rc 0/0 00000100:00100000:1.0:1746126608.016760:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3708 00000100:00100000:3.0:1746126608.017329:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721295232:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.017403:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e82586761251a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126608.018583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:0.0:1746126608.019557:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126608.022597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.022747:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268096 00000100:00100000:1.0:1746126608.022754:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268096 00010000:00010000:1.0:1746126608.022783:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 234 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746126608.022815:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6809 00000100:00100000:1.0:1746126608.022821:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+234:1963:x1830945721268096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.022855:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.022861:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 234 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126608.022870:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 234 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126608.022886:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612448 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0bc expref: 234 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746126608.022897:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.022901:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e82586761251a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.022908:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e82586761251a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.022914:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e82586761251a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.022944:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.022979:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+233:1963:x1830945721268096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 158us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.022984:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6809 00000100:00100000:3.0:1746126608.024447:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721295360:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126608.024462:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.024702:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721267968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4950us (6120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.024708:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6808 00000100:00100000:0.0:1746126608.031323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.031360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.031381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.031404:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268224 00000100:00100000:0.0:1746126608.031412:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268224 00000100:00100000:0.0:1746126608.031454:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268352 00000100:00100000:0.0:1746126608.031456:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268352 00000100:00100000:0.0:1746126608.031466:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268480 00000100:00100000:0.0:1746126608.031467:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268480 00000100:00100000:0.0:1746126608.031479:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13052 00000100:00100000:0.0:1746126608.031485:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1965:x1830945721268224:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.031507:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.031523:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d125 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.031544:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.031546:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.031554:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.031568:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.031578:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec79c00, rc 0) 00000100:00100000:0.0:1746126608.031619:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721268224:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 133us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.031625:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13052 00000100:00100000:0.0:1746126608.031638:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13053 00000100:00100000:0.0:1746126608.031642:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721268352:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.031649:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.031658:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d12c expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.031668:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.031669:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.031673:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d12c expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.031682:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d12c expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.031689:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec79600, rc 0) 00000100:00100000:0.0:1746126608.031701:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721268352:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 59us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.031705:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13053 00000100:00100000:0.0:1746126608.031711:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13054 00000100:00100000:0.0:1746126608.031715:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721268480:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.031719:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.031723:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec78800/0xb50e82586761252f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d133 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.031731:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.031732:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.031735:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec78800/0xb50e82586761252f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d133 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.031742:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec78800/0xb50e82586761252f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d133 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.031747:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec78800, rc 0) 00000100:00100000:0.0:1746126608.031755:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721268480:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.031758:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13054 00000100:00100000:0.0:1746126608.031794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.034631:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268608 00000100:00100000:1.0:1746126608.034640:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268608 00000100:00100000:1.0:1746126608.034690:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13055 00000100:00100000:1.0:1746126608.034698:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721268608:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.034711:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.034725:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b1800/0xb50e825867612536 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d13a expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.034750:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.034751:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.034758:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b1800/0xb50e825867612536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d13a expref: 7 pid: 4642 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126608.034766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126608.034769:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b1800/0xb50e825867612536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d13a expref: 7 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.034777:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b1800, rc 0) 00000100:00100000:0.0:1746126608.034782:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268736 00000100:00100000:0.0:1746126608.034789:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268736 00000100:00100000:1.0:1746126608.034817:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721268608:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 120us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.034819:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13056 00000100:00100000:1.0:1746126608.034823:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13055 00000100:00100000:0.0:1746126608.034840:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721268736:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.034853:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.034865:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d141 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.034881:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.034883:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.034889:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d141 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.034900:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d141 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126608.034907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126608.034908:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec79200, rc 0) 00000100:00100000:1.0:1746126608.034924:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721268864 00000100:00100000:1.0:1746126608.034927:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721268864 00000100:00100000:0.0:1746126608.034934:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721268736:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 109us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.034940:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13056 00000100:00100000:0.0:1746126608.034953:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13057 00000100:00100000:0.0:1746126608.034959:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721268864:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.034967:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.034976:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d148 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.034987:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.034988:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.034991:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d148 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.035000:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d148 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.035005:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec78400, rc 0) 00000100:00100000:0.0:1746126608.035020:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721268864:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.035025:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13057 00000100:00100000:0.0:1746126608.039940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.039992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.040232:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721269248 00000100:00100000:3.0:1746126608.040241:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721269248 00002000:00100000:3.0:1746126608.040289:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008f257480 x1830945721269248/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.040300:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f257480 with x1830945721269248 ext(3145728->4194303) 00002000:00010000:3.0:1746126608.040305:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f257480 00000100:00100000:3.0:1746126608.040328:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721269120 00000100:00100000:3.0:1746126608.040330:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721269120 00002000:00100000:3.0:1746126608.040341:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008f256300 x1830945721269120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.040346:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256300 with x1830945721269120 ext(2097152->3145727) 00002000:00010000:3.0:1746126608.040349:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256300 00000100:00100000:3.0:1746126608.040945:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7467 00000100:00100000:3.0:1746126608.040952:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721269120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126608.041937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.060259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.060424:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721295488:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.060449:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126608.061033:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126608.061040:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:0.0:1746126608.061059:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126608.061248:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941800/0xb50e82586761254b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d14f expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.061266:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d14f expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.061272:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126608.061275:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126608.061277:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d940400, rc 0) 00000100:00100000:0.0:1746126608.061462:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31056:x1830945721269632:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 18261us (19527us total) trans 8589942988 rc 0/0 00000100:00100000:0.0:1746126608.061470:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8829 00000100:00100000:3.0:1746126608.061720:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721269120:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20768us (21726us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.061727:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7467 00002000:00100000:3.0:1746126608.061734:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008f256300 x1830945721269120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.061741:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256300 with x1830945721269120 ext(2097152->3145727) 00002000:00010000:3.0:1746126608.061744:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256300 00000100:00100000:0.0:1746126608.067142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.086373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.086481:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270144 00000100:00100000:3.0:1746126608.086490:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270144 00002000:00100000:3.0:1746126608.086534:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f255880 x1830945721270144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.086543:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f255880 with x1830945721270144 ext(4194304->4976639) 00002000:00010000:3.0:1746126608.086548:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f255880 00000100:00100000:3.0:1746126608.086618:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7468 00000100:00100000:3.0:1746126608.086624:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721270144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126608.094207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.095540:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270528 00000100:00100000:1.0:1746126608.095551:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270528 00000100:00100000:1.0:1746126608.095623:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8831 00000100:00100000:1.0:1746126608.095632:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+233:31060:x1830945721270528:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.095657:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.095676:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761256e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d15d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.095784:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095801:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095813:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095866:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095873:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095879:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095989:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d600/0xb50e825867612583 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.095998:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d600/0xb50e825867612583 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096004:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d600/0xb50e825867612583 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.096012:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126608.096093:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096099:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096104:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096113:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea4d800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.096129:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096135:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096145:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126608.096148:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.096151:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096156:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e825867612575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096169:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096173:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096178:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096182:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea4d200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.096184:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096189:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096194:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8a700) 00010000:00010000:1.0:1746126608.096195:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.096197:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096201:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e82586761257c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.096234:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761256e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d15d expref: 236 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.096244:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d600/0xb50e825867612583 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d15d expref: 235 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.096250:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.096252:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126608.096255:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.096262:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.096266:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea4d600, rc 0) 00000100:00100000:1.0:1746126608.096313:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+235:31060:x1830945721270528:12345-192.168.203.2@tcp:101:cat.0 Request processed in 683us (2116us total) trans 8589942989 rc 0/0 00000100:00100000:1.0:1746126608.096320:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8831 00000100:00100000:1.0:1746126608.099442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.100151:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270272 00000100:00100000:3.0:1746126608.100159:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270272 00010000:00010000:3.0:1746126608.100192:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d14f expref: 14 pid: 20362 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746126608.101564:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6811 00000100:00100000:3.0:1746126608.101574:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721270272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.101589:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.101596:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d14f expref: 14 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126608.101607:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d14f expref: 14 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126608.101628:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612552 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d14f expref: 14 pid: 20362 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746126608.101654:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.101658:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.101667:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.101673:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.101689:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.101733:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721270272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 161us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.101739:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6811 00010000:00010000:3.0:1746126608.101762:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.101771:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126608.101809:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126608.101813:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126608.101843:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.101872:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941200/0xb50e825867612560 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d156 expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.101884:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d156 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.101890:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.101892:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126608.101894:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d940200, rc 0) 00000100:00100000:3.0:1746126608.101918:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31056:x1830945721269888:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 34610us (34799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.101923:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8830 00000100:00100000:3.0:1746126608.103559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.104236:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.104268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.104384:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721270912 00000100:00100000:1.0:1746126608.104388:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721270912 00000100:00100000:1.0:1746126608.104412:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 675 00000100:00100000:1.0:1746126608.104416:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:1963:x1830945721270912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.104425:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.104445:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d600/0xb50e825867612583 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d15d expref: 236 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.104455:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.104459:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.104478:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+235:1963:x1830945721270912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.104483:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 675 00000100:00100000:3.0:1746126608.104609:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721271168 00000100:00100000:3.0:1746126608.104611:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721271168 00000100:00100000:3.0:1746126608.104630:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8832 00000100:00100000:3.0:1746126608.104634:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31056:x1830945721271168:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126608.104642:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.104652:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fd400/0xb50e825867612591 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d164 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.104714:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104725:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104733:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104742:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104748:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104753:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104757:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4cce00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126608.104760:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104767:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104773:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.104775:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126608.104777:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104781:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cce00/0xb50e825867612598 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.104801:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fd400/0xb50e825867612591 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d164 expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.104807:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fd400/0xb50e825867612591 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d164 expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.104812:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fd400, rc 0) 00000100:00100000:3.0:1746126608.104844:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31056:x1830945721271168:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 210us (610us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.104849:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8832 00000100:00100000:3.0:1746126608.108014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.110325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.110377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.110408:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721271552 00000100:00100000:3.0:1746126608.110417:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721271552 00000100:00100000:1.0:1746126608.111181:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721271680 00000100:00100000:1.0:1746126608.111185:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721271680 00000100:00100000:3.0:1746126608.111212:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13058 00000100:00100000:3.0:1746126608.111241:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721271552:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:1.0:1746126608.111247:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13059 00000100:00100000:1.0:1746126608.111255:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721271680:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.111259:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.111269:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.111276:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d16b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.111284:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ea4de00/0xb50e8258676125a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d172 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.111297:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.111299:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.111302:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.111304:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.111306:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d16b expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.111312:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ea4de00/0xb50e8258676125a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d172 expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.111321:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d16b expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.111330:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fc800, rc 0) 00010000:00010000:1.0:1746126608.111333:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ea4de00/0xb50e8258676125a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d172 expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.111342:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea4de00, rc 0) 00000100:00100000:3.0:1746126608.111376:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721271552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 150us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.111382:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13058 00000100:00100000:1.0:1746126608.111382:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721271680:12345-192.168.203.2@tcp:101:cat.0 Request processed in 128us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.111395:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13059 00000100:00080000:3.0:1746126608.112126:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746126608.112130:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126608.132168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.136217:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721271936 00000100:00100000:1.0:1746126608.136230:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721271936 00000100:00100000:1.0:1746126608.136327:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8833 00000100:00100000:1.0:1746126608.136335:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31063:x1830945721271936:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126608.136360:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.136379:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e8258676125ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d179 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.136483:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136495:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136504:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136515:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136519:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136523:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00080000:3.0:1746126608.136593:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746126608.136621:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136629:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136634:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.136643:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126608.136726:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136733:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136739:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136745:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea4d800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.136748:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136754:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136764:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126608.136767:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.136770:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136775:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d800/0xb50e8258676125b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136798:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136802:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136806:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136814:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea4d400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.136816:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136821:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136860:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e21fc00) 00010000:00010000:1.0:1746126608.136861:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.136864:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136868:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676125bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.136904:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e8258676125ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 19 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.136914:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.136919:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.136921:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126608.136924:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea4da00, rc 0) 00000100:00100000:1.0:1746126608.136985:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31063:x1830945721271936:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 651us (4826us total) trans 8589942992 rc 0/0 00000100:00100000:1.0:1746126608.136991:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8833 00000100:00100000:0.0:1746126608.144714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.178763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.178890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.178940:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721272448 00000100:00100000:1.0:1746126608.178950:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721272448 00002000:00100000:1.0:1746126608.179011:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880135bcc380 x1830945721272448/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.179021:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc380 with x1830945721272448 ext(2097152->3145727) 00002000:00010000:1.0:1746126608.179027:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcc380 00000100:00100000:1.0:1746126608.179045:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721272576 00000100:00100000:1.0:1746126608.179048:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721272576 00002000:00100000:1.0:1746126608.179060:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135bcfb80 x1830945721272576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.179067:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcfb80 with x1830945721272576 ext(3145728->4194303) 00002000:00010000:1.0:1746126608.179069:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcfb80 00000100:00100000:1.0:1746126608.179090:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7470 00000100:00100000:1.0:1746126608.179098:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721272448:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126608.179108:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7471 00000100:00100000:0.0:1746126608.179115:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721272576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126608.200462:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721272448:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21353us (21700us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126608.200475:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7470 00002000:00100000:1.0:1746126608.200488:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880135bcc380 x1830945721272448/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.200497:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc380 with x1830945721272448 ext(2097152->3145727) 00002000:00010000:1.0:1746126608.200503:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcc380 00000100:00100000:0.0:1746126608.201353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.201484:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721272576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22368us (22592us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.201492:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7471 00002000:00100000:3.0:1746126608.201498:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135bcfb80 x1830945721272576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.201504:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcfb80 with x1830945721272576 ext(3145728->4194303) 00002000:00010000:3.0:1746126608.201507:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcfb80 00000100:00100000:0.0:1746126608.205038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.205307:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721272960 00000100:00100000:1.0:1746126608.205313:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721272960 00010000:00010000:1.0:1746126608.205351:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d148 expref: 9 pid: 10890 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746126608.205383:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6812 00000100:00100000:1.0:1746126608.205391:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721272960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.205402:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.205423:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d148 expref: 9 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.205432:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d148 expref: 9 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.205451:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec78400/0xb50e825867612544 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d148 expref: 9 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.205479:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.205514:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721272960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 124us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.205520:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6812 00000100:00100000:0.0:1746126608.212432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.212484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.212583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.212701:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721273216 00000100:00100000:1.0:1746126608.212711:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721273216 00010000:00010000:1.0:1746126608.212776:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d08b expref: 10 pid: 4642 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.212802:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721273344 00000100:00100000:1.0:1746126608.212805:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721273344 00010000:00010000:1.0:1746126608.212814:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0b5 expref: 27 pid: 4642 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746126608.212860:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6813 00000100:00100000:1.0:1746126608.212868:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721273216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.212884:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.212905:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d08b expref: 10 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.212915:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d08b expref: 10 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.212939:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3a00/0xb50e8258676123d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d08b expref: 10 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.212959:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.213000:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721273216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 133us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.213007:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6813 00000100:00100000:1.0:1746126608.213022:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6814 00000100:00100000:1.0:1746126608.213027:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:1965:x1830945721273344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.213035:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.213044:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0b5 expref: 27 pid: 4642 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.213052:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0b5 expref: 27 pid: 4642 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.213064:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57e3200/0xb50e82586761243a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0b5 expref: 27 pid: 4642 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.213076:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.213078:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.213084:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.213091:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.213135:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.213147:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721296128:192.168.203.2@tcp:105: 00000100:00080000:3.0:1746126608.213398:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746126608.213512:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.217335:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721296128:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126608.217365:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.217410:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721273344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4381us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.217419:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6814 00000100:00100000:0.0:1746126608.218186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.218295:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721273600 00000100:00100000:3.0:1746126608.218302:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721273600 00002000:00100000:3.0:1746126608.218340:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3072000->3076095) req@ffff880135bce300 x1830945721273600/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.218349:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bce300 with x1830945721273600 ext(3072000->3076095) 00010000:00010000:3.0:1746126608.218355:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 27 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.218366:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 27 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:3.0:1746126608.218373:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135bce300 00000100:00100000:3.0:1746126608.218388:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1701 00000100:00100000:3.0:1746126608.218394:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721273600:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126608.218968:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721273600:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 572us (780us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126608.218975:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1701 00002000:00100000:3.0:1746126608.218980:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3072000->3076095) req@ffff880135bce300 x1830945721273600/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/4536 e 0 to 0 dl 1746126619 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.218987:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bce300 with x1830945721273600 ext(3072000->3076095) 00010000:00010000:3.0:1746126608.218993:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 27 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.219003:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 27 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:3.0:1746126608.219009:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135bce300 00000100:00100000:0.0:1746126608.231243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.231313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.232850:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721273984 00000100:00100000:3.0:1746126608.232857:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721273984 00002000:00100000:3.0:1746126608.232896:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3072000->3145727) req@ffff880135bcc700 x1830945721273984/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.232905:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc700 with x1830945721273984 ext(3072000->3145727) 00010000:00010000:3.0:1746126608.232912:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 27 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.232927:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 27 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:3.0:1746126608.232933:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135bcc700 00000100:00100000:3.0:1746126608.232950:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1702 00000100:00100000:3.0:1746126608.232956:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721273984:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126608.239480:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721273984:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 6512us (8155us total) trans 17179873098 rc 0/0 00000100:00100000:3.0:1746126608.239494:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1702 00002000:00100000:3.0:1746126608.239505:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3072000->3145727) req@ffff880135bcc700 x1830945721273984/t17179873098(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/448 e 0 to 0 dl 1746126619 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.239515:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc700 with x1830945721273984 ext(3072000->3145727) 00010000:00010000:3.0:1746126608.239526:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 29 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.239539:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 29 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:3.0:1746126608.239546:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135bcc700 00000100:00100000:0.0:1746126608.244337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.244390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.244424:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721274240 00000100:00100000:0.0:1746126608.244433:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721274240 00000100:00100000:0.0:1746126608.244478:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13063 00000100:00100000:0.0:1746126608.244485:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721274240:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126608.244504:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.244523:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e8258676125e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d195 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.244579:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721296768:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126608.244666:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.245266:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721274112 00000100:00100000:1.0:1746126608.245271:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721274112 00010000:00010000:1.0:1746126608.245294:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d141 expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746126608.245312:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6815 00000100:00100000:1.0:1746126608.245317:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721274112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.245327:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.245347:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d141 expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.245357:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d141 expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.245375:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec79200/0xb50e82586761253d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d141 expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.245388:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.245404:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721274112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 87us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.245409:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6815 00000100:00100000:0.0:1746126608.247600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.247651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126608.248702:0:23766:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126606 -> 1746126607 00000100:00100000:0.0:1746126608.248716:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721296768:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126608.248740:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e8258676125e5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d195 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.248749:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e8258676125e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d195 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.248759:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a26800, rc 0) 00000100:00100000:0.0:1746126608.248785:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721274240:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4300us (4394us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126608.248790:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13063 00000100:00100000:1.0:1746126608.249195:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721274624 00000100:00100000:1.0:1746126608.249200:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721274624 00010000:00010000:1.0:1746126608.249221:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 29 pid: 17475 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.249235:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6818 00000100:00100000:1.0:1746126608.249240:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721274624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.249247:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.249254:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 29 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.249262:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 29 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.249276:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1000/0xb50e8258676125d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d180 expref: 29 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.249285:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.249287:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.249291:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.249298:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.249313:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.249320:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721297024:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126608.249361:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.253979:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721297024:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126608.254011:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.254263:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721274624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5018us (5626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.254274:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6818 00000100:00100000:0.0:1746126608.257710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.257798:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721275008 00000100:00100000:3.0:1746126608.257809:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721275008 00002000:00100000:3.0:1746126608.257900:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880135bcdc00 x1830945721275008/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.257909:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcdc00 with x1830945721275008 ext(2097152->3145727) 00002000:00010000:3.0:1746126608.257916:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcdc00 00000100:00100000:3.0:1746126608.257945:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7472 00000100:00100000:3.0:1746126608.257952:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721275008:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126608.264328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.264433:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721275264 00000100:00100000:1.0:1746126608.264441:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721275264 00002000:00100000:1.0:1746126608.264478:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3989504->3993599) req@ffff880135bcf100 x1830945721275264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.264493:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf100 with x1830945721275264 ext(3989504->3993599) 00002000:00010000:1.0:1746126608.264498:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcf100 00000100:00100000:1.0:1746126608.264527:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7473 00000100:00100000:1.0:1746126608.264535:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721275264:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126608.264653:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721275264:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 119us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126608.264658:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7473 00002000:00100000:1.0:1746126608.264664:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3989504->3993599) req@ffff880135bcf100 x1830945721275264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/4536 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.264670:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf100 with x1830945721275264 ext(3989504->3993599) 00002000:00010000:1.0:1746126608.264673:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcf100 00000100:00100000:0.0:1746126608.271915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.271956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.272059:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13064 00000100:00100000:3.0:1746126608.272075:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721275392:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.272093:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.272109:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921fda00/0xb50e8258676125f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d19c expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.272166:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721297152:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126608.272257:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09c00 going to sleep for 11 seconds 00002000:00010000:3.0:1746126608.281248:0:9686:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126606 -> 1746126607 00000100:00100000:3.0:1746126608.281274:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721297152:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126608.281302:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fda00/0xb50e8258676125f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d19c expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.281315:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921fda00/0xb50e8258676125f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d19c expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.281337:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fda00, rc 0) 00000100:00100000:3.0:1746126608.281396:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721275392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9327us (9489us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.281403:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13064 00000100:00100000:0.0:1746126608.283252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.284477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.284869:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721275904 00000100:00100000:3.0:1746126608.284880:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721275904 00000100:00100000:3.0:1746126608.284932:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13066 00000100:00100000:3.0:1746126608.284938:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31068:x1830945721275904:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.284952:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.284966:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4ba000/0xb50e8258676125fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1aa expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.284990:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 13 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.284997:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126608.284999:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126608.285002:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ba000/0xb50e8258676125fa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1aa expref: 14 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.285029:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 13 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.285039:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 13 pid: 17475 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.285050:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721297280:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.285133:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.290636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.292338:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721297280:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.292365:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4ba000/0xb50e8258676125fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1aa expref: 14 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.292379:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4ba000, rc 0) 00000100:00100000:3.0:1746126608.294288:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31068:x1830945721275904:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9339us (9802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.294298:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13066 00000100:00100000:0.0:1746126608.295429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.295460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.295493:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721276288 00000100:00100000:0.0:1746126608.295500:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721276288 00002000:00100000:0.0:1746126608.295541:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3993599) req@ffff880131d57480 x1830945721276288/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126608.295549:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57480 with x1830945721276288 ext(3145728->3993599) 00010000:00010000:0.0:1746126608.295557:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 16 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.295570:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 16 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746126608.295576:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131d57480 00000100:00100000:0.0:1746126608.295590:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721276544 00000100:00100000:0.0:1746126608.295593:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721276544 00002000:00100000:0.0:1746126608.295603:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880131d56680 x1830945721276544/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126608.295609:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d56680 with x1830945721276544 ext(3145728->4194303) 00002000:00010000:0.0:1746126608.295611:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d56680 00000100:00100000:0.0:1746126608.295635:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1704 00000100:00100000:0.0:1746126608.295642:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721276288:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126608.296231:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7474 00000100:00100000:3.0:1746126608.296239:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721276544:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126608.300853:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721276160:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 9056us (10218us total) trans 0 rc 200704/200704 00000100:00100000:3.0:1746126608.300864:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1703 00002000:00100000:3.0:1746126608.300875:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3993600->4194303) req@ffff880131d54a80 x1830945721276160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:H/200/0 rc 200704/200704 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.300885:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54a80 with x1830945721276160 ext(3993600->4194303) 00010000:00010000:3.0:1746126608.300895:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 16 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.300909:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 16 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:3.0:1746126608.300915:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131d54a80 00000100:00100000:3.0:1746126608.308894:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721276544:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 12644us (13420us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.308907:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7474 00002000:00100000:3.0:1746126608.308920:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880131d56680 x1830945721276544/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.308929:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d56680 with x1830945721276544 ext(3145728->4194303) 00002000:00010000:3.0:1746126608.308936:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d56680 00000100:00100000:3.0:1746126608.325203:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721276288:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 29551us (29767us total) trans 21474840253 rc 0/0 00000100:00100000:3.0:1746126608.325216:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1704 00002000:00100000:3.0:1746126608.325227:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3993599) req@ffff880131d57480 x1830945721276288/t21474840253(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/448 e 0 to 0 dl 1746126619 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.325236:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57480 with x1830945721276288 ext(3145728->3993599) 00010000:00010000:3.0:1746126608.325245:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 17 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.325260:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 17 pid: 17475 timeout: 830 lvb_type: 0 00002000:00010000:3.0:1746126608.325267:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131d57480 00000100:00100000:0.0:1746126608.327061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.329225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.329428:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721276928 00000100:00100000:3.0:1746126608.329435:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721276928 00010000:00010000:3.0:1746126608.329467:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 17 pid: 17475 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.330798:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6819 00000100:00100000:3.0:1746126608.330808:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721276928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.330823:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.330858:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 17 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.330869:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 17 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.330892:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1200/0xb50e8258676125de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d18e expref: 17 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.330916:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.330918:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.330925:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4ba000/0xb50e8258676125fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1aa expref: 13 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.330933:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4ba000/0xb50e8258676125fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1aa expref: 13 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.330941:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.330943:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.330946:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35e00/0xb50e825867612601 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b1 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.330952:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35e00/0xb50e825867612601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b1 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.330983:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35e00/0xb50e825867612601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b1 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.330994:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721297792:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126608.331441:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4ba000/0xb50e8258676125fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1aa expref: 13 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.331458:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721297920:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126608.331478:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.331898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.331911:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721277056 00000100:00100000:1.0:1746126608.331918:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721277056 00010000:00010000:1.0:1746126608.331942:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d12c expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746126608.332221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.332346:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721277184 00000100:00100000:1.0:1746126608.332349:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721277184 00000100:00100000:0.0:1746126608.332389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126608.332502:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973a1800/0xb50e8258676123ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d068 expref: 11 pid: 4640 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746126608.332519:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721277312 00000100:00100000:1.0:1746126608.332522:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721277312 00010000:00010000:1.0:1746126608.332533:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d03e expref: 28 pid: 8437 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746126608.332543:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6820 00000100:00100000:1.0:1746126608.332549:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721277056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.332558:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.332575:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d12c expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332582:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d12c expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332598:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec79600/0xb50e825867612528 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d12c expref: 8 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332622:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.332642:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721277056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 93us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.332648:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6820 00000100:00100000:1.0:1746126608.332659:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6821 00000100:00100000:1.0:1746126608.332664:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721277184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.332670:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.332677:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973a1800/0xb50e8258676123ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d068 expref: 11 pid: 4640 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332685:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973a1800/0xb50e8258676123ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d068 expref: 11 pid: 4640 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332701:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973a1800/0xb50e8258676123ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d068 expref: 11 pid: 4640 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332713:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.332726:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721277184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 63us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.332731:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6821 00000100:00100000:1.0:1746126608.332740:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6822 00000100:00100000:1.0:1746126608.332745:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721277312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.332752:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.332759:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d03e expref: 28 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332767:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d03e expref: 28 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332778:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4cda00/0xb50e825867612399 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d03e expref: 28 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.332786:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.332788:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.332792:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.332798:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.332818:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.332846:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721298048:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126608.332883:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.334332:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721297792:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126608.334342:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721297920:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126608.334355:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.334387:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721276928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3582us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.334394:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6819 00000100:00100000:0.0:1746126608.336928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.336974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.337237:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721298048:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126608.337262:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.337297:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721277312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4551us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.337307:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6822 00000100:00100000:0.0:1746126608.345521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.345562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.345587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.345611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.345633:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721278208 00000100:00100000:1.0:1746126608.345638:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721278208 00000100:00100000:0.0:1746126608.345642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:1.0:1746126608.345680:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880131d55500 x1830945721278208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.345690:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55500 with x1830945721278208 ext(2097152->3145727) 00002000:00010000:1.0:1746126608.345695:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d55500 00000100:00100000:1.0:1746126608.345709:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721278464 00000100:00100000:1.0:1746126608.345711:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721278464 00002000:00100000:1.0:1746126608.345722:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880131d54000 x1830945721278464/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.345728:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54000 with x1830945721278464 ext(3145728->4194303) 00002000:00010000:1.0:1746126608.345730:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d54000 00000100:00100000:1.0:1746126608.345738:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721278720 00000100:00100000:1.0:1746126608.345740:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721278720 00002000:00100000:1.0:1746126608.345751:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880131d57100 x1830945721278720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.345756:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57100 with x1830945721278720 ext(2097152->3145727) 00002000:00010000:1.0:1746126608.345759:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d57100 00000100:00100000:1.0:1746126608.345766:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721278976 00000100:00100000:1.0:1746126608.345767:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721278976 00002000:00100000:1.0:1746126608.345774:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880131d54e00 x1830945721278976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.345780:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54e00 with x1830945721278976 ext(3145728->4194303) 00002000:00010000:1.0:1746126608.345782:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d54e00 00000100:00100000:1.0:1746126608.345798:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7477 00000100:00100000:1.0:1746126608.345804:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721278208:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126608.345846:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7478 00000100:00100000:0.0:1746126608.345854:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721278464:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126608.345908:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7479 00000100:00100000:3.0:1746126608.345915:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721278720:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126608.346440:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7480 00000100:00100000:1.0:1746126608.347430:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721278976:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126608.354816:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721298176:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.354852:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721298304:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.354861:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721298432:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.354893:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1048576->1773567] (req 1048576->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.354910:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c79c00, rc 0) 00000100:00100000:3.0:1746126608.354965:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31063:x1830945721277952:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9309us (9454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.354975:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13069 00000100:00100000:0.0:1746126608.355858:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721278464:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 10001us (10265us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126608.355867:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7478 00002000:00100000:0.0:1746126608.355878:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880131d54000 x1830945721278464/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126608.355888:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54000 with x1830945721278464 ext(3145728->4194303) 00002000:00010000:0.0:1746126608.355893:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d54000 00000100:00100000:3.0:1746126608.356083:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721279232 00000100:00100000:3.0:1746126608.356091:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721279232 00010000:00010000:3.0:1746126608.356129:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d16b expref: 27 pid: 8437 timeout: 830 lvb_type: 1 00000100:00100000:3.0:1746126608.356164:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6823 00000100:00100000:3.0:1746126608.356172:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721279232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.356189:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.356209:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d16b expref: 27 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.356219:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d16b expref: 27 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.356241:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e82586761259f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d16b expref: 27 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.356256:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.356275:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721279232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.356281:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6823 00000100:00100000:0.0:1746126608.358382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.358415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.358477:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721279360 00000100:00100000:3.0:1746126608.358481:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721279360 00010000:00010000:3.0:1746126608.358494:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 15 pid: 17475 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.358513:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6824 00000100:00100000:3.0:1746126608.358519:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721279360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.358531:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.358550:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 15 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.358559:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 15 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.358718:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921fcc00/0xb50e82586761249c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0ed expref: 15 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.358735:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.358737:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.358743:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.358749:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.358961:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.358972:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721298560:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126608.359017:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.363665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.365405:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721279616 00000100:00100000:1.0:1746126608.365411:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721279616 00000100:00100000:1.0:1746126608.365441:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13071 00000100:00100000:1.0:1746126608.365447:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721279616:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.365458:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.365469:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b1a00/0xb50e82586761261d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1cd expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.365501:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721298816:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126608.366461:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.368077:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721298560:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126608.368096:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.368145:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721279360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9625us (9727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.368156:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6824 00002000:00010000:0.0:1746126608.370756:0:17475:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126607 -> 1746126608 00002000:00010000:0.0:1746126608.370759:0:17475:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126607 -> 1746126608 00002000:00010000:0.0:1746126608.370760:0:17475:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126607 -> 1746126608 00000100:00100000:0.0:1746126608.370769:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721298816:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126608.370789:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b1a00/0xb50e82586761261d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1cd expref: 28 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.370799:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1a00/0xb50e82586761261d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1cd expref: 28 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.370808:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1a00, rc 0) 00000100:00100000:0.0:1746126608.370822:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721279616:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5377us (5479us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126608.370841:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13071 00000100:00100000:3.0:1746126608.371064:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721278976:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 24617us (25419us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.371073:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7480 00002000:00100000:3.0:1746126608.371082:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880131d54e00 x1830945721278976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.371090:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54e00 with x1830945721278976 ext(3145728->4194303) 00002000:00010000:3.0:1746126608.371094:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d54e00 00000100:00100000:1.0:1746126608.372366:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721278208:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 26558us (26798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126608.372375:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7477 00002000:00100000:1.0:1746126608.372381:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880131d55500 x1830945721278208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.372388:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55500 with x1830945721278208 ext(2097152->3145727) 00002000:00010000:1.0:1746126608.372393:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d55500 00000100:00100000:1.0:1746126608.377301:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721279872 00000100:00100000:1.0:1746126608.377310:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721279872 00002000:00100000:1.0:1746126608.377358:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1769472->1773567) req@ffff880092ad2300 x1830945721279872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.377367:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad2300 with x1830945721279872 ext(1769472->1773567) 00002000:00010000:1.0:1746126608.377371:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad2300 00000100:00100000:1.0:1746126608.377383:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721280128 00000100:00100000:1.0:1746126608.377384:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721280128 00002000:00100000:1.0:1746126608.377393:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092ad1180 x1830945721280128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.377399:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1180 with x1830945721280128 ext(4194304->4976639) 00002000:00010000:1.0:1746126608.377401:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad1180 00000100:00100000:1.0:1746126608.377416:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7481 00000100:00100000:1.0:1746126608.377422:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721279872:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126608.377446:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7482 00000100:00100000:0.0:1746126608.377456:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721280128:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126608.377584:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721279872:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 161us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126608.377590:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7481 00002000:00100000:1.0:1746126608.377596:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1769472->1773567) req@ffff880092ad2300 x1830945721279872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/4536 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.377603:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad2300 with x1830945721279872 ext(1769472->1773567) 00002000:00010000:1.0:1746126608.377605:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad2300 00000100:00100000:0.0:1746126608.382424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.384041:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721280128:12345-192.168.203.2@tcp:3:cat.0 Request processed in 6584us (6804us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126608.384082:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7482 00002000:00100000:1.0:1746126608.384091:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092ad1180 x1830945721280128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.384098:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1180 with x1830945721280128 ext(4194304->4976639) 00002000:00010000:1.0:1746126608.384104:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad1180 00000100:00100000:0.0:1746126608.389538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.389576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.389594:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721280640 00000100:00100000:1.0:1746126608.389604:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721280640 00000100:00100000:1.0:1746126608.389667:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3712 00000100:00100000:1.0:1746126608.389676:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31063:x1830945721280640:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126608.389967:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31063:x1830945721280640:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 292us (481us total) trans 8589942994 rc 0/0 00000100:00100000:1.0:1746126608.389974:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3712 00000100:00100000:0.0:1746126608.389993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.390446:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13073 00000100:00100000:3.0:1746126608.390455:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721280896:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.390462:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.390469:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18000/0xb50e82586761262b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1db expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.390502:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721299072:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126608.390562:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.396248:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721299072:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126608.396284:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18000/0xb50e82586761262b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1db expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.396298:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce18000/0xb50e82586761262b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1db expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.396323:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18000, rc 0) 00000100:00100000:3.0:1746126608.396377:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721280896:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5922us (6382us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.396385:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13073 00000100:00100000:0.0:1746126608.400814:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281152 00000100:00100000:0.0:1746126608.400824:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281152 00000100:00100000:3.0:1746126608.400931:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281024 00000100:00100000:3.0:1746126608.400936:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281024 00000100:00100000:3.0:1746126608.400975:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13074 00000100:00100000:3.0:1746126608.400983:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721281024:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.401000:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.401018:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18800/0xb50e825867612632 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1e2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.401072:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721299200:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126608.401158:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.401476:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13075 00000100:00100000:1.0:1746126608.401485:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721281152:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.401492:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.401500:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b0a00/0xb50e825867612639 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1e9 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.401526:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721299328:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126608.402073:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.404696:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721299200:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126608.404696:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721299328:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126608.404725:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18800/0xb50e825867612632 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1e2 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.404725:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b0a00/0xb50e825867612639 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1e9 expref: 29 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.404738:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce18800/0xb50e825867612632 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1e2 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.404738:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0a00/0xb50e825867612639 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1e9 expref: 29 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.404759:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18800, rc 0) 00010000:00010000:1.0:1746126608.404760:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b0a00, rc 0) 00000100:00100000:3.0:1746126608.404800:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721281024:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3817us (4303us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126608.404800:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721281152:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3315us (4355us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.404808:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13074 00000100:00100000:1.0:1746126608.404812:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13075 00000100:00100000:0.0:1746126608.420703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.420818:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281280 00000100:00100000:1.0:1746126608.420859:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281280 00000100:00100000:1.0:1746126608.421569:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8834 00000100:00100000:1.0:1746126608.421581:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31073:x1830945721281280:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.421605:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.421626:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1400/0xb50e825867612640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1f0 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.421689:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421701:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421712:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421729:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421735:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421740:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421879:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421889:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421894:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.421925:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126608.421929:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126608.421943:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421952:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421959:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421965:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421971:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421980:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348b0a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.421983:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421989:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.421999:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126608.422002:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.422005:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422009:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0a00/0xb50e825867612647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422038:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422043:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422048:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422052:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348b0000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.422054:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422060:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422066:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005a00) 00010000:00010000:1.0:1746126608.422068:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.422071:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422076:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0000/0xb50e82586761264e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.422100:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1400/0xb50e825867612640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1f0 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.422110:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1f0 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.422125:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.422127:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126608.422130:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b0200, rc 0) 00000100:00100000:1.0:1746126608.423187:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31073:x1830945721281280:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1605us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.423195:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8834 00000100:00100000:0.0:1746126608.426149:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.426224:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281536 00000100:00100000:3.0:1746126608.426235:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281536 00000100:00100000:3.0:1746126608.426297:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 676 00000100:00100000:3.0:1746126608.426305:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945721281536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.426321:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.426344:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867612655 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1f0 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.426362:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.426367:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.426406:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945721281536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.426412:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 676 00000100:00100000:0.0:1746126608.426542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.426622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.426637:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281408 00000100:00100000:3.0:1746126608.426640:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281408 00000100:00100000:0.0:1746126608.426640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.426706:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281792 00000100:00100000:3.0:1746126608.426709:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281792 00000100:00100000:0.0:1746126608.426715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.426764:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721281920 00000100:00100000:3.0:1746126608.426767:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721281920 00000100:00100000:0.0:1746126608.426779:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13076 00000100:00100000:3.0:1746126608.426786:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13077 00000100:00100000:0.0:1746126608.426787:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721281408:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:3.0:1746126608.426791:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721281792:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126608.426801:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.426801:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.426815:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce18400/0xb50e82586761265c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d205 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.426815:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867612663 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1f7 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.426854:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.426856:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.426863:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18400/0xb50e82586761265c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d205 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.426876:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18400/0xb50e82586761265c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d205 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.426885:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18400, rc 0) 00000100:00100000:3.0:1746126608.426907:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721281792:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.426912:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13077 00000100:00100000:3.0:1746126608.426922:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13078 00000100:00100000:3.0:1746126608.426927:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721281664:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126608.426932:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.426939:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18600/0xb50e82586761266a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d1fe expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.426973:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721299456:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126608.426995:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721299584:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126608.427018:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.427018:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a44e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.427035:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13079 00000100:00100000:3.0:1746126608.427040:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721281920:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126608.427046:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.427052:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867612671 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d20c expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.427062:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.427063:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.427067:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867612671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d20c expref: 11 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.427074:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18c00/0xb50e825867612671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d20c expref: 11 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.427082:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18c00, rc 0) 00000100:00100000:3.0:1746126608.427107:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721281920:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 68us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.427111:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13079 00000100:00100000:3.0:1746126608.428435:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721299456:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126608.428456:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18600/0xb50e82586761266a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1fe expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.428467:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce18600/0xb50e82586761266a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1fe expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.428475:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18600, rc 0) 00000100:00100000:3.0:1746126608.428507:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721281664:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1578us (1865us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.428512:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13078 00000100:00100000:1.0:1746126608.428526:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721299584:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126608.428666:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867612663 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1f7 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.428675:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867612663 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1f7 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.428686:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c78c00, rc 0) 00000100:00100000:1.0:1746126608.429013:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721281408:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2227us (2471us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126608.429019:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13076 00000100:00100000:0.0:1746126608.431540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.431633:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282176 00000100:00100000:1.0:1746126608.431641:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282176 00000100:00100000:1.0:1746126608.431700:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8835 00000100:00100000:1.0:1746126608.431707:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31073:x1830945721282176:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.431726:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.431744:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1c00/0xb50e825867612678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d213 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.431862:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.431877:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d156 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.431884:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.431889:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.431919:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.431931:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 18 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.431942:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721299712:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.432021:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d156 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.432167:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612567 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d156 expref: 14 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.432176:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721299840:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.432212:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.434889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.434964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.435583:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721299712:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.435593:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721299840:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.435624:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126608.435995:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6826 00000100:00100000:0.0:1746126608.436007:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721282304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126608.436018:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126608.436024:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 19 pid: 14548 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.436044:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 19 pid: 14548 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.436070:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4da00/0xb50e8258676125c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d179 expref: 19 pid: 14548 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.436087:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126608.436091:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126608.436101:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126608.436107:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126608.436763:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126608.436771:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.436779:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.436798:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:0.0:1746126608.436799:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721282304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 797us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.436808:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6826 00010000:00010000:1.0:1746126608.437176:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1c00/0xb50e825867612678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d213 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.437192:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d213 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.437198:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.437201:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126608.437203:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b0e00, rc 0) 00000100:00100000:1.0:1746126608.437237:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31073:x1830945721282176:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5531us (5705us total) trans 8589942995 rc 0/0 00000100:00100000:1.0:1746126608.437244:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8835 00000100:00100000:0.0:1746126608.439998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.440203:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282560 00000100:00100000:1.0:1746126608.440212:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282560 00000100:00100000:1.0:1746126608.440267:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8836 00000100:00100000:1.0:1746126608.440274:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31073:x1830945721282560:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.440298:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.440315:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0800/0xb50e82586761268d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d21a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.440394:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.440408:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d213 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.440414:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.440440:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d213 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.440451:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0e00/0xb50e82586761267f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d213 expref: 15 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.440462:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721299968:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.440545:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.443665:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721299968:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.443696:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126608.445080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126608.445650:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.445657:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.445700:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126608.445704:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126608.445720:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.445753:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0800/0xb50e82586761268d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d21a expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.445766:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1000/0xb50e825867612694 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d21a expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.445771:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.445774:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126608.445777:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1000, rc 0) 00000100:00100000:1.0:1746126608.446679:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31073:x1830945721282560:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6403us (6685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.446686:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8836 00000100:00100000:0.0:1746126608.448920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.448962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.449047:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282816 00000100:00100000:1.0:1746126608.449056:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282816 00000100:00100000:3.0:1746126608.449070:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721282944 00000100:00100000:3.0:1746126608.449075:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721282944 00000100:00100000:3.0:1746126608.452134:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13080 00000100:00100000:1.0:1746126608.452151:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13081 00000100:00100000:3.0:1746126608.452152:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721282944:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:1.0:1746126608.452166:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721282816:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126608.452173:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.452173:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.452191:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b1a00/0xb50e82586761269b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d221 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.452320:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18800/0xb50e8258676126a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d228 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.452352:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721300096:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126608.452472:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721300224:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126608.452700:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.453030:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.455054:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721300096:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126608.455083:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18800/0xb50e8258676126a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d228 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.455096:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce18800/0xb50e8258676126a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d228 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.455111:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18800, rc 0) 00000100:00100000:3.0:1746126608.455159:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721282944:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3014us (6195us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.455167:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13080 00000100:00100000:1.0:1746126608.455383:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b163b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721300224:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126608.455410:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b1a00/0xb50e82586761269b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d221 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.455422:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1a00/0xb50e82586761269b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d221 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.455429:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1a00, rc 0) 00000100:00100000:1.0:1746126608.455464:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721282816:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3306us (6550us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126608.455469:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13081 00000100:00100000:0.0:1746126608.458585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.459048:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283200 00000100:00100000:1.0:1746126608.459059:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283200 00000100:00100000:1.0:1746126608.459137:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8837 00000100:00100000:1.0:1746126608.459145:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31073:x1830945721283200:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.459166:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.459184:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1800/0xb50e8258676126a9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d22f expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.459488:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1e00/0xb50e8258676126b0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.459502:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1e00/0xb50e8258676126b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.459512:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1e00/0xb50e8258676126b0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.459524:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126608.459635:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1800/0xb50e8258676126a9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d22f expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.459651:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1e00/0xb50e8258676126b0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d22f expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.459658:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.459661:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126608.459663:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1e00, rc 0) 00000100:00100000:1.0:1746126608.459723:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:31073:x1830945721283200:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 579us (1148us total) trans 8589942996 rc 0/0 00000100:00100000:1.0:1746126608.459730:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8837 00000100:00100000:0.0:1746126608.462988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.463029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.463062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.463094:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.463128:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283328 00000100:00100000:0.0:1746126608.463137:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283328 00000100:00100000:0.0:1746126608.463172:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283456 00000100:00100000:0.0:1746126608.463174:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283456 00000100:00100000:0.0:1746126608.463184:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283584 00000100:00100000:0.0:1746126608.463186:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283584 00000100:00100000:0.0:1746126608.463195:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721283712 00000100:00100000:0.0:1746126608.463196:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721283712 00000100:00100000:0.0:1746126608.463209:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13082 00000100:00100000:0.0:1746126608.463215:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721283328:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126608.463258:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.463274:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.463287:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.463295:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.463302:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.463303:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.463306:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.463341:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.463354:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 13 pid: 8436 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746126608.463367:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721300352:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126608.463441:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.463448:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 9 pid: 10890 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746126608.463455:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721300480:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126608.463475:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.463482:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 15 pid: 8437 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746126608.463489:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721300608:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126608.463501:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093a446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.463525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.463571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.466880:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721300352:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.466894:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721300480:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.466901:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721300608:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.466929:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.480128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.480168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.480286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.480960:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284096 00000100:00100000:3.0:1746126608.480971:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284096 00010000:00010000:3.0:1746126608.481010:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 11 pid: 10890 timeout: 830 lvb_type: 1 00000100:00100000:3.0:1746126608.481036:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284224 00000100:00100000:3.0:1746126608.481039:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284224 00010000:00010000:3.0:1746126608.481049:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 14 pid: 8436 timeout: 830 lvb_type: 1 00000100:00100000:3.0:1746126608.481060:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284352 00000100:00100000:3.0:1746126608.481062:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284352 00010000:00010000:3.0:1746126608.481072:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 16 pid: 8437 timeout: 830 lvb_type: 1 00000100:00100000:3.0:1746126608.481088:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6829 00000100:00100000:3.0:1746126608.481095:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721284096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.481110:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.481144:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 11 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481155:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 11 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481177:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec79c00/0xb50e825867612521 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d125 expref: 11 pid: 10890 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481197:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.481240:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721284096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 145us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.481245:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6829 00000100:00100000:3.0:1746126608.481288:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6830 00000100:00100000:3.0:1746126608.481292:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721284224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.481298:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.481305:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 14 pid: 8436 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481313:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 14 pid: 8436 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481323:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65800/0xb50e8258676123c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d061 expref: 14 pid: 8436 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481336:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.481350:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721284224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 57us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.481355:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6830 00000100:00100000:3.0:1746126608.481365:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6831 00000100:00100000:3.0:1746126608.481369:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721284352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.481374:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.481380:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 16 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481388:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 16 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481398:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53bfa00/0xb50e825867612384 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d037 expref: 16 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:3.0:1746126608.481407:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.481410:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.481414:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.481422:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.481451:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.481467:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721284352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 97us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.481473:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6831 00010000:00010000:1.0:1746126608.481792:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.481801:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.481821:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.481964:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.481972:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.481978:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4c79200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126608.481981:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.481989:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.482000:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.482006:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79200/0xb50e8258676126be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.482384:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721283328:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 19167us (19405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.482392:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13082 00000100:00100000:1.0:1746126608.482848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.482868:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.483426:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721300736:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.483447:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e8258676126c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.484252:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284736 00000100:00100000:0.0:1746126608.484258:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284736 00010000:00010000:0.0:1746126608.484278:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0e6 expref: 13 pid: 23766 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746126608.484297:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6832 00000100:00100000:0.0:1746126608.484303:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721284736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126608.484311:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126608.484329:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0e6 expref: 13 pid: 23766 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746126608.484339:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0e6 expref: 13 pid: 23766 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746126608.484358:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4cd200/0xb50e825867612495 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0e6 expref: 13 pid: 23766 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746126608.484380:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.487188:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721284480 00000100:00100000:1.0:1746126608.487193:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721284480 00002000:00100000:1.0:1746126608.487221:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1773567) req@ffff880098d98380 x1830945721284480/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.487230:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098d98380 with x1830945721284480 ext(1048576->1773567) 00010000:00010000:1.0:1746126608.487236:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 11 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.487245:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 11 pid: 23766 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746126608.487251:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098d98380 00000100:00100000:1.0:1746126608.487263:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1706 00000100:00100000:1.0:1746126608.487269:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721284480:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126608.491469:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721284736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7151us (8584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.491799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.491883:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6832 00000100:00100000:1.0:1746126608.492142:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721285760 00000100:00100000:1.0:1746126608.492152:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721285760 00010000:00010000:1.0:1746126608.492181:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 26 pid: 17475 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.492207:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6840 00000100:00100000:1.0:1746126608.492214:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721285760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.492226:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.492251:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 26 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.492262:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 26 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.492284:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e8258676125d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d187 expref: 26 pid: 17475 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.492297:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.492299:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.492303:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adb2e00/0xb50e8258676126e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.492311:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb2e00/0xb50e8258676126e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.492334:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.492384:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721285760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 170us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.492390:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6840 00000100:00100000:0.0:1746126608.500791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.501697:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721285888 00000100:00100000:3.0:1746126608.501707:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721285888 00010000:00010000:3.0:1746126608.501744:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 13 pid: 23766 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.501777:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6841 00000100:00100000:3.0:1746126608.501784:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721285888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.501799:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.501820:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 13 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.501853:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 13 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.501875:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78200/0xb50e825867612608 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1b8 expref: 13 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.501900:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.501902:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.501907:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e8258676126c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.501915:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e8258676126c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.501945:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.501987:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721285888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 204us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.501994:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6841 00000100:00100000:0.0:1746126608.514946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.518894:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6842 00000100:00100000:3.0:1746126608.518908:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721286016:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.518925:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.518952:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 12 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.518966:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 12 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.518989:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c79c00/0xb50e82586761260f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1773567) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d1bf expref: 12 pid: 23766 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.519019:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.519021:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.519026:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e8258676126cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.519034:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e8258676126cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.519061:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.519371:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721286016:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 466us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.519378:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6842 00000100:00100000:0.0:1746126608.525567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.535329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.535473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.535522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.536906:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721286656 00000100:00100000:3.0:1746126608.536921:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721286656 00010000:00010000:3.0:1746126608.536967:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1e00/0xb50e8258676124fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d117 expref: 236 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.537001:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721286528 00000100:00100000:3.0:1746126608.537005:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721286528 00010000:00010000:3.0:1746126608.537018:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d55d200/0xb50e82586761221f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4cf57 expref: 18 pid: 15560 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.537049:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721286400 00000100:00100000:3.0:1746126608.537053:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721286400 00010000:00010000:3.0:1746126608.537065:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d8 expref: 19 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746126608.538248:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721302528:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126608.538274:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec81800/0xb50e8258676126e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:3.0:1746126608.539784:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6845 00000100:00100000:3.0:1746126608.539792:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721286400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.539800:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.539804:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d8 expref: 17 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.539812:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d8 expref: 17 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.539844:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4cc000/0xb50e825867612480 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d0d8 expref: 17 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.539856:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.539859:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec81800/0xb50e8258676126e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.539864:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.539892:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721286400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 102us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.539897:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6845 00000100:00100000:1.0:1746126608.540246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126608.541980:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec81800/0xb50e8258676126e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126608.541988:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec81800/0xb50e8258676126e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000040:00080000:0.0:1746126608.542671:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2579, 88 off218800 00000004:00080000:0.0:1746126608.542678:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730456850224ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.542773:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2686, 88 off228312 00000004:00080000:0.0:1746126608.542778:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730456950252ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543436:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2687, 88 off228400 00000004:00080000:0.0:1746126608.543440:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457612914ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543448:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2580, 88 off218888 00000004:00080000:0.0:1746126608.543451:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457623098ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.543460:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2581, 88 off218976 00000004:00080000:0.0:1746126608.543462:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457634669ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.543469:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2688, 88 off228488 00000004:00080000:0.0:1746126608.543472:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457644473ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543478:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2689, 88 off228576 00000004:00080000:0.0:1746126608.543480:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457652593ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543485:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2582, 88 off219064 00000004:00080000:0.0:1746126608.543488:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457660192ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.543494:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2690, 88 off228664 00000004:00080000:0.0:1746126608.543496:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457668388ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543502:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2583, 88 off219152 00000004:00080000:0.0:1746126608.543504:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457676869ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.543510:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2691, 88 off228752 00000004:00080000:0.0:1746126608.543513:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457685113ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543518:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2584, 88 off219240 00000004:00080000:0.0:1746126608.543520:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457693039ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.543526:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2692, 88 off228840 00000004:00080000:0.0:1746126608.543528:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457700769ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543534:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2585, 88 off219328 00000004:00080000:0.0:1746126608.543536:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457708958ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126608.543542:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2693, 88 off228928 00000004:00080000:0.0:1746126608.543544:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457716913ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543550:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2694, 88 off229016 00000004:00080000:0.0:1746126608.543553:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730457725198ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126608.543558:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2586, 88 off219416 00000004:00080000:0.0:1746126608.543561:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730457733543ns, next at 687927188999ns, rc = 0 00000001:00080000:1.0:1746126608.569174:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942997 is committed 00000004:00080000:1.0:1746126608.569182:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1972 committed 00000004:00080000:1.0:1746126608.569190:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2077 committed 00000004:00080000:1.0:1746126608.569196:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2076 committed 00000004:00080000:1.0:1746126608.569198:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1971 committed 00000004:00080000:1.0:1746126608.569199:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2075 committed 00000004:00080000:1.0:1746126608.569201:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1970 committed 00000004:00080000:1.0:1746126608.569202:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2074 committed 00000004:00080000:1.0:1746126608.569203:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1969 committed 00000004:00080000:1.0:1746126608.569204:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2073 committed 00000004:00080000:1.0:1746126608.569205:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1968 committed 00000004:00080000:1.0:1746126608.569206:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2072 committed 00000004:00080000:1.0:1746126608.569207:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2071 committed 00000004:00080000:1.0:1746126608.569208:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1967 committed 00000004:00080000:1.0:1746126608.569209:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1966 committed 00000004:00080000:1.0:1746126608.569211:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2070 committed 00000004:00080000:1.0:1746126608.569212:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2069 committed 00000004:00080000:1.0:1746126608.569213:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1965 committed 00000001:00080000:1.0:1746126608.569229:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942994 is committed 00000001:00080000:1.0:1746126608.569236:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942989 is committed 00000001:00080000:1.0:1746126608.571910:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942993 is committed 00000100:00100000:1.0:1746126608.572014:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572040:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.572069:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572081:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.572091:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126608.572095:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721303680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.572126:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572139:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.572156:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304064 00000100:00100000:1.0:1746126608.572160:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304064 00000100:00100000:1.0:1746126608.572177:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304576 00000100:00100000:1.0:1746126608.572179:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304576 00000100:00100000:1.0:1746126608.572187:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721303680 00000100:00100000:1.0:1746126608.572189:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721303680 00000100:00100000:1.0:1746126608.572196:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304192 00000100:00100000:1.0:1746126608.572198:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304192 00000100:00100000:1.0:1746126608.572205:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13096 00000100:00100000:1.0:1746126608.572209:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3294:x1830945721304064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572330:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3294:x1830945721304064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (283us total) trans 17179873101 rc 0/0 00000100:00100000:1.0:1746126608.572335:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13096 00000100:00100000:1.0:1746126608.572343:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13098 00000100:00100000:1.0:1746126608.572347:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3294:x1830945721303680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572407:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3294:x1830945721303680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (299us total) trans 17179873103 rc 0/0 00000100:00100000:1.0:1746126608.572413:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13098 00000100:00100000:1.0:1746126608.572419:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13099 00000100:00100000:1.0:1746126608.572423:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3294:x1830945721304192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126608.572488:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126608.572491:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126608.572493:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126608.572495:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126608.572497:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126608.572510:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3294:x1830945721304192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (370us total) trans 17179873104 rc 0/0 00000100:00100000:1.0:1746126608.572515:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13099 00000100:00100000:1.0:1746126608.572523:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721303808 00000100:00100000:1.0:1746126608.572526:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721303808 00000100:00100000:1.0:1746126608.572535:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304320 00000100:00100000:1.0:1746126608.572537:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304320 00000100:00100000:1.0:1746126608.572544:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13100 00000100:00100000:1.0:1746126608.572548:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1830945721303808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572628:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1830945721303808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (127us total) trans 17179873105 rc 0/0 00000100:00100000:1.0:1746126608.572632:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13100 00000100:00100000:1.0:1746126608.572640:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13103 00000100:00100000:1.0:1746126608.572644:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721304448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.572704:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1830945721304448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (142us total) trans 17179873107 rc 0/0 00000100:00100000:1.0:1746126608.572708:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13103 00000100:00100000:1.0:1746126608.572739:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873084 gen 2 00000004:00080000:1.0:1746126608.572742:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b192300, transno 17179873012 00000004:00080000:1.0:1746126608.572747:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15d500, transno 17179873013 00000004:00080000:1.0:1746126608.572750:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b190700, transno 17179873014 00000004:00080000:1.0:1746126608.572751:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15ca80, transno 17179873015 00000004:00080000:1.0:1746126608.572754:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b191f80, transno 17179873016 00000004:00080000:1.0:1746126608.572756:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b190e00, transno 17179873017 00000004:00080000:1.0:1746126608.572759:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b191500, transno 17179873018 00000004:00080000:1.0:1746126608.572761:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b193800, transno 17179873019 00000004:00080000:1.0:1746126608.572764:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b191c00, transno 17179873020 00000004:00080000:1.0:1746126608.572767:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e9180, transno 17179873021 00000004:00080000:1.0:1746126608.572769:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918ebb80, transno 17179873022 00000004:00080000:1.0:1746126608.572771:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8e00, transno 17179873023 00000004:00080000:1.0:1746126608.572773:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918ead80, transno 17179873024 00000004:00080000:1.0:1746126608.572775:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e9500, transno 17179873025 00000004:00080000:1.0:1746126608.572778:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8700, transno 17179873026 00000004:00080000:1.0:1746126608.572781:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e9880, transno 17179873027 00000004:00080000:1.0:1746126608.572783:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918eb480, transno 17179873028 00000004:00080000:1.0:1746126608.572785:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8a80, transno 17179873029 00000004:00080000:1.0:1746126608.572787:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17100, transno 17179873032 00000004:00080000:1.0:1746126608.572789:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14000, transno 17179873033 00000004:00080000:1.0:1746126608.572791:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14700, transno 17179873034 00000004:00080000:1.0:1746126608.572793:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b16680, transno 17179873035 00000004:00080000:1.0:1746126608.572796:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17b80, transno 17179873036 00000004:00080000:1.0:1746126608.572798:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17480, transno 17179873037 00000004:00080000:1.0:1746126608.572801:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15c00, transno 17179873038 00000004:00080000:1.0:1746126608.572803:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15180, transno 17179873039 00000004:00080000:1.0:1746126608.572805:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b16300, transno 17179873040 00000004:00080000:1.0:1746126608.572807:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fd500, transno 17179873041 00000004:00080000:1.0:1746126608.572809:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff480, transno 17179873042 00000004:00080000:1.0:1746126608.572811:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fdf80, transno 17179873043 00000004:00080000:1.0:1746126608.572814:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fca80, transno 17179873044 00000004:00080000:1.0:1746126608.572816:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fce00, transno 17179873045 00000004:00080000:1.0:1746126608.572818:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fc380, transno 17179873046 00000004:00080000:1.0:1746126608.572821:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff100, transno 17179873047 00000004:00080000:1.0:1746126608.572824:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f9880, transno 17179873048 00000004:00080000:1.0:1746126608.572845:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fed80, transno 17179873049 00000004:00080000:1.0:1746126608.572847:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369fb800, transno 17179873052 00000004:00080000:1.0:1746126608.572849:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f8380, transno 17179873053 00000004:00080000:1.0:1746126608.572851:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f8a80, transno 17179873054 00000004:00080000:1.0:1746126608.572853:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f9500, transno 17179873055 00000004:00080000:1.0:1746126608.572855:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f8e00, transno 17179873056 00000004:00080000:1.0:1746126608.572857:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369fa680, transno 17179873057 00000004:00080000:1.0:1746126608.572860:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f9c00, transno 17179873058 00000004:00080000:1.0:1746126608.572862:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801369f9f80, transno 17179873059 00000004:00080000:1.0:1746126608.572864:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af5880, transno 17179873060 00000004:00080000:1.0:1746126608.572867:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099251c00, transno 17179873061 00000004:00080000:1.0:1746126608.572869:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14380, transno 17179873062 00000004:00080000:1.0:1746126608.572872:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3a7b80, transno 17179873063 00000004:00080000:1.0:1746126608.572874:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e804000, transno 17179873064 00000004:00080000:1.0:1746126608.572876:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14e00, transno 17179873065 00000004:00080000:1.0:1746126608.572878:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e806300, transno 17179873066 00000004:00080000:1.0:1746126608.572879:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e804380, transno 17179873067 00000004:00080000:1.0:1746126608.572881:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099252a00, transno 17179873068 00000004:00080000:1.0:1746126608.572883:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e804700, transno 17179873069 00000004:00080000:1.0:1746126608.572885:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f136300, transno 17179873076 00000004:00080000:1.0:1746126608.572887:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091da1180, transno 17179873077 00000004:00080000:1.0:1746126608.572889:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f136a00, transno 17179873078 00000004:00080000:1.0:1746126608.572890:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f135500, transno 17179873079 00000004:00080000:1.0:1746126608.572892:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f137b80, transno 17179873080 00000004:00080000:1.0:1746126608.572894:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091da0e00, transno 17179873081 00000004:00080000:1.0:1746126608.572896:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f137480, transno 17179873082 00000004:00080000:1.0:1746126608.572899:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091da1f80, transno 17179873083 00000004:00080000:1.0:1746126608.572901:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5c00, transno 17179873084 00000100:00100000:1.0:1746126608.572906:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009e3f6d80 x1830945721285504/t17179873085(17179873085) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126623 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746126608.572912:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fdc00/2, rc 0, transno 17179873103 00000100:00100000:1.0:1746126608.572915:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721303680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126608.573857:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15ce00/2, rc 0, transno 17179873104 00000100:00100000:1.0:1746126608.573860:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126608.573868:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15d180/2, rc 0, transno 17179873101 00000100:00100000:1.0:1746126608.573871:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126608.573877:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df6680/2, rc 0, transno 17179873102 00000100:00100000:1.0:1746126608.573880:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304576:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126608.574523:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 17 in progress, 0 in flight, 63 done 00000100:00100000:1.0:1746126608.574561:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746126608.574569:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.574601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126608.574669:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304704 00000100:00100000:0.0:1746126608.574675:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304704 00000100:00100000:0.0:1746126608.574703:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13104 00000100:00100000:0.0:1746126608.574711:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721304704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126608.574870:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721304704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (267us total) trans 17179873109 rc 0/0 00000100:00100000:0.0:1746126608.574875:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13104 00000004:00080000:1.0:1746126608.575292:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df5500/2, rc 0, transno 17179873109 00000100:00100000:1.0:1746126608.575296:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126608.577715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.588402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.591537:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287040 00000100:00100000:1.0:1746126608.591553:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287040 00000100:00100000:1.0:1746126608.591617:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8840 00000100:00100000:1.0:1746126608.591628:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31073:x1830945721287040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.591652:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.591675:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e8258676126f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d23d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.591770:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e8258676126fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.591786:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e8258676126fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.591798:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e8258676126fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126608.591846:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126608.591850:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126608.591865:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e8258676126fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.591887:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1200/0xb50e8258676126f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d23d expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.591921:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927e1e00/0xb50e8258676126fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d23d expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.591929:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.591932:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126608.591934:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927e1e00, rc 0) 00000100:00100000:1.0:1746126608.591983:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31073:x1830945721287040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 359us (3594us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.591989:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8840 00000100:00100000:0.0:1746126608.597156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.597200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.597226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.597250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.597262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.597273:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287296 00000100:00100000:1.0:1746126608.597283:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287296 00000100:00100000:1.0:1746126608.597329:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287552 00000100:00100000:0.0:1746126608.597332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.597334:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287552 00000100:00100000:1.0:1746126608.597354:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287808 00000100:00100000:1.0:1746126608.597357:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287808 00000100:00100000:1.0:1746126608.597372:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287168 00000100:00100000:1.0:1746126608.597375:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287168 00000100:00100000:1.0:1746126608.597389:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287424 00000100:00100000:1.0:1746126608.597392:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287424 00000100:00100000:1.0:1746126608.597405:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721287680 00000100:00100000:1.0:1746126608.597408:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721287680 00000100:00100000:0.0:1746126608.597419:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13105 00000100:00100000:0.0:1746126608.597428:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721287296:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:1.0:1746126608.597438:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13106 00000100:00100000:1.0:1746126608.597445:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721287552:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.597447:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.597455:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.597464:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d24b expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.597471:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d259 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126608.597486:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c710, atime: 0x6813c70e, ctime: 0x6813c710, blocks: 0x821 00002000:00010000:1.0:1746126608.597491:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c70f, atime: 0x6813c70a, ctime: 0x6813c70f, blocks: 0x81d 00010000:00010000:0.0:1746126608.597502:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.597504:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.597504:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.597506:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.597511:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597513:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.597524:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597525:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597536:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c2a00, rc 0) 00010000:00010000:0.0:1746126608.597536:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec81c00, rc 0) 00000100:00100000:0.0:1746126608.597573:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721287296:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 147us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.597579:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13105 00000100:00100000:0.0:1746126608.597595:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13107 00000100:00100000:0.0:1746126608.597599:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721287808:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.597604:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.597612:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d267 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.597621:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13108 00002000:00010000:0.0:1746126608.597622:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c70f, atime: 0x6813c70e, ctime: 0x6813c70f, blocks: 0x1029 00000100:00100000:3.0:1746126608.597630:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721287168:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126608.597630:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.597631:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.597635:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.597639:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.597643:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.597649:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec80a00, rc 0) 00010000:00010000:3.0:1746126608.597651:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d244 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126608.597675:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c709, atime: 0x6813c709, ctime: 0x6813c709, blocks: 0x7a1 00010000:00010000:3.0:1746126608.597686:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.597688:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.597694:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d244 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.597704:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d244 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.597717:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce18a00, rc 0) 00000100:00100000:1.0:1746126608.597758:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721287552:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 313us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.597763:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13106 00000100:00100000:1.0:1746126608.597775:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13109 00000100:00100000:1.0:1746126608.597779:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721287424:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.597785:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.597792:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d252 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126608.597802:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c710, atime: 0x6813c70f, ctime: 0x6813c710, blocks: 0x81f 00010000:00010000:1.0:1746126608.597810:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.597811:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.597815:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597822:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597860:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c2800, rc 0) 00000100:00100000:1.0:1746126608.597876:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721287424:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 96us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.597880:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13109 00000100:00100000:1.0:1746126608.597890:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13110 00000100:00100000:1.0:1746126608.597894:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721287680:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.597899:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.597906:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c3400/0xb50e825867612727 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d260 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126608.597916:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c70f, atime: 0x6813c70e, ctime: 0x6813c70f, blocks: 0x163f 00010000:00010000:1.0:1746126608.597922:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.597923:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.597927:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c3400/0xb50e825867612727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d260 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597934:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c3400/0xb50e825867612727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d260 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126608.597940:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c3400, rc 0) 00000100:00100000:1.0:1746126608.597951:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721287680:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 57us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.597955:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13110 00000100:00100000:0.0:1746126608.597999:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721287808:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 398us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.598004:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13107 00000100:00100000:3.0:1746126608.598026:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721287168:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 399us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.598031:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13108 00000100:00100000:0.0:1746126608.618086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.618273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.622230:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721288064 00000100:00100000:1.0:1746126608.622246:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721288064 00000100:00100000:1.0:1746126608.622327:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721288320 00000100:00100000:1.0:1746126608.622330:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721288320 00000100:00100000:1.0:1746126608.622352:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721288576 00000100:00100000:1.0:1746126608.622355:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721288576 00000100:00100000:1.0:1746126608.622375:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721288832 00000100:00100000:1.0:1746126608.622378:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721288832 00000100:00100000:1.0:1746126608.622394:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721289088 00000100:00100000:1.0:1746126608.622397:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721289088 00000100:00100000:1.0:1746126608.622410:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721289344 00000100:00100000:1.0:1746126608.622412:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721289344 00000100:00100000:1.0:1746126608.622422:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721289600 00000100:00100000:1.0:1746126608.622425:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721289600 00000100:00100000:1.0:1746126608.622438:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721289856 00000100:00100000:1.0:1746126608.622440:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721289856 00000100:00100000:1.0:1746126608.622462:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7484 00000100:00100000:1.0:1746126608.622471:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721288064:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126608.622510:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b897600/0xb50e82586761272e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.622525:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.622527:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.622532:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b897600/0xb50e82586761272e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.622545:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b897600/0xb50e82586761272e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.624084:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7485 00000100:00100000:1.0:1746126608.624094:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1965:x1830945721288320:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126608.624129:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.624144:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.624145:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.624149:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.624160:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.625351:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7486 00000100:00100000:3.0:1746126608.625361:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1965:x1830945721288576:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126608.625384:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.625393:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.625394:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.625397:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.625406:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.625692:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7487 00000100:00100000:0.0:1746126608.625702:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1965:x1830945721288832:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126608.625724:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.625733:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.625734:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.625737:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.625745:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.626603:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7488 00000100:00100000:3.0:1746126608.626610:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1965:x1830945721289088:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126608.626627:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.626634:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.626635:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.626638:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.626650:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.627919:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7489 00000100:00100000:0.0:1746126608.627929:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1965:x1830945721289344:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126608.627951:0:21461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.627960:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.627961:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.627964:0:21461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.627979:0:21461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.628181:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7490 00000100:00100000:3.0:1746126608.628191:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1965:x1830945721289600:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126608.628212:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.628220:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.628221:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.628225:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.628232:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648251:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648267:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648274:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648280:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce18200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126608.648284:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648292:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648307:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.648312:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce18200/0xb50e82586761273c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.650477:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1965:x1830945721288576:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 25107us (32291us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.650487:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7486 00010000:00010000:0.0:1746126608.656397:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.656415:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.656422:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.656428:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927e1200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126608.656432:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.656438:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.656455:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.656460:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927e1200/0xb50e825867612743 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.660564:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1965:x1830945721288832:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 34851us (42364us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126608.660581:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7487 00010000:00010000:3.0:1746126608.661340:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.661352:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.661359:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.661365:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce18600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126608.661369:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.661378:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.661397:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.661404:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18600/0xb50e82586761274a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.661445:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721289088:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 34836us (43233us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.661452:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7488 00010000:00010000:0.0:1746126608.668699:0:21461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.668716:0:21461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.668724:0:21461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.668730:0:21461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927e0600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126608.668734:0:21461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.668741:0:21461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.668759:0:21461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.668764:0:21461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927e0600/0xb50e825867612751 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.668862:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1965:x1830945721289344:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 40930us (50631us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126608.668872:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7489 00010000:00010000:3.0:1746126608.677529:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.677544:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.677552:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.677558:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58d0e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126608.677562:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.677570:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.677590:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.677601:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58d0e00/0xb50e82586761275f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.677701:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721289856:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 48503us (59420us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.677712:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7491 00010000:00010000:1.0:1746126608.680504:0:21462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.680518:0:21462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.680525:0:21462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.680532:0:21462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b896c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126608.680536:0:21462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.680543:0:21462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.680560:0:21462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.680566:0:21462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b896c00/0xb50e825867612735 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.680692:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721288320:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 56596us (62544us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126608.680702:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7485 00010000:00010000:3.0:1746126608.682699:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.682712:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.682719:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.682725:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce18000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126608.682728:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.682734:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.682747:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.682753:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18000/0xb50e825867612758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.682817:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721289600:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 54624us (64572us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.682824:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7490 00000100:00100000:0.0:1746126608.687511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.690380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.690410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.690435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.690487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.691303:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13112 00000100:00100000:1.0:1746126608.691311:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721290240:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:1.0:1746126608.691424:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126608.691427:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126601 -> 1746126608 00002000:00010000:1.0:1746126608.691429:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126601 -> 1746126608 00002000:00010000:1.0:1746126608.691430:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126601 -> 1746126608 00002000:00010000:1.0:1746126608.691432:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:1.0:1746126608.691477:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721290240:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 167us (1065us total) trans 21474840262 rc 0/0 00000100:00100000:1.0:1746126608.691484:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13112 00000100:00100000:1.0:1746126608.691499:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13113 00000100:00100000:1.0:1746126608.691503:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721290496:12345-192.168.203.2@tcp:2:lfs.0 00000100:00100000:0.0:1746126608.691559:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13114 00002000:00010000:1.0:1746126608.691564:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126608.691566:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00000100:00100000:0.0:1746126608.691567:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721290752:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:1.0:1746126608.691568:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126607 -> 1746126608 00002000:00010000:1.0:1746126608.691570:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.691571:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746126608.691588:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721290496:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 85us (1152us total) trans 17179873111 rc 0/0 00000100:00100000:1.0:1746126608.691593:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13113 00002000:00010000:0.0:1746126608.691643:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126608.691645:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126607 -> 1746126608 00002000:00010000:0.0:1746126608.691647:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126606 -> 1746126608 00002000:00010000:0.0:1746126608.691648:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126607 -> 1746126608 00002000:00010000:0.0:1746126608.691650:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:0.0:1746126608.691666:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721290752:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 101us (1178us total) trans 21474840263 rc 0/0 00000100:00100000:0.0:1746126608.691671:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13114 00000100:00100000:0.0:1746126608.691728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.691759:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721290624 00000100:00100000:1.0:1746126608.691762:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721290624 00000100:00100000:0.0:1746126608.691797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.692319:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721290880 00000100:00100000:1.0:1746126608.692323:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721290880 00000100:00100000:1.0:1746126608.692341:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13115 00000100:00100000:1.0:1746126608.692346:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721290624:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:1.0:1746126608.692598:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126608.692600:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126607 -> 1746126608 00002000:00010000:1.0:1746126608.692602:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126602 -> 1746126608 00002000:00010000:1.0:1746126608.692604:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126607 -> 1746126608 00002000:00010000:1.0:1746126608.692606:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746126608.692623:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721290624:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 277us (895us total) trans 21474840264 rc 0/0 00000100:00100000:1.0:1746126608.692628:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13115 00000100:00100000:0.0:1746126608.694357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.694445:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721291136 00000100:00100000:1.0:1746126608.694452:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721291136 00000100:00100000:1.0:1746126608.695027:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3713 00000100:00100000:1.0:1746126608.695035:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31073:x1830945721291136:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:1.0:1746126608.695090:0:16623:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2a7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1e00/0xb50e8258676126b0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d22f expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.695146:0:16623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.695158:0:16623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676126ef lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d236 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.695165:0:16623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.695196:0:16623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676126ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d236 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.695208:0:16623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676126ef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d236 expref: 9 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.695232:0:16623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16623:1830945721304832:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.695316:0:16623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.697887:0:16623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16623:1830945721304832:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.697917:0:16623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16623 initiator: MDT0 00000100:00100000:0.0:1746126608.698198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126608.699019:0:16623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.699025:0:16623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16623 initiator: MDT0 00000040:00080000:1.0:1746126608.699553:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2587, 88 off219504 00000004:00080000:1.0:1746126608.699560:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613731689ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699587:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2695, 88 off229104 00000004:00080000:1.0:1746126608.699590:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613762893ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699601:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2696, 88 off229192 00000004:00080000:1.0:1746126608.699604:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613776444ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699610:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2588, 88 off219592 00000004:00080000:1.0:1746126608.699613:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613785539ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699619:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2589, 88 off219680 00000004:00080000:1.0:1746126608.699621:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613793712ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699628:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2697, 88 off229280 00000004:00080000:1.0:1746126608.699631:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613803288ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699660:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2699, 88 off229464 00000004:00080000:1.0:1746126608.699664:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613836559ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699672:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2590, 88 off219768 00000004:00080000:1.0:1746126608.699674:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613846569ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699680:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2700, 88 off229552 00000004:00080000:1.0:1746126608.699682:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613854525ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699688:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2591, 88 off219856 00000004:00080000:1.0:1746126608.699690:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613862952ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699696:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2701, 88 off229640 00000004:00080000:1.0:1746126608.699698:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613870682ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699704:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2592, 88 off219944 00000004:00080000:1.0:1746126608.699706:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613878693ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699711:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2702, 88 off229728 00000004:00080000:1.0:1746126608.699713:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613885908ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699719:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2593, 88 off220032 00000004:00080000:1.0:1746126608.699721:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613893662ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126608.699727:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2703, 88 off229816 00000004:00080000:1.0:1746126608.699731:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613903368ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699737:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2704, 88 off229904 00000004:00080000:1.0:1746126608.699739:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730613911627ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126608.699745:0:16623:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2594, 88 off220120 00000004:00080000:1.0:1746126608.699747:0:16623:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730613919817ns, next at 687927188999ns, rc = 0 00000004:00010000:1.0:1746126608.725552:0:16623:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b163480 reply state ffff880092e80800 transno 8589942999 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16623 initiator: MDT0 00000100:00100000:1.0:1746126608.725574:0:16623:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746126608.725585:0:16623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.725588:0:16623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126608.725597:0:16623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1e00/0xb50e8258676126b0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d22f expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.725710:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31073:x1830945721291136:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 30675us (31357us total) trans 8589942999 rc 0/0 00000100:00100000:1.0:1746126608.725720:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3713 00000001:00080000:1.0:1746126608.725775:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942999 is committed 00000004:00080000:1.0:1746126608.725781:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1980 committed 00000004:00080000:1.0:1746126608.725803:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2086 committed 00000004:00080000:1.0:1746126608.725809:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2085 committed 00000004:00080000:1.0:1746126608.725811:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1979 committed 00000004:00080000:1.0:1746126608.725813:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2084 committed 00000004:00080000:1.0:1746126608.725815:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1978 committed 00000004:00080000:1.0:1746126608.725816:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2083 committed 00000004:00080000:1.0:1746126608.725818:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1977 committed 00000004:00080000:1.0:1746126608.725819:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2082 committed 00000004:00080000:1.0:1746126608.725820:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1976 committed 00000004:00080000:1.0:1746126608.725822:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2081 committed 00000004:00080000:1.0:1746126608.725824:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2080 committed 00000004:00080000:1.0:1746126608.725843:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1975 committed 00000004:00080000:1.0:1746126608.725845:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1974 committed 00000004:00080000:1.0:1746126608.725846:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2079 committed 00000004:00080000:1.0:1746126608.725848:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2078 committed 00000004:00080000:1.0:1746126608.725850:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1973 committed 00010000:00010000:1.0:1746126608.725971:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.725981:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.725987:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.725992:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b1200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.725996:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.726003:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.726017:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.726019:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126608.726022:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16623 initiator: MDT0 00010000:00010000:1.0:1746126608.726027:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b1200/0xb50e82586761276d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16623 initiator: MDT0 00000100:00100000:1.0:1746126608.726168:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721305216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.726211:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.726534:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721305600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.726555:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.726569:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721306112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.726994:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721305088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.727018:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.727037:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721305472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.727050:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.727060:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721305984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.727072:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.727082:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721306496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.727097:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.727133:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305216 00000100:00100000:3.0:1746126608.727140:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305216 00000100:00100000:3.0:1746126608.727170:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305600 00000100:00100000:3.0:1746126608.727172:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305600 00000100:00100000:3.0:1746126608.727181:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305088 00000100:00100000:3.0:1746126608.727183:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305088 00000100:00100000:3.0:1746126608.727191:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305472 00000100:00100000:3.0:1746126608.727192:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305472 00000100:00100000:3.0:1746126608.727201:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305984 00000100:00100000:3.0:1746126608.727202:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305984 00000100:00100000:3.0:1746126608.727210:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306496 00000100:00100000:3.0:1746126608.727211:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306496 00000100:00100000:3.0:1746126608.727220:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13117 00000100:00100000:3.0:1746126608.727225:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3297:x1830945721305216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.727273:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727282:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721306624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727293:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727311:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721305344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.727326:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727333:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721305728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727356:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727363:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721306240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727380:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721306752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.727392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727399:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746126608.727403:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727414:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746126608.727417:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746126608.727420:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721305856:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126608.727421:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.727423:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.727425:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.727427:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746126608.727431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.727437:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721306368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.727448:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.727449:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3297:x1830945721305216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (1238us total) trans 17179873113 rc 0/0 00000100:00100000:1.0:1746126608.727454:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721306880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.727455:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13117 00000100:00100000:1.0:1746126608.727464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.727466:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306112 00000100:00100000:3.0:1746126608.727468:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306112 00000100:00100000:3.0:1746126608.727475:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306624 00000100:00100000:3.0:1746126608.727476:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306624 00000100:00100000:1.0:1746126608.727480:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305344 00000100:00100000:3.0:1746126608.727482:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305728 00000100:00100000:1.0:1746126608.727482:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305344 00000100:00100000:3.0:1746126608.727483:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305728 00000100:00100000:3.0:1746126608.727487:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306240 00000100:00100000:3.0:1746126608.727489:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306240 00000100:00100000:3.0:1746126608.727493:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306752 00000100:00100000:1.0:1746126608.727494:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304960 00000100:00100000:3.0:1746126608.727495:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306752 00000100:00100000:1.0:1746126608.727496:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304960 00000100:00100000:3.0:1746126608.727500:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305856 00000100:00100000:3.0:1746126608.727501:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305856 00000100:00100000:1.0:1746126608.727501:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306368 00000100:00100000:1.0:1746126608.727502:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306368 00000100:00100000:3.0:1746126608.727506:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306880 00000100:00100000:3.0:1746126608.727507:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306880 00000100:00100000:1.0:1746126608.727510:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13118 00000100:00100000:3.0:1746126608.727514:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13119 00000100:00100000:1.0:1746126608.727514:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721305600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.727517:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3296:x1830945721305088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126608.727583:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126608.727585:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.727587:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.727589:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.727591:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746126608.727607:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126608.727610:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00000100:00100000:3.0:1746126608.727612:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721305088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (593us total) trans 17179873114 rc 0/0 00002000:00010000:1.0:1746126608.727612:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.727614:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.727616:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:3.0:1746126608.727617:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13119 00000100:00100000:3.0:1746126608.727627:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13120 00000100:00100000:3.0:1746126608.727631:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721305472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727631:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721305600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (1075us total) trans 21474840265 rc 0/0 00000100:00100000:1.0:1746126608.727635:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13118 00000100:00100000:1.0:1746126608.727643:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13121 00000100:00100000:1.0:1746126608.727647:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721305984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727708:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721305984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (634us total) trans 21474840266 rc 0/0 00000100:00100000:1.0:1746126608.727713:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13121 00000100:00100000:1.0:1746126608.727721:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13122 00000100:00100000:1.0:1746126608.727727:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d44a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3296:x1830945721306496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.727799:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d44a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721306496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (701us total) trans 17179873115 rc 0/0 00000100:00100000:1.0:1746126608.727803:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13122 00000100:00100000:1.0:1746126608.727811:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13123 00000100:00100000:1.0:1746126608.727816:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3297:x1830945721306112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.727909:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721306112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (634us total) trans 17179873116 rc 0/0 00000100:00100000:1.0:1746126608.727913:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13123 00000100:00100000:1.0:1746126608.727922:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13124 00000100:00100000:1.0:1746126608.727927:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721306624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.727991:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721306624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (697us total) trans 21474840267 rc 0/0 00000100:00100000:1.0:1746126608.727996:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13124 00000100:00100000:1.0:1746126608.728004:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13125 00000100:00100000:1.0:1746126608.728007:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721305728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.728397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000004:00080000:0.0:1746126608.728431:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ff480/2, rc 0, transno 17179873113 00000100:00100000:0.0:1746126608.728440:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721305216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126608.728450:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092209f80/2, rc 0, transno 21474840265 00000100:00100000:0.0:1746126608.728453:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721305600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126608.728459:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fca80/2, rc 0, transno 17179873116 00000100:00100000:0.0:1746126608.728462:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721306112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126608.728470:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad3100/2, rc 0, transno 21474840267 00000100:00100000:0.0:1746126608.728473:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721306624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.728541:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746126608.728546:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721307008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126608.728567:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.728947:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307008 00000100:00100000:1.0:1746126608.728951:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307008 00000100:00100000:1.0:1746126608.728968:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13130 00000100:00100000:1.0:1746126608.728972:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721305856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126608.729272:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126608.729275:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.729276:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.729278:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.729280:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746126608.729298:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3296:x1830945721305472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1666us (2247us total) trans 21474840269 rc 0/0 00000100:00100000:3.0:1746126608.729303:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13120 00000100:00100000:1.0:1746126608.729387:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721305856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 414us (1954us total) trans 21474840268 rc 0/0 00000100:00100000:1.0:1746126608.729392:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13130 00000100:00100000:1.0:1746126608.729401:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13131 00000100:00100000:1.0:1746126608.729406:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721306368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.729410:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13132 00000100:00100000:3.0:1746126608.729414:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721306880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126608.729538:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126608.729541:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126608.729542:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126608.729544:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126608.729546:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126608.729563:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721306368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (2114us total) trans 17179873119 rc 0/0 00000100:00100000:1.0:1746126608.729568:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13131 00000100:00100000:1.0:1746126608.729742:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13133 00000100:00100000:1.0:1746126608.729749:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721307008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.729820:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721307008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1252us total) trans 17179873120 rc 0/0 00000100:00100000:1.0:1746126608.729841:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13133 00000004:00080000:0.0:1746126608.729849:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11ed80/2, rc 0, transno 17179873120 00000100:00100000:0.0:1746126608.729852:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721307008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.729860:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721291392 00000100:00100000:1.0:1746126608.729863:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721291392 00000100:00100000:1.0:1746126608.729883:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8842 00000100:00100000:1.0:1746126608.729888:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31073:x1830945721291392:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126608.729901:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1746126608.729969:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fd500/2, rc 0, transno 17179873114 00000100:00100000:3.0:1746126608.729972:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721305088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126608.729978:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009220aa00/2, rc 0, transno 21474840269 00000100:00100000:3.0:1746126608.729980:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721305472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126608.729986:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092208a80/2, rc 0, transno 21474840266 00000100:00100000:3.0:1746126608.729989:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721305984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126608.729996:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fc380/2, rc 0, transno 17179873115 00000100:00100000:3.0:1746126608.729998:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721306496:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746126608.730015:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d26e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.730062:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d26e expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.730074:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d26e expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.730088:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.730091:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126608.730094:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec78a00, rc 0) 00000100:00100000:1.0:1746126608.730161:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31073:x1830945721291392:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 272us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.730165:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8842 00000100:00100000:1.0:1746126608.730236:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721306880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 821us (2769us total) trans 17179873121 rc 0/0 00000100:00100000:1.0:1746126608.730241:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13132 00000004:00080000:3.0:1746126608.730261:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fed80/2, rc 0, transno 17179873121 00000100:00100000:3.0:1746126608.730265:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721306880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.730367:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721305728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2358us (3008us total) trans 21474840270 rc 0/0 00000100:00100000:1.0:1746126608.730371:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13125 00002000:00010000:3.0:1746126608.730442:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746126608.730445:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.730447:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.730448:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.730450:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:3.0:1746126608.730467:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721304960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1964us (3051us total) trans 21474840272 rc 0/0 00000100:00100000:3.0:1746126608.730471:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13129 00000004:00080000:3.0:1746126608.730486:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009220bb80/2, rc 0, transno 21474840272 00000100:00100000:3.0:1746126608.730489:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721304960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126608.730495:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092208380/2, rc 0, transno 21474840270 00000100:00100000:3.0:1746126608.730497:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721305728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126608.730502:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad3480/2, rc 0, transno 21474840271 00000100:00100000:3.0:1746126608.730504:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721306240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.734816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.735169:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721291648 00000100:00100000:1.0:1746126608.735178:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721291648 00000100:00100000:1.0:1746126608.735223:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3714 00000100:00100000:1.0:1746126608.735231:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31073:x1830945721291648:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1746126608.735477:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31073:x1830945721291648:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 247us (671us total) trans 8589943000 rc 0/0 00000100:00100000:1.0:1746126608.735483:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3714 00000100:00100000:1.0:1746126608.752978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.753843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.753882:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721292160 00000100:00100000:1.0:1746126608.753886:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721292160 00000100:00100000:1.0:1746126608.754457:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8844 00000100:00100000:1.0:1746126608.754465:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31085:x1830945721292160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.754477:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.754484:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e82586761279e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d27c expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.754529:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754535:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754541:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754548:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754552:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754560:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754611:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754617:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754624:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126608.754629:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126608.754674:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754680:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754685:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754690:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eac2a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.754694:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754699:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754709:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126608.754711:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.754715:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.754722:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e8258676127a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755429:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755434:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755438:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755442:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eac2c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126608.755444:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755448:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755458:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135bcba00) 00010000:00010000:1.0:1746126608.755459:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126608.755461:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755465:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e8258676127ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.755496:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e82586761279e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.755506:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.755517:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.755519:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126608.755520:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3a00, rc 0) 00000100:00100000:1.0:1746126608.755796:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31085:x1830945721292160:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1333us (1971us total) trans 8589943002 rc 0/0 00000100:00100000:1.0:1746126608.755801:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8844 00000100:00100000:1.0:1746126608.759069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.759728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.760130:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3715 00000100:00100000:0.0:1746126608.760139:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31086:x1830945721292416:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126608.760344:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31086:x1830945721292416:12345-192.168.203.2@tcp:35:cat.0 Request processed in 207us (1283us total) trans 8589943003 rc 0/0 00000100:00100000:0.0:1746126608.760352:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3715 00000100:00100000:0.0:1746126608.761695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.763047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.763087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.763158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.763196:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721293056 00000100:00100000:1.0:1746126608.763204:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721293056 00000100:00100000:1.0:1746126608.763249:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721293440 00000100:00100000:1.0:1746126608.763253:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721293440 00000100:00100000:1.0:1746126608.763279:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8845 00000100:00100000:1.0:1746126608.763289:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:31082:x1830945721293056:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126608.763313:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.763335:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2800/0xb50e8258676127c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d28a expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.763441:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.763457:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.763465:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.763476:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126608.763512:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.763526:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 10 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.763539:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721307136:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.763645:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.763654:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 225 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.763663:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721307264:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.763691:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e50480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.764250:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721292800 00000100:00100000:3.0:1746126608.764255:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721292800 00000100:00100000:3.0:1746126608.764278:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721293184 00000100:00100000:3.0:1746126608.764280:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721293184 00000100:00100000:3.0:1746126608.764304:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13134 00000100:00100000:3.0:1746126608.764308:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+13:31086:x1830945721292800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.764317:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.764329:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d283 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.764347:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.764348:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.764356:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d283 expref: 14 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.764368:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d283 expref: 14 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.764376:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35200, rc 0) 00000100:00100000:3.0:1746126608.764403:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+14:31086:x1830945721292800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 94us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.764408:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13134 00000100:00100000:3.0:1746126608.764421:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13135 00000100:00100000:3.0:1746126608.764425:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31085:x1830945721293184:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.764431:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.764436:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d291 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.764446:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.764447:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.764450:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d291 expref: 12 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.764457:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d291 expref: 12 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.764463:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35800, rc 0) 00000100:00100000:3.0:1746126608.764478:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31085:x1830945721293184:12345-192.168.203.2@tcp:101:cat.0 Request processed in 53us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.764483:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13135 00000100:00100000:0.0:1746126608.765379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.766006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.766329:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721293568 00000100:00100000:3.0:1746126608.766334:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721293568 00010000:00010000:3.0:1746126608.766357:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 12 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.766376:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721293696 00000100:00100000:3.0:1746126608.766378:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721293696 00010000:00010000:3.0:1746126608.766386:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 226 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.766537:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6848 00000100:00100000:3.0:1746126608.766543:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721293568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.766554:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.766559:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 12 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.766568:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 12 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.766586:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3a00/0xb50e8258676127b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d27c expref: 12 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.766612:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.766615:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.766622:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.766627:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.766664:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721293568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 121us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.766670:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6848 00000100:00100000:3.0:1746126608.766682:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6849 00000100:00100000:3.0:1746126608.766686:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:1964:x1830945721293696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.766692:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.766696:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 226 pid: 14548 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.766704:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 226 pid: 14548 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.766715:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612790 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d275 expref: 226 pid: 14548 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.766723:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.766726:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.766732:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.766738:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.766744:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.766749:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.766757:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.766776:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.766791:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+225:1964:x1830945721293696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 104us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.766797:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6849 00010000:00010000:3.0:1746126608.767853:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126608.767860:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126608.767872:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126608.767941:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2800/0xb50e8258676127c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d28a expref: 226 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.767953:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d28a expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.767959:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.767962:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126608.767963:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac2400, rc 0) 00000100:00100000:3.0:1746126608.767992:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:31082:x1830945721293056:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4706us (5026us total) trans 8589943006 rc 0/0 00000100:00100000:3.0:1746126608.767998:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8845 00000100:00100000:0.0:1746126608.768483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.768519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.768571:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721293824 00000100:00100000:3.0:1746126608.768580:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721293824 00000100:00100000:3.0:1746126608.768617:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8847 00000100:00100000:3.0:1746126608.768624:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:31086:x1830945721293824:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.768636:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.768646:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d29f expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.768799:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 226 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.768874:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 226 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.768888:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.768890:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126608.768892:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34600, rc 0) 00000100:00100000:3.0:1746126608.768925:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+226:31086:x1830945721293824:12345-192.168.203.2@tcp:101:cat.0 Request processed in 300us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.768930:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8847 00000100:00100000:3.0:1746126608.779731:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721294208 00000100:00100000:3.0:1746126608.779743:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721294208 00002000:00100000:3.0:1746126608.779794:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f257100 x1830945721294208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.779805:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f257100 with x1830945721294208 ext(0->1048575) 00002000:00010000:3.0:1746126608.779810:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f257100 00000100:00100000:3.0:1746126608.779874:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7492 00000100:00100000:3.0:1746126608.779882:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721294208:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126608.781966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.804462:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721294208:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24570us (24841us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.804474:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7492 00002000:00100000:3.0:1746126608.804486:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f257100 x1830945721294208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.804495:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f257100 with x1830945721294208 ext(0->1048575) 00002000:00010000:3.0:1746126608.804500:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f257100 00010000:00010000:0.0:1746126608.809137:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126608.819246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.819363:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721294592 00000100:00100000:1.0:1746126608.819373:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721294592 00000100:00100000:1.0:1746126608.819440:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13136 00000100:00100000:1.0:1746126608.819450:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31085:x1830945721294592:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.819468:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.819486:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d2ad expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.819511:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.819514:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.819522:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 12 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.819535:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 12 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.819546:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3200, rc 0) 00000100:00100000:1.0:1746126608.819593:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31085:x1830945721294592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 145us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.819599:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13136 00000100:00100000:0.0:1746126608.832380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.834920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.834970:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721294976 00000100:00100000:3.0:1746126608.834977:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721294976 00000100:00100000:3.0:1746126608.835021:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13137 00000100:00100000:3.0:1746126608.835028:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:31086:x1830945721294976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126608.835044:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.835062:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d2b4 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.835085:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.835087:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.835095:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.835110:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.835131:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34a00, rc 0) 00000100:00100000:3.0:1746126608.835162:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:31086:x1830945721294976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 134us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.835168:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13137 00000100:00100000:0.0:1746126608.843972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.844119:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721295232 00000100:00100000:3.0:1746126608.844130:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721295232 00002000:00100000:3.0:1746126608.844181:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad0380 x1830945721295232/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.844191:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0380 with x1830945721295232 ext(1048576->2097151) 00002000:00010000:3.0:1746126608.844197:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad0380 00000100:00100000:3.0:1746126608.844235:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7495 00000100:00100000:3.0:1746126608.844243:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721295232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126608.854790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.855571:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721295360 00000100:00100000:1.0:1746126608.855583:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721295360 00000100:00100000:1.0:1746126608.855644:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13138 00000100:00100000:1.0:1746126608.855653:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31085:x1830945721295360:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.855671:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.855689:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d2bb expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.855713:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.855715:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.855722:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 13 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.855735:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 13 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.855744:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac2e00, rc 0) 00000100:00100000:1.0:1746126608.855797:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31085:x1830945721295360:12345-192.168.203.2@tcp:101:cat.0 Request processed in 145us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.855803:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13138 00000100:00100000:0.0:1746126608.859109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.859176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.859179:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721295616 00000100:00100000:3.0:1746126608.859188:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721295616 00000100:00100000:3.0:1746126608.859239:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721295744 00000100:00100000:3.0:1746126608.859242:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721295744 00000100:00100000:1.0:1746126608.859250:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8849 00000100:00100000:1.0:1746126608.859266:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31083:x1830945721295616:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:3.0:1746126608.859273:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8850 00000100:00100000:3.0:1746126608.859280:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31085:x1830945721295744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.859306:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.859310:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.859310:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746126608.859326:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d2c9 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859334:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0c00/0xb50e825867612800 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2a6 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859355:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.859359:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126608.859365:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e825867612823 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d2c2 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.859380:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.859392:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859395:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126608.859404:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d26e expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859411:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859416:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859422:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.859431:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.859434:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126608.859436:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.859450:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008df21e00, rc 0) 00010000:00010000:1.0:1746126608.859464:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859475:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 14 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.859485:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307392:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.859495:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31085:x1830945721295744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 215us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.859501:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8850 00010000:00010000:1.0:1746126608.859553:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859559:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 225 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.859566:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307520:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.859587:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d26e expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.859593:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d26e expref: 7 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.859600:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307648:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.859612:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e50480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126608.862620:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307392:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126608.863546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.864970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.865026:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307520:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126608.865034:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307648:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126608.865065:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126608.865161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.865176:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721296000 00000100:00100000:3.0:1746126608.865180:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721296000 00000100:00100000:0.0:1746126608.865187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126608.865196:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 16 pid: 20362 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.865211:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721296256 00000100:00100000:3.0:1746126608.865212:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721296256 00000100:00100000:0.0:1746126608.865219:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721296128 00000100:00100000:0.0:1746126608.865221:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721296128 00010000:00010000:3.0:1746126608.865222:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 226 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.865231:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612774 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d26e expref: 8 pid: 14548 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.865246:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6850 00000100:00100000:0.0:1746126608.865248:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6851 00000100:00100000:3.0:1746126608.865251:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721296000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126608.865252:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:1963:x1830945721296256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.865258:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126608.865258:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.865262:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 16 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.865262:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 226 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.865336:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 226 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.865353:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34600/0xb50e8258676127f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d29f expref: 226 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.865369:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126608.865372:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126608.865377:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126608.865382:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126608.865396:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+225:1963:x1830945721296256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 143us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.865401:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6851 00010000:00010000:3.0:1746126608.865544:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 15 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.865557:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e82586761281c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c9 expref: 15 pid: 20362 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.865568:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.865571:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.865578:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.865584:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126608.865592:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.865605:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126608.865621:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721296000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 371us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.865626:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6850 00000100:00100000:0.0:1746126608.872894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.880709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.880920:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721296512 00000100:00100000:1.0:1746126608.880930:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721296512 00000100:00100000:1.0:1746126608.881702:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8852 00000100:00100000:1.0:1746126608.881712:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:31086:x1830945721296512:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126608.881735:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126608.881755:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d2de expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.881815:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 226 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.881855:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 226 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.881868:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126608.881871:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126608.881875:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.881882:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac2c00, rc 0) 00000100:00100000:1.0:1746126608.881928:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+226:31086:x1830945721296512:12345-192.168.203.2@tcp:101:cat.0 Request processed in 218us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.881934:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8852 00010000:00010000:3.0:1746126608.912067:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.912081:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126608.912084:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746126608.912088:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 15 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.912097:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 15 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.912102:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 15 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.912109:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.912128:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.912134:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746126608.912150:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943003 is committed 00000001:00080000:0.0:1746126608.912163:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943002 is committed 00000001:00080000:0.0:1746126608.912168:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943000 is committed 00010000:00010000:3.0:1746126608.912171:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746126608.912172:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943007 is committed 00000004:00080000:0.0:1746126608.912176:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746126608.912182:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2095 committed 00000100:00100000:3.0:1746126608.912184:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307776:192.168.203.2@tcp:105: 00000004:00080000:0.0:1746126608.912193:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2094 committed 00000004:00080000:0.0:1746126608.912195:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746126608.912196:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2093 committed 00000004:00080000:0.0:1746126608.912198:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1986 committed 00000004:00080000:0.0:1746126608.912200:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2092 committed 00000004:00080000:0.0:1746126608.912201:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746126608.912203:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2091 committed 00000004:00080000:0.0:1746126608.912204:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746126608.912205:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2090 committed 00000004:00080000:0.0:1746126608.912206:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2089 committed 00000004:00080000:0.0:1746126608.912208:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746126608.912209:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746126608.912210:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2088 committed 00000004:00080000:0.0:1746126608.912212:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746126608.912214:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1981 committed 00000001:00080000:0.0:1746126608.912227:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943006 is committed 00010000:00010000:3.0:1746126608.912278:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 11 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126608.912286:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721308032:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126608.912302:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6300 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.912317:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721308416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.912350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.912371:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721308160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.912376:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721308928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.912390:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.912396:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721308288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.912404:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746126608.912408:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721307904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.912411:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.912422:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.912426:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721308800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.912432:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721308544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.912436:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.912460:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308416 00000100:00100000:1.0:1746126608.912466:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308416 00000100:00100000:1.0:1746126608.912496:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308928 00000100:00100000:1.0:1746126608.912498:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308928 00000100:00100000:1.0:1746126608.912509:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308288 00000100:00100000:1.0:1746126608.912510:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308288 00000100:00100000:1.0:1746126608.912519:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307904 00000100:00100000:1.0:1746126608.912520:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307904 00000100:00100000:1.0:1746126608.912528:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308800 00000100:00100000:1.0:1746126608.912530:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308800 00000100:00100000:1.0:1746126608.912542:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13140 00000100:00100000:1.0:1746126608.912548:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721308416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.912736:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721308416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (385us total) trans 17179873122 rc 0/0 00000100:00100000:1.0:1746126608.912743:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13140 00000100:00100000:1.0:1746126608.912757:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13141 00000100:00100000:1.0:1746126608.912761:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721308928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.912859:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721308928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (467us total) trans 17179873123 rc 0/0 00000100:00100000:1.0:1746126608.912864:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13141 00000100:00100000:1.0:1746126608.912875:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13142 00000100:00100000:1.0:1746126608.912879:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3295:x1830945721308288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.912944:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746126608.912948:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746126608.912951:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.912954:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.912955:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.912958:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00080000:3.0:1746126608.912971:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dabb480/2, rc 0, transno 17179873123 00000100:00100000:3.0:1746126608.912977:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721308928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.912979:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721308288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (567us total) trans 17179873124 rc 0/0 00000100:00100000:1.0:1746126608.912984:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13142 00000004:00080000:3.0:1746126608.912988:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8caa00/2, rc 0, transno 17179873122 00000100:00100000:3.0:1746126608.912991:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721308416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.912994:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308544 00000100:00100000:1.0:1746126608.912996:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308544 00000100:00100000:1.0:1746126608.913006:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13143 00000100:00100000:1.0:1746126608.913010:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721307904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.913013:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13144 00000100:00100000:3.0:1746126608.913018:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721308800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126608.913077:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126608.913080:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.913082:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.913083:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.913085:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746126608.913104:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3295:x1830945721308800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (666us total) trans 17179873126 rc 0/0 00000100:00100000:1.0:1746126608.913109:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830945721307904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (686us total) trans 17179873125 rc 0/0 00000100:00100000:3.0:1746126608.913126:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13144 00000100:00100000:1.0:1746126608.913270:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13143 00000100:00100000:1.0:1746126608.913282:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13145 00000100:00100000:1.0:1746126608.913287:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721308544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126608.913354:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126608.913356:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126608.913358:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126608.913359:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126608.913361:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126608.913380:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3296:x1830945721308544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (436us total) trans 17179873127 rc 0/0 00000100:00100000:1.0:1746126608.913386:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13145 00000100:00100000:1.0:1746126608.913413:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.913426:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721308672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.913443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.913456:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.913459:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308160 00000100:00100000:3.0:1746126608.913463:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308160 00000100:00100000:1.0:1746126608.913471:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126608.913498:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308672 00000100:00100000:3.0:1746126608.913500:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308672 00000100:00100000:3.0:1746126608.913511:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309184 00000100:00100000:3.0:1746126608.913513:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309184 00000100:00100000:3.0:1746126608.913522:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13146 00000100:00100000:3.0:1746126608.913526:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721308160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126608.913594:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126608.913597:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.913598:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.913600:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.913601:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746126608.914285:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914308:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126608.914320:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126608.914325:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126608.914347:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914351:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126608.914376:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309696 00000100:00100000:0.0:1746126608.914379:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309696 00000100:00100000:1.0:1746126608.914389:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309312 00000100:00100000:0.0:1746126608.914391:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309824 00000100:00100000:1.0:1746126608.914392:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309312 00000100:00100000:0.0:1746126608.914393:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309824 00000100:00100000:0.0:1746126608.914401:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13148 00000100:00100000:0.0:1746126608.914405:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3294:x1830945721309184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914408:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13149 00000100:00100000:3.0:1746126608.914409:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3294:x1830945721308160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 881us (994us total) trans 17179873128 rc 0/0 00000100:00100000:1.0:1746126608.914413:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3294:x1830945721309696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.914415:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13146 00000100:00100000:3.0:1746126608.914425:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13150 00000100:00100000:3.0:1746126608.914429:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3294:x1830945721309824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914443:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13151 00000100:00100000:1.0:1746126608.914448:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3294:x1830945721309312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.914454:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126608.914468:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.914484:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126608.914494:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746126608.914498:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.914511:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126608.914517:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.914528:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3294:x1830945721309824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (160us total) trans 21474840273 rc 0/0 00002000:00010000:1.0:1746126608.914531:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00000100:00100000:3.0:1746126608.914533:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13150 00002000:00010000:1.0:1746126608.914533:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.914535:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.914537:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126608.914538:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:3.0:1746126608.914541:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309056 00000100:00100000:3.0:1746126608.914543:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309056 00000100:00100000:3.0:1746126608.914549:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309568 00000100:00100000:3.0:1746126608.914550:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309568 00000100:00100000:3.0:1746126608.914554:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309440 00000100:00100000:3.0:1746126608.914556:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309440 00000100:00100000:1.0:1746126608.914561:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721309312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (216us total) trans 21474840274 rc 0/0 00000100:00100000:3.0:1746126608.914562:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13152 00000100:00100000:3.0:1746126608.914565:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721309056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914567:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13151 00000100:00100000:1.0:1746126608.914577:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13153 00000100:00100000:1.0:1746126608.914581:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3297:x1830945721309568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126608.914628:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746126608.914630:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.914632:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.914634:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126608.914635:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:3.0:1746126608.914650:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3297:x1830945721309056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (196us total) trans 21474840275 rc 0/0 00000100:00100000:3.0:1746126608.914654:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13152 00000100:00100000:3.0:1746126608.914661:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13154 00000100:00100000:1.0:1746126608.914664:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721309568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (178us total) trans 21474840276 rc 0/0 00000100:00100000:3.0:1746126608.914665:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721309440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126608.914670:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13153 00000004:00080000:1.0:1746126608.914702:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8ca300/2, rc 0, transno 17179873124 00000100:00100000:1.0:1746126608.914707:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721308288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126608.914708:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126608.914714:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008daba680/2, rc 0, transno 17179873126 00000100:00100000:1.0:1746126608.914717:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721308800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.914728:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309952 00000004:00080000:0.0:1746126608.914728:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f255180/2, rc 0, transno 21474840275 00000100:00100000:3.0:1746126608.914729:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721309440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (217us total) trans 21474840277 rc 0/0 00000100:00100000:1.0:1746126608.914730:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309952 00000100:00100000:0.0:1746126608.914732:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.914734:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13154 00000004:00080000:0.0:1746126608.914738:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f255500/2, rc 0, transno 21474840276 00000100:00100000:0.0:1746126608.914741:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.914742:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13155 00000100:00100000:3.0:1746126608.914746:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721309952:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126608.914747:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f254a80/2, rc 0, transno 21474840277 00000100:00100000:0.0:1746126608.914750:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126608.914756:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f255c00/2, rc 0, transno 21474840274 00000100:00100000:1.0:1746126608.914759:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126608.914765:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f256d80/2, rc 0, transno 21474840273 00000100:00100000:1.0:1746126608.914767:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126608.914773:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8cb480/2, rc 0, transno 17179873128 00000100:00100000:1.0:1746126608.914775:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721308160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126608.914812:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721310080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126608.914821:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c8000/2, rc 0, transno 17179873125 00000100:00100000:3.0:1746126608.914838:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721307904:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126608.914842:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746126608.914843:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746126608.914845:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00000004:00080000:3.0:1746126608.914847:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab9f80/2, rc 0, transno 17179873127 00002000:00010000:0.0:1746126608.914848:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00000100:00100000:3.0:1746126608.914849:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721308544:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126608.914849:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126608.914851:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746126608.914861:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310080 00000100:00100000:3.0:1746126608.914864:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310080 00000100:00100000:3.0:1746126608.914877:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13156 00000100:00100000:0.0:1746126608.914878:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721309184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 472us (1406us total) trans 21474840278 rc 0/0 00000100:00100000:3.0:1746126608.914880:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721310080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126608.914884:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13148 00000004:00080000:1.0:1746126608.914888:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f255f80/2, rc 0, transno 21474840278 00000100:00100000:1.0:1746126608.914891:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126608.914964:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3297:x1830945721310080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (121us total) trans 17179873130 rc 0/0 00000100:00100000:3.0:1746126608.914970:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13156 00000100:00100000:3.0:1746126608.915037:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3297:x1830945721309952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (328us total) trans 21474840280 rc 0/0 00000100:00100000:3.0:1746126608.915042:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13155 00000004:00080000:1.0:1746126608.915619:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2e680/2, rc 0, transno 17179873130 00000100:00100000:1.0:1746126608.915622:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721310080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126608.915629:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15d500/2, rc 0, transno 21474840280 00000100:00100000:1.0:1746126608.915632:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721309952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126608.915646:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab8700/2, rc 0, transno 17179873129 00000100:00100000:1.0:1746126608.915648:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721308672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126608.917563:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721307776:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126608.917574:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721308032:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126608.917608:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2a00/0xb50e825867612823 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 11 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746126608.917629:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.917660:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3400, rc 0) 00000100:00100000:0.0:1746126608.917687:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721309696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3271us (3375us total) trans 21474840279 rc 0/0 00000100:00100000:0.0:1746126608.917695:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13149 00000100:00100000:3.0:1746126608.917742:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31083:x1830945721295616:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 58483us (58640us total) trans 8589943007 rc 0/0 00000100:00100000:3.0:1746126608.917752:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8849 00000004:00080000:1.0:1746126608.917801:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f254000/2, rc 0, transno 21474840279 00000100:00100000:1.0:1746126608.917806:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721309696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126608.918058:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721296640 00000100:00100000:0.0:1746126608.918064:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721296640 00000100:00100000:0.0:1746126608.918090:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3717 00000100:00100000:0.0:1746126608.918096:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31085:x1830945721296640:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:0.0:1746126608.918175:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31085:x1830945721296640:12345-192.168.203.2@tcp:49:cat.0 Request processed in 79us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.918181:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3717 00000100:00100000:0.0:1746126608.923531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.930809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.934631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.939646:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721297024:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 8653us (8836us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.939658:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7496 00002000:00100000:3.0:1746126608.939667:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009b2ffb80 x1830945721297024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.939676:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ffb80 with x1830945721297024 ext(1048576->2097151) 00000100:00100000:0.0:1746126608.939741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:3.0:1746126608.941521:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2ffb80 00000100:00100000:3.0:1746126608.942357:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721297408 00000100:00100000:3.0:1746126608.942364:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721297408 00010000:00010000:3.0:1746126608.942391:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d291 expref: 13 pid: 4642 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.942410:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721297536 00000100:00100000:3.0:1746126608.942412:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721297536 00010000:00010000:3.0:1746126608.942421:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d244 expref: 11 pid: 8437 timeout: 830 lvb_type: 1 00000100:00100000:3.0:1746126608.942435:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6853 00000100:00100000:3.0:1746126608.942440:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721297408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126608.942452:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126608.942474:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d291 expref: 13 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.942484:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d291 expref: 13 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.942504:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676127e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d291 expref: 13 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:3.0:1746126608.942519:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.942599:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721297664 00000100:00100000:1.0:1746126608.942603:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721297664 00010000:00010000:1.0:1746126608.942617:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d283 expref: 15 pid: 4642 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.942632:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6854 00000100:00100000:1.0:1746126608.942636:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721297536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.942643:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.942652:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d244 expref: 11 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.942658:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d244 expref: 11 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.942670:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18a00/0xb50e825867612719 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d244 expref: 11 pid: 8437 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.942692:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126608.942917:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6855 00000100:00100000:0.0:1746126608.942925:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721297664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126608.942934:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126608.942942:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d283 expref: 15 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.942955:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d283 expref: 15 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.942966:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a35200/0xb50e8258676127dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d283 expref: 15 pid: 4642 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746126608.942977:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.942979:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.942986:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 12 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.942992:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 12 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.942999:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.943000:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.943003:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.943009:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.943037:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.943048:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721310592:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126608.943842:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721297408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1398us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.943850:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6853 00000100:00100000:3.0:1746126608.944723:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721297920 00000100:00100000:3.0:1746126608.944733:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721297920 00002000:00100000:3.0:1746126608.944765:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008e722300 x1830945721297920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.944774:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722300 with x1830945721297920 ext(1048576->2097151) 00002000:00010000:3.0:1746126608.944779:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722300 00000100:00100000:3.0:1746126608.944794:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7497 00000100:00100000:3.0:1746126608.944800:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721297920:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126608.945045:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721297536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2405us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.945052:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6854 00010000:00010000:0.0:1746126608.945225:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 11 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.945239:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721310720:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126608.945281:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.945985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.946806:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721310720:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126608.956312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.956360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.956626:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7498 00000100:00100000:1.0:1746126608.956636:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721298304:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126608.957011:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721298304:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 376us (709us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126608.957017:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7498 00002000:00100000:1.0:1746126608.957023:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (249856->253951) req@ffff88009b2fc700 x1830945721298304/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/4536 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.957030:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fc700 with x1830945721298304 ext(249856->253951) 00002000:00010000:1.0:1746126608.957033:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fc700 00000100:00100000:1.0:1746126608.957047:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7499 00000100:00100000:1.0:1746126608.957052:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721298560:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126608.957641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126608.958867:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721298816 00000100:00100000:3.0:1746126608.958875:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721298816 00002000:00100000:3.0:1746126608.958905:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (966656->970751) req@ffff88009b2fe680 x1830945721298816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.958913:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fe680 with x1830945721298816 ext(966656->970751) 00002000:00010000:3.0:1746126608.958918:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fe680 00000100:00100000:3.0:1746126608.958948:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7500 00000100:00100000:3.0:1746126608.958955:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721298816:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126608.959058:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721298816:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 103us (1417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126608.959065:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7500 00002000:00100000:3.0:1746126608.959070:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (966656->970751) req@ffff88009b2fe680 x1830945721298816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/4536 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.959076:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fe680 with x1830945721298816 ext(966656->970751) 00002000:00010000:3.0:1746126608.959079:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fe680 00000100:00100000:3.0:1746126608.959365:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721297920:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 14564us (14705us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126608.959370:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7497 00002000:00100000:3.0:1746126608.959375:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008e722300 x1830945721297920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126608.959382:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722300 with x1830945721297920 ext(1048576->2097151) 00002000:00010000:3.0:1746126608.959385:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722300 00000100:00100000:0.0:1746126608.971804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.973440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.976006:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721298560:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 18951us (19643us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126608.976010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.976014:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7499 00002000:00100000:0.0:1746126608.976023:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009b2fdc00 x1830945721298560/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126608.976031:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fdc00 with x1830945721298560 ext(1048576->2097151) 00002000:00010000:0.0:1746126608.976035:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fdc00 00000100:00100000:3.0:1746126608.976161:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721299328 00000100:00100000:3.0:1746126608.976165:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721299328 00000100:00100000:3.0:1746126608.976192:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13161 00000100:00100000:3.0:1746126608.976197:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:31082:x1830945721299328:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126608.976205:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126608.976219:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d301 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.976248:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.976260:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.976266:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 12 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.976272:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.976274:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126608.976277:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1048576->1695743] (req 1048576->1695743) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.976307:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 12 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.976318:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 12 pid: 4641 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.976330:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721310848:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.976388:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.976395:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 830 lvb_type: 0 00000100:00100000:3.0:1746126608.976403:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721310976:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.976427:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.976434:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 11 pid: 20294 timeout: 830 lvb_type: 1 00000100:00100000:3.0:1746126608.976442:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721311104:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.976456:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126608.982676:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721310848:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.982691:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721310976:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126608.982699:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721311104:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126608.982740:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1048576->1695743] (req 1048576->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126608.982757:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35600, rc 0) 00000100:00100000:3.0:1746126608.982814:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:31082:x1830945721299328:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6615us (6803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126608.982823:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13161 00000100:00100000:0.0:1746126608.983258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.983332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.983351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.983373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.983403:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721299840 00000100:00100000:0.0:1746126608.983409:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721299840 00002000:00100000:0.0:1746126608.983447:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009b2ff800 x1830945721299840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/0 e 0 to 0 dl 1746126619 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126608.983461:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff800 with x1830945721299840 ext(1048576->2097151) 00002000:00010000:0.0:1746126608.983465:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2ff800 00000100:00100000:0.0:1746126608.983479:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7502 00000100:00100000:0.0:1746126608.983485:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721299840:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126608.983850:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721299456 00000100:00100000:1.0:1746126608.983853:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721299456 00010000:00010000:1.0:1746126608.983872:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 13 pid: 4641 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.983886:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721299584 00000100:00100000:1.0:1746126608.983887:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721299584 00010000:00010000:1.0:1746126608.983894:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746126608.983903:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721300096 00000100:00100000:1.0:1746126608.983904:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721300096 00010000:00010000:1.0:1746126608.983911:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 12 pid: 20294 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746126608.983920:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6856 00000100:00100000:1.0:1746126608.983924:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721299456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.983932:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.983949:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 13 pid: 4641 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.983957:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 13 pid: 4641 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.983976:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e825867612807 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ad expref: 13 pid: 4641 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.983990:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.984109:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721299456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 183us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.984125:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6856 00000100:00100000:1.0:1746126608.984137:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6857 00000100:00100000:1.0:1746126608.984142:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721299584:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.984149:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.984156:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.984173:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.984184:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e82586761280e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2b4 expref: 28 pid: 9686 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746126608.984192:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.984206:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721299584:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 64us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.984210:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6857 00000100:00100000:1.0:1746126608.984253:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6858 00000100:00100000:1.0:1746126608.984258:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721300096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126608.984263:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126608.984269:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 12 pid: 20294 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.984278:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 12 pid: 20294 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.984289:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867612704 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d24b expref: 12 pid: 20294 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746126608.984300:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.984302:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126608.984308:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.984314:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126608.984339:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126608.984348:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721311232:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126608.984394:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.985657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.985677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.985690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.985711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.985731:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721299968 00000100:00100000:0.0:1746126608.985738:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721299968 00000100:00100000:0.0:1746126608.985770:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721300224 00000100:00100000:0.0:1746126608.985772:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721300224 00000100:00100000:0.0:1746126608.985784:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721300352 00000100:00100000:0.0:1746126608.985786:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721300352 00000100:00100000:0.0:1746126608.985796:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721300480 00000100:00100000:0.0:1746126608.985798:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721300480 00000100:00100000:0.0:1746126608.985810:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13162 00000100:00100000:0.0:1746126608.985815:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721299968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126608.985849:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.985865:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eee0a00/0xb50e825867612869 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d308 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126608.985902:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721311360:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126608.985951:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126608.985963:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13164 00000100:00100000:0.0:1746126608.985967:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721300352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126608.985973:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.985979:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eee0800/0xb50e825867612870 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d316 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.985989:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.985990:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.985996:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eee0800/0xb50e825867612870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d316 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.986008:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eee0800/0xb50e825867612870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d316 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.986016:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eee0800, rc 0) 00000100:00100000:0.0:1746126608.986032:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721300352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.986037:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13164 00000100:00100000:0.0:1746126608.986050:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13165 00000100:00100000:0.0:1746126608.986054:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721300480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126608.986059:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126608.986065:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d31d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126608.986074:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.986299:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126608.986304:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 15 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.986315:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 15 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126608.986322:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eee1400, rc 0) 00000100:00100000:0.0:1746126608.986889:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721300480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 832us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126608.986894:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13165 00000100:00100000:1.0:1746126608.990854:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721311232:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126608.990878:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126608.990923:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721300096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6662us (7547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126608.990933:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6858 00000100:00100000:3.0:1746126608.991706:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721311488:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126608.991730:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e464800/0xb50e825867612877 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d30f expref: 14 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.991743:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e464800/0xb50e825867612877 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d30f expref: 14 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126608.991758:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e464800, rc 0) 00000100:00100000:3.0:1746126608.992400:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721300224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6435us (6720us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126608.992405:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13163 00000100:00100000:1.0:1746126608.993077:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721299840:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 9590us (9723us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126608.993085:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7502 00002000:00100000:1.0:1746126608.993094:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009b2ff800 x1830945721299840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:369/0 lens 488/440 e 0 to 0 dl 1746126619 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126608.993103:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff800 with x1830945721299840 ext(1048576->2097151) 00002000:00010000:1.0:1746126608.993108:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2ff800 00000100:00100000:1.0:1746126608.996903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126608.998757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.999859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126608.999932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.000109:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13167 00000100:00100000:1.0:1746126609.000124:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721300992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.000131:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.000138:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4651600/0xb50e82586761288c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d32b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.000148:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.000150:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.000158:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4651600/0xb50e82586761288c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d32b expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.000171:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4651600/0xb50e82586761288c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d32b expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.000181:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4651600, rc 0) 00000100:00100000:1.0:1746126609.000199:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721300992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 76us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.000204:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13167 00000100:00100000:0.0:1746126609.002817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.002880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.003014:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721301376 00000100:00100000:1.0:1746126609.003020:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721301376 00002000:00100000:1.0:1746126609.003050:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009b2fd180 x1830945721301376/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.003058:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fd180 with x1830945721301376 ext(2097152->3145727) 00002000:00010000:1.0:1746126609.003062:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fd180 00000100:00100000:1.0:1746126609.003076:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721301632 00000100:00100000:1.0:1746126609.003079:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721301632 00002000:00100000:1.0:1746126609.003089:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009b2fce00 x1830945721301632/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.003095:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fce00 with x1830945721301632 ext(3145728->4194303) 00002000:00010000:1.0:1746126609.003098:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fce00 00000100:00100000:1.0:1746126609.003125:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7504 00000100:00100000:1.0:1746126609.003132:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721301376:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126609.003734:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7505 00000100:00100000:3.0:1746126609.003741:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721301632:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.004986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.005095:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.005126:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721301888 00000100:00100000:0.0:1746126609.005131:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721301888 00002000:00100000:0.0:1746126609.005162:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009b2ff100 x1830945721301888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126609.005169:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff100 with x1830945721301888 ext(2097152->3145727) 00002000:00010000:0.0:1746126609.005173:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2ff100 00000100:00100000:0.0:1746126609.005185:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721302144 00000100:00100000:0.0:1746126609.005187:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721302144 00002000:00100000:0.0:1746126609.005196:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e8c9f80 x1830945721302144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126609.005202:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c9f80 with x1830945721302144 ext(3145728->4194303) 00002000:00010000:0.0:1746126609.005204:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c9f80 00000100:00100000:0.0:1746126609.005220:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7506 00000100:00100000:0.0:1746126609.005225:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721301888:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.017303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.017371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.021083:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721302656 00000100:00100000:3.0:1746126609.021100:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721302656 00002000:00100000:3.0:1746126609.021163:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e8cbb80 x1830945721302656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.021173:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cbb80 with x1830945721302656 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.021183:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cbb80 00000100:00100000:3.0:1746126609.021971:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7508 00000100:00100000:3.0:1746126609.021980:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721302656:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.025793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.025845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.025866:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721302912 00000100:00100000:1.0:1746126609.025874:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721302912 00002000:00100000:1.0:1746126609.025916:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dab9500 x1830945721302912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.025927:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9500 with x1830945721302912 ext(2097152->3145727) 00002000:00010000:1.0:1746126609.025931:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9500 00000100:00100000:1.0:1746126609.025953:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721303040 00000100:00100000:1.0:1746126609.025956:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721303040 00002000:00100000:1.0:1746126609.025968:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008dab9880 x1830945721303040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.025975:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9880 with x1830945721303040 ext(3145728->4194303) 00002000:00010000:1.0:1746126609.025977:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9880 00000100:00100000:1.0:1746126609.027189:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7510 00000100:00100000:1.0:1746126609.027199:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721302912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126609.027492:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7511 00000100:00100000:3.0:1746126609.027499:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721303040:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126609.031745:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721301632:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28002us (28862us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.031753:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7505 00002000:00100000:3.0:1746126609.031758:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009b2fce00 x1830945721301632/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.031766:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fce00 with x1830945721301632 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.031769:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fce00 00000100:00100000:3.0:1746126609.047692:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721302656:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25701us (30386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.047704:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7508 00002000:00100000:3.0:1746126609.047715:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e8cbb80 x1830945721302656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.047723:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cbb80 with x1830945721302656 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.047729:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cbb80 00000100:00100000:0.0:1746126609.054514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.054552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.055248:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721302912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28049us (29463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126609.055257:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7510 00002000:00100000:1.0:1746126609.055266:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dab9500 x1830945721302912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.055274:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9500 with x1830945721302912 ext(2097152->3145727) 00002000:00010000:1.0:1746126609.055279:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9500 00000100:00100000:3.0:1746126609.056217:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13170 00000100:00100000:3.0:1746126609.056225:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721303424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.056234:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.056245:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e8258676128a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d340 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.057128:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721311872:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126609.057717:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.059042:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721303040:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31539us (33191us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.059051:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7511 00002000:00100000:3.0:1746126609.059061:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008dab9880 x1830945721303040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.059069:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9880 with x1830945721303040 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.059074:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9880 00000100:00100000:3.0:1746126609.060750:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721311872:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126609.060785:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e8258676128a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d340 expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.060798:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008edef200/0xb50e8258676128a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d340 expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.060851:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edef200, rc 0) 00000100:00100000:3.0:1746126609.060887:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721303424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4662us (6333us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126609.060895:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13170 00000100:00100000:0.0:1746126609.065901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.069435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.069652:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721303808 00000100:00100000:3.0:1746126609.069658:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721303808 00002000:00100000:3.0:1746126609.069693:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e8c8a80 x1830945721303808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.069701:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8a80 with x1830945721303808 ext(4194304->4976639) 00002000:00010000:3.0:1746126609.069705:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c8a80 00000100:00100000:3.0:1746126609.069731:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7512 00000100:00100000:3.0:1746126609.069737:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721303808:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.077424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.078086:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304064 00000100:00100000:3.0:1746126609.078107:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721303808:12345-192.168.203.2@tcp:3:cat.0 Request processed in 8366us (8672us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126609.078125:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7512 00002000:00100000:3.0:1746126609.078137:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e8c8a80 x1830945721303808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.078145:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8a80 with x1830945721303808 ext(4194304->4976639) 00002000:00010000:3.0:1746126609.078151:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c8a80 00000100:00100000:1.0:1746126609.078207:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304064 00002000:00100000:1.0:1746126609.078245:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e8cb100 x1830945721304064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.078251:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb100 with x1830945721304064 ext(4194304->4976639) 00002000:00010000:1.0:1746126609.078255:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8cb100 00000100:00100000:1.0:1746126609.078268:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7513 00000100:00100000:1.0:1746126609.078274:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721304064:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.085485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.088198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.088220:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304320 00000100:00100000:0.0:1746126609.088222:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304320 00000100:00100000:0.0:1746126609.088239:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13173 00000100:00100000:0.0:1746126609.088244:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721304320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126609.088250:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126609.088260:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e8258676128b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d355 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126609.088282:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721312256:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126609.088318:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.088784:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721304064:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10507us (11368us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126609.089749:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7513 00002000:00100000:1.0:1746126609.089760:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e8cb100 x1830945721304064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.089769:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb100 with x1830945721304064 ext(4194304->4976639) 00002000:00010000:1.0:1746126609.089774:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8cb100 00000100:00100000:1.0:1746126609.090881:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721312256:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.090900:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e8258676128b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d355 expref: 14 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.090909:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e8258676128b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d355 expref: 14 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.091348:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18800, rc 0) 00000100:00100000:1.0:1746126609.091368:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721304320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3124us (3169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.091373:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13173 00000100:00100000:0.0:1746126609.096718:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304576 00000100:00100000:0.0:1746126609.096729:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304576 00000100:00100000:3.0:1746126609.096860:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304704 00000100:00100000:3.0:1746126609.096864:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304704 00000100:00100000:3.0:1746126609.097308:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13175 00000100:00100000:3.0:1746126609.097314:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721304704:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.097322:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.097334:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35200/0xb50e8258676128c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d36a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.097360:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721312512:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126609.097382:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.097430:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13176 00000100:00100000:1.0:1746126609.097436:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721304576:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.097444:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.097449:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd4000/0xb50e8258676128cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d363 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.097470:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721312640:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.097491:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.099918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.100132:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721304960 00000100:00100000:3.0:1746126609.100139:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721304960 00000100:00100000:3.0:1746126609.100179:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8853 00000100:00100000:3.0:1746126609.100185:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31090:x1830945721304960:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126609.100204:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.100219:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e8258676128d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d371 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.100316:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100328:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100340:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100352:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100361:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100366:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126609.100434:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721312640:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.100453:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edd4000/0xb50e8258676128cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d363 expref: 15 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.100462:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edd4000/0xb50e8258676128cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d363 expref: 15 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.100491:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd4000, rc 0) 00000100:00100000:1.0:1746126609.100511:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721304576:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3075us (4914us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.100517:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13176 00010000:00010000:3.0:1746126609.100713:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100722:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.100728:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126609.100737:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126609.101412:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101419:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101425:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101430:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b6ea00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126609.101434:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101440:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101450:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126609.101453:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126609.101457:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101462:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b6ea00/0xb50e8258676128d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101482:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101778:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101783:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101788:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008df21c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126609.101790:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101795:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101801:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8aa00) 00010000:00010000:3.0:1746126609.101803:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126609.101805:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101809:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676128e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.101970:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e8258676128d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.101987:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.101993:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126609.101995:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126609.101997:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008df21200, rc 0) 00000100:00100000:3.0:1746126609.102030:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31090:x1830945721304960:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1844us (2118us total) trans 8589943008 rc 0/0 00000100:00100000:3.0:1746126609.102035:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8853 00000100:00100000:0.0:1746126609.103228:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305088 00000100:00100000:0.0:1746126609.103235:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305088 00000100:00100000:0.0:1746126609.103273:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13177 00000100:00100000:0.0:1746126609.103281:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721305088:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126609.103295:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126609.103307:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e8258676128f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d378 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126609.103360:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721312768:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126609.103705:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.105477:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305344 00000100:00100000:1.0:1746126609.105483:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305344 00000100:00100000:1.0:1746126609.105513:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3719 00000100:00100000:1.0:1746126609.105520:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31090:x1830945721305344:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126609.106339:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31090:x1830945721305344:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 816us (936us total) trans 8589943009 rc 0/0 00000100:00100000:1.0:1746126609.106346:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3719 00000100:00100000:0.0:1746126609.151600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.152518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.152610:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305600 00000100:00100000:3.0:1746126609.152614:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305600 00000100:00100000:3.0:1746126609.152647:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8854 00000100:00100000:3.0:1746126609.152652:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31093:x1830945721305600:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126609.152666:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.152679:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009915d800/0xb50e825867612903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d386 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.152916:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.152927:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.152937:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.152949:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.152959:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.152964:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.153079:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.153089:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d28a expref: 222 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.153095:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.153101:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.153130:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.153138:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 12 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.153146:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721313280:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.153216:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d28a expref: 222 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.153224:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e8258676127c8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d28a expref: 222 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.153237:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721313408:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.153254:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.156741:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721305984 00000100:00100000:1.0:1746126609.156750:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721305984 00000100:00100000:0.0:1746126609.156766:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e720e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721312896:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126609.156775:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721313024:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.156780:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c3400/0xb50e825867612727 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d260 expref: 10 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126609.156782:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721313152:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.156808:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6859 00010000:00010000:0.0:1746126609.156810:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3727360->4194303] (req 3727360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.156816:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721305856:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126609.156824:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e465a00, rc 0) 00010000:00010000:1.0:1746126609.156850:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.156872:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4651600/0xb50e82586761288c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d32b expref: 16 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126609.156883:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31090:x1830945721305472:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5100us (5294us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126609.156892:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4651600/0xb50e82586761288c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d32b expref: 16 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126609.156895:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13178 00000100:00080000:3.0:1746126609.156982:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126609.156997:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6861 00000100:00100000:3.0:1746126609.157003:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721305728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.157010:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.157068:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4651600/0xb50e82586761288c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d32b expref: 16 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.157088:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.157105:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721305856:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 292us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.157123:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6859 00010000:00010000:3.0:1746126609.157307:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eee0800/0xb50e825867612870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d316 expref: 15 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.157316:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eee0800/0xb50e825867612870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d316 expref: 15 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.157329:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eee0800/0xb50e825867612870 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d316 expref: 15 pid: 4642 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126609.157989:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721313408:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126609.158009:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.158064:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.158066:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.158072:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.158080:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.158105:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.158128:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721313536:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126609.158175:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.158389:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306368 00000100:00100000:1.0:1746126609.158393:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306368 00000100:00100000:1.0:1746126609.158423:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3720 00000100:00100000:1.0:1746126609.158428:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:27349:x1830945721306368:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126609.158581:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:27349:x1830945721306368:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 152us (240us total) trans 8589943010 rc 0/0 00000100:00100000:1.0:1746126609.158586:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3720 00000100:00100000:3.0:1746126609.158657:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306112 00000100:00100000:3.0:1746126609.158660:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306112 00010000:00010000:3.0:1746126609.158674:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 13 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.158688:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6862 00000100:00100000:3.0:1746126609.158691:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721306112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.158697:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.158701:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 13 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.158708:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 13 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.158722:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e8258676127d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d298 expref: 13 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.158733:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126609.158737:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.158744:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.158748:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126609.158753:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.158770:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721306112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.158776:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6862 00000100:00100000:0.0:1746126609.161052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.161408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.161451:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306752 00000100:00100000:1.0:1746126609.161458:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306752 00002000:00100000:1.0:1746126609.161672:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3727360->3731455) req@ffff88009ee38380 x1830945721306752/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.161682:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38380 with x1830945721306752 ext(3727360->3731455) 00002000:00010000:1.0:1746126609.161686:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38380 00000100:00100000:1.0:1746126609.161703:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7514 00000100:00100000:1.0:1746126609.161710:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721306752:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126609.161867:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721306752:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 156us (457us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126609.161876:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7514 00002000:00100000:1.0:1746126609.161881:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3727360->3731455) req@ffff88009ee38380 x1830945721306752/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.161887:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38380 with x1830945721306752 ext(3727360->3731455) 00002000:00010000:1.0:1746126609.161890:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38380 00000100:00100000:3.0:1746126609.161904:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721313536:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126609.161921:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126609.161967:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.161974:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126609.162010:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126609.162014:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126609.162028:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162037:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162045:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162050:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162055:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162060:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a454f400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126609.162064:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162069:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162077:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126609.162080:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126609.162083:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162087:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454f400/0xb50e82586761290a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162100:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162105:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162117:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162120:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a454e600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126609.162123:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162127:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162132:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ee8a700) 00010000:00010000:0.0:1746126609.162134:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126609.162136:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.162140:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a454e600/0xb50e825867612911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126609.162540:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721305728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5536us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.162546:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6861 00010000:00010000:0.0:1746126609.162619:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915d800/0xb50e825867612903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d386 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.162632:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d386 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.162639:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126609.162640:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126609.162642:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4e4000, rc 0) 00000100:00100000:1.0:1746126609.163437:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31093:x1830945721305600:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 10783us (10918us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.163443:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8854 00000100:00100000:1.0:1746126609.171997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.172017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.172039:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721306880 00000100:00100000:1.0:1746126609.172047:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721306880 00000100:00100000:1.0:1746126609.172089:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307136 00000100:00100000:1.0:1746126609.172091:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307136 00000100:00100000:1.0:1746126609.172130:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13179 00000100:00100000:1.0:1746126609.172136:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31090:x1830945721306880:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126609.172156:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.172174:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d38d expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.172202:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.172211:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 27 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.172223:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.172228:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.172230:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.172233:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.172259:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.172270:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.172280:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721313664:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.172345:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 27 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.172352:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 27 pid: 4642 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.172358:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721313792:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.172375:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 11 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.172386:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 11 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.172393:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721313920:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.172404:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.172424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.172439:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307008 00000100:00100000:1.0:1746126609.172441:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307008 00000100:00100000:1.0:1746126609.172456:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13180 00000100:00100000:1.0:1746126609.172460:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721307136:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126609.172465:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.172471:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867612926 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d39b expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.172494:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721314048:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.172511:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.172521:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13181 00000100:00100000:1.0:1746126609.172526:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721307008:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126609.172531:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.172540:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dc1b400/0xb50e82586761292d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d394 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.172558:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721314176:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.172571:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.172620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126609.172676:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746126609.172684:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307264 00000100:00100000:1.0:1746126609.172686:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307264 00000100:00100000:1.0:1746126609.172702:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13182 00000100:00100000:1.0:1746126609.172706:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721307264:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126609.172713:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.172719:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef65400/0xb50e825867612934 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3a2 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.172741:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721314304:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.172760:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.176732:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721314048:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.176768:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867612926 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d39b expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.176781:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b6ea00/0xb50e825867612926 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d39b expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.176793:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b6ea00, rc 0) 00000100:00100000:1.0:1746126609.176860:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721307136:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 4397us (4840us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.176868:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13180 00000100:00100000:1.0:1746126609.177028:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721314304:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.177045:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65400/0xb50e825867612934 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3a2 expref: 12 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.177060:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65400/0xb50e825867612934 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3a2 expref: 12 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.177067:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65400, rc 0) 00000100:00100000:1.0:1746126609.177087:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721307264:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 4379us (4465us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.177092:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13182 00000100:00100000:1.0:1746126609.177153:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721314176:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.177166:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dc1b400/0xb50e82586761292d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d394 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.177174:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dc1b400/0xb50e82586761292d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d394 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.177180:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dc1b400, rc 0) 00000100:00100000:1.0:1746126609.177195:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721307008:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 4669us (4770us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.177200:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13181 00000100:00100000:1.0:1746126609.177230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.177280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.177331:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307392 00000100:00100000:1.0:1746126609.177337:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307392 00010000:00010000:1.0:1746126609.177359:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 28 pid: 4642 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.177382:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307520 00000100:00100000:1.0:1746126609.177384:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307520 00010000:00010000:1.0:1746126609.177391:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 11 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.177403:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6864 00000100:00100000:1.0:1746126609.177408:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721307392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.177419:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.177429:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 28 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.177437:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 28 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.177460:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.177476:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721307392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.177480:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6864 00000100:00100000:1.0:1746126609.177512:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6865 00000100:00100000:1.0:1746126609.177516:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721307520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.177523:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.177530:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 11 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.177537:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 11 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.177546:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.177558:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721307520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.177562:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6865 00000100:00100000:0.0:1746126609.178276:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721313664:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126609.178286:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867612893 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d332 expref: 27 pid: 4642 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126609.178296:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721313792:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126609.178302:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867612712 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d267 expref: 10 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126609.178309:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721313920:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126609.178326:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.178333:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd4400, rc 0) 00000100:00100000:0.0:1746126609.178362:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31090:x1830945721306880:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6226us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126609.178367:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13179 00000100:00100000:0.0:1746126609.180105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.180182:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307776 00000100:00100000:1.0:1746126609.180189:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307776 00000100:00100000:1.0:1746126609.180222:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8855 00000100:00100000:1.0:1746126609.180227:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31093:x1830945721307776:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126609.180245:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.180261:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e82586761293b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3a9 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.180343:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.180356:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d386 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.180362:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.180392:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d386 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.180400:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d386 expref: 8 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.180410:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721314432:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.180518:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.182094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.182179:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721307904 00000100:00100000:3.0:1746126609.182185:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721307904 00010000:00010000:3.0:1746126609.182216:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746126609.182250:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6866 00000100:00100000:3.0:1746126609.182256:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721307904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.182268:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.182294:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.182304:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.182323:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eee1400/0xb50e82586761287e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d31d expref: 14 pid: 4642 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.182344:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.182346:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.182357:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 13 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.182365:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 13 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.182397:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 13 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.182408:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721314560:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126609.182784:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.183661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126609.184071:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4e4000/0xb50e825867612918 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d386 expref: 8 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.184084:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721314432:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.184101:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.184108:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.184122:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126609.184141:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126609.184288:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e82586761293b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3a9 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.184302:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3a9 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.184753:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.184756:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126609.184758:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136975000, rc 0) 00000100:00100000:1.0:1746126609.185107:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31093:x1830945721307776:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 4877us (5006us total) trans 8589943011 rc 0/0 00000100:00100000:1.0:1746126609.185126:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8855 00000100:00100000:3.0:1746126609.185772:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721314560:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126609.185789:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.186211:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721307904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3954us (4121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.186219:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6866 00000100:00100000:0.0:1746126609.189291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.189587:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308288 00000100:00100000:3.0:1746126609.189597:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308288 00002000:00100000:3.0:1746126609.189644:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3223552->3227647) req@ffff88009ee3ad80 x1830945721308288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.189653:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3ad80 with x1830945721308288 ext(3223552->3227647) 00002000:00010000:3.0:1746126609.189658:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3ad80 00000100:00100000:0.0:1746126609.189849:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.190190:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7515 00000100:00100000:3.0:1746126609.190199:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721308288:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126609.190364:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721308288:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 166us (1081us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126609.190370:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7515 00002000:00100000:3.0:1746126609.190376:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3223552->3227647) req@ffff88009ee3ad80 x1830945721308288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.190382:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3ad80 with x1830945721308288 ext(3223552->3227647) 00002000:00010000:3.0:1746126609.190385:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3ad80 00000100:00100000:1.0:1746126609.190763:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721308544 00000100:00100000:1.0:1746126609.190767:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721308544 00000100:00100000:1.0:1746126609.190805:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8856 00000100:00100000:1.0:1746126609.190810:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31093:x1830945721308544:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126609.190847:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.190851:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746126609.190877:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e825867612942 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3a9 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.190893:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.190897:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126609.190908:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136975c00/0xb50e825867612950 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3b0 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.190988:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191000:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191008:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191018:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191023:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191029:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191035:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136975600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.191038:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191045:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191051:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.191053:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126609.191056:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191060:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612957 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.191080:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975c00/0xb50e825867612950 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b0 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.191087:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136975c00/0xb50e825867612950 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b0 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.191094:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136975c00, rc 0) 00000100:00100000:1.0:1746126609.191138:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31093:x1830945721308544:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 327us (1288us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.191144:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8856 00000100:00100000:0.0:1746126609.193706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.194666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.195935:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309056 00000100:00100000:1.0:1746126609.195941:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309056 00000100:00100000:1.0:1746126609.195977:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3722 00000100:00100000:1.0:1746126609.195982:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31093:x1830945721309056:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:1.0:1746126609.196090:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31093:x1830945721309056:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 107us (1426us total) trans 8589943013 rc 0/0 00000100:00100000:1.0:1746126609.196095:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3722 00000100:00100000:0.0:1746126609.222468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.224468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.224513:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309568 00000100:00100000:1.0:1746126609.224519:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309568 00000100:00100000:1.0:1746126609.224556:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8858 00000100:00100000:1.0:1746126609.224562:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31100:x1830945721309568:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.224576:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.224587:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136975c00/0xb50e825867612981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3be expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.224647:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224657:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224664:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224673:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224677:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224682:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224752:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224759:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224765:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126609.224776:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126609.224867:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224872:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224878:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224883:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136975600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.224886:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224891:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224898:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126609.224900:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.224903:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.224907:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136975600/0xb50e825867612988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225042:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225048:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225053:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225061:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136975000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.225063:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225068:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225075:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4200) 00010000:00010000:1.0:1746126609.225077:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.225079:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225083:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136975000/0xb50e82586761298f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.225123:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136975c00/0xb50e825867612981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3be expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.225133:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3be expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.225139:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.225141:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126609.225142:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136974400, rc 0) 00000100:00100000:1.0:1746126609.225180:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31100:x1830945721309568:12345-192.168.203.2@tcp:101:cat.0 Request processed in 617us (713us total) trans 8589943015 rc 0/0 00000100:00100000:1.0:1746126609.225185:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8858 00000100:00100000:0.0:1746126609.231701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.231818:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721309824 00000100:00100000:3.0:1746126609.231904:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721309824 00000100:00100000:3.0:1746126609.231991:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3723 00000100:00100000:3.0:1746126609.232004:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31100:x1830945721309824:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126609.232267:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31100:x1830945721309824:12345-192.168.203.2@tcp:35:cat.0 Request processed in 262us (576us total) trans 8589943016 rc 0/0 00000100:00100000:3.0:1746126609.232275:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3723 00000100:00100000:0.0:1746126609.239906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.240072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.240290:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310080 00000100:00100000:1.0:1746126609.240294:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310080 00000100:00100000:1.0:1746126609.240318:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13184 00000100:00100000:1.0:1746126609.240323:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721310080:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.240330:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.240340:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136974800/0xb50e8258676129ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3cc expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.240367:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721314816:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.240390:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.249582:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721314816:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.249623:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136974800/0xb50e8258676129ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3cc expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.249640:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136974800/0xb50e8258676129ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3cc expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.249683:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136974800, rc 0) 00000100:00100000:1.0:1746126609.249747:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721310080:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9419us (9673us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.249756:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13184 00000100:00100000:0.0:1746126609.258095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.262665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.263205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.263285:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310336 00000100:00100000:1.0:1746126609.263293:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310336 00002000:00100000:1.0:1746126609.263337:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (966656->1048575) req@ffff88008e721500 x1830945721310336/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.263346:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721500 with x1830945721310336 ext(966656->1048575) 00010000:00010000:1.0:1746126609.263354:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 15 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.263370:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 15 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.263377:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e721500 00000100:00100000:1.0:1746126609.263396:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310464 00000100:00100000:1.0:1746126609.263401:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310464 00002000:00100000:1.0:1746126609.263417:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (249856->831487) req@ffff88008e720e00 x1830945721310464/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.263424:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720e00 with x1830945721310464 ext(249856->831487) 00010000:00010000:1.0:1746126609.263428:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 15 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.263436:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 15 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.263441:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e720e00 00000100:00100000:1.0:1746126609.263458:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1707 00000100:00100000:1.0:1746126609.263465:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721310336:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126609.263690:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1708 00000100:00100000:1.0:1746126609.263698:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721310464:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126609.275644:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721310336:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12165us (12968us total) trans 21474840281 rc 0/0 00000100:00100000:1.0:1746126609.275658:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1707 00002000:00100000:1.0:1746126609.275671:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (966656->1048575) req@ffff88008e721500 x1830945721310336/t21474840281(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.275682:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721500 with x1830945721310336 ext(966656->1048575) 00010000:00010000:1.0:1746126609.275693:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.275706:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.275713:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e721500 00000100:00100000:0.0:1746126609.293887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.293965:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310592 00000100:00100000:3.0:1746126609.293975:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310592 00010000:00010000:3.0:1746126609.294014:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.294045:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6868 00000100:00100000:3.0:1746126609.294052:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721310592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.294068:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.294084:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.294101:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.294132:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18800/0xb50e82586761284d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [966656->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2ec expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.294163:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.294206:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721310592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 154us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.294212:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6868 00000100:00100000:1.0:1746126609.295978:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721310464:12345-192.168.203.2@tcp:4:cat.0 Request processed in 32276us (32770us total) trans 21474840282 rc 0/0 00000100:00100000:1.0:1746126609.295987:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1708 00002000:00100000:1.0:1746126609.295998:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (249856->831487) req@ffff88008e720e00 x1830945721310464/t21474840282(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.296007:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720e00 with x1830945721310464 ext(249856->831487) 00010000:00010000:1.0:1746126609.296015:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.296030:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.296036:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e720e00 00000100:00100000:0.0:1746126609.296823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.300147:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310848 00000100:00100000:3.0:1746126609.300155:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310848 00010000:00010000:3.0:1746126609.300184:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.300222:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6869 00000100:00100000:3.0:1746126609.300230:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721310848:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.300241:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.300264:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.300274:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.300293:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a26a00/0xb50e825867612846 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 249856->831487) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2e5 expref: 17 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.300314:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.300317:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.300323:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676129b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3d3 expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.300330:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676129b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3d3 expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.300359:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676129b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3d3 expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.300369:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721315328:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126609.300431:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.300674:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721315200:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126609.300698:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3547136->4194303] (req 3547136->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 17 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.300707:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34200, rc 0) 00000100:00100000:0.0:1746126609.300731:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+17:31098:x1830945721310720:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3064us (3911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126609.300738:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13186 00000100:00100000:1.0:1746126609.300814:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721310976 00000100:00100000:1.0:1746126609.300818:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721310976 00002000:00100000:1.0:1746126609.300870:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3727360->4194303) req@ffff880092ad1500 x1830945721310976/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.300884:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1500 with x1830945721310976 ext(3727360->4194303) 00010000:00010000:1.0:1746126609.300890:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 17 pid: 8437 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.300900:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 17 pid: 8437 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.300906:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1500 00000100:00100000:1.0:1746126609.300918:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1709 00000100:00100000:1.0:1746126609.300923:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721310976:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126609.306399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.306424:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721311232 00000100:00100000:0.0:1746126609.306430:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721311232 00002000:00100000:0.0:1746126609.306468:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddaed80 x1830945721311232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126609.306478:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaed80 with x1830945721311232 ext(0->1048575) 00002000:00010000:0.0:1746126609.306482:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddaed80 00000100:00100000:0.0:1746126609.306497:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7516 00000100:00100000:0.0:1746126609.306503:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721311232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.318088:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721310976:12345-192.168.203.2@tcp:4:cat.0 Request processed in 16919us (17361us total) trans 21474840283 rc 0/0 00000100:00100000:1.0:1746126609.318102:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1709 00002000:00100000:1.0:1746126609.318125:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3727360->4194303) req@ffff880092ad1500 x1830945721310976/t21474840283(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.318134:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1500 with x1830945721310976 ext(3727360->4194303) 00010000:00010000:1.0:1746126609.318145:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 20 pid: 8437 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.318160:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e465a00/0xb50e8258676128fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d37f expref: 20 pid: 8437 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.318167:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1500 00000100:00100000:0.0:1746126609.325646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.331293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.333260:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721311744 00000100:00100000:0.0:1746126609.333267:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721311744 00000100:00100000:0.0:1746126609.333306:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13187 00000100:00100000:0.0:1746126609.333312:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31100:x1830945721311744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126609.333323:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126609.333339:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e8258676129c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3e1 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.333364:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.333371:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126609.333373:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126609.333376:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e8258676129c0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e1 expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.333404:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.333416:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a35600/0xb50e82586761285b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d301 expref: 26 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126609.333427:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721315584:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126609.333875:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.336099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.336169:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721311872 00000100:00100000:1.0:1746126609.336178:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721311872 00000100:00100000:3.0:1746126609.336281:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13188 00000100:00100000:3.0:1746126609.336292:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721311872:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.336305:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.336320:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da80c00/0xb50e8258676129c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3e8 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.336337:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.336339:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.336346:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da80c00/0xb50e8258676129c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e8 expref: 18 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.336357:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da80c00/0xb50e8258676129c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e8 expref: 18 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.336368:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da80c00, rc 0) 00000100:00100000:3.0:1746126609.336384:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721311872:12345-192.168.203.2@tcp:101:cat.0 Request processed in 95us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.336388:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13188 00000100:00100000:0.0:1746126609.338448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.338768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.338860:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721312128 00000100:00100000:1.0:1746126609.338868:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721312128 00000100:00100000:1.0:1746126609.339392:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13189 00000100:00100000:1.0:1746126609.339401:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721312128:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.339410:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.339426:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e8258676129ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d3ef expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.339472:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721315712:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.339537:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.339617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.347282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:3.0:1746126609.347318:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126608 -> 1746126609 00000100:00100000:3.0:1746126609.347344:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721315840:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.347368:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721312512 00000100:00100000:1.0:1746126609.347375:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721312512 00010000:00010000:3.0:1746126609.347378:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35200/0xb50e8258676129d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3f6 expref: 32 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.347391:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35200/0xb50e8258676129d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3f6 expref: 32 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.347406:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35200, rc 0) 00002000:00100000:1.0:1746126609.347411:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4190208->4194303) req@ffff88012ddad880 x1830945721312512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.347419:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad880 with x1830945721312512 ext(4190208->4194303) 00002000:00010000:1.0:1746126609.347422:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddad880 00000100:00100000:1.0:1746126609.347440:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7518 00000100:00100000:3.0:1746126609.347446:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721312256:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6947us (7829us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.347446:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721312512:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126609.347453:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13190 00000100:00100000:1.0:1746126609.347583:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721312512:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 137us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126609.347589:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7518 00002000:00100000:1.0:1746126609.347594:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4190208->4194303) req@ffff88012ddad880 x1830945721312512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.347601:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad880 with x1830945721312512 ext(4190208->4194303) 00002000:00010000:1.0:1746126609.347604:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddad880 00000100:00100000:0.0:1746126609.354527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.354596:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721312768 00000100:00100000:1.0:1746126609.354606:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721312768 00000100:00100000:1.0:1746126609.354666:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3724 00000100:00100000:1.0:1746126609.354675:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31098:x1830945721312768:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126609.354961:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31098:x1830945721312768:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 287us (442us total) trans 8589943017 rc 0/0 00000100:00100000:1.0:1746126609.354967:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3724 00000100:00100000:0.0:1746126609.356637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.356701:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721313024 00000100:00100000:3.0:1746126609.356708:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721313024 00002000:00100000:3.0:1746126609.356742:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddac000 x1830945721313024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.356751:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac000 with x1830945721313024 ext(0->1048575) 00002000:00010000:3.0:1746126609.356756:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac000 00000100:00100000:3.0:1746126609.356782:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7519 00000100:00100000:3.0:1746126609.356787:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721313024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126609.365241:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721313024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 8442us (8598us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.365253:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7519 00002000:00100000:3.0:1746126609.365264:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddac000 x1830945721313024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.365273:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac000 with x1830945721313024 ext(0->1048575) 00002000:00010000:3.0:1746126609.365278:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac000 00000100:00100000:0.0:1746126609.370059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.373146:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.379306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.379659:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721313536 00000100:00100000:3.0:1746126609.379666:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721313536 00002000:00100000:3.0:1746126609.379854:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880135ed3800 x1830945721313536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.379864:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed3800 with x1830945721313536 ext(1048576->2097151) 00002000:00010000:3.0:1746126609.379868:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ed3800 00000100:00100000:3.0:1746126609.379884:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7520 00000100:00100000:3.0:1746126609.379891:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721313536:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.388463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.392316:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721313536:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12413us (13008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.392328:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7520 00002000:00100000:3.0:1746126609.392341:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880135ed3800 x1830945721313536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.392350:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed3800 with x1830945721313536 ext(1048576->2097151) 00002000:00010000:3.0:1746126609.392356:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ed3800 00000100:00100000:0.0:1746126609.404252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.405102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.405879:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721314176 00000100:00100000:3.0:1746126609.405883:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721314176 00002000:00100000:3.0:1746126609.405916:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5956a00 x1830945721314176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.405925:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956a00 with x1830945721314176 ext(2097152->3145727) 00010000:00010000:3.0:1746126609.405931:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 18 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.405941:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 18 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.405947:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5956a00 00000100:00100000:3.0:1746126609.407164:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1711 00000100:00100000:3.0:1746126609.407173:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721314176:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.411018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.411479:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721314304 00000100:00100000:1.0:1746126609.411487:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721314304 00002000:00100000:1.0:1746126609.411523:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3547136->4194303) req@ffff8800a5956680 x1830945721314304/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.411531:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956680 with x1830945721314304 ext(3547136->4194303) 00010000:00010000:1.0:1746126609.411538:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.411550:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.411556:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5956680 00000100:00100000:1.0:1746126609.412809:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1712 00000100:00100000:1.0:1746126609.412822:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721314304:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126609.415938:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721314176:12345-192.168.203.2@tcp:3:cat.0 Request processed in 8756us (10827us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.415950:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1711 00002000:00100000:3.0:1746126609.415963:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5956a00 x1830945721314176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.415973:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956a00 with x1830945721314176 ext(2097152->3145727) 00010000:00010000:3.0:1746126609.415984:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.415998:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.416005:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5956a00 00000100:00100000:0.0:1746126609.422854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.422902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.423081:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721314560 00000100:00100000:1.0:1746126609.423090:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721314560 00000100:00100000:1.0:1746126609.423143:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8859 00000100:00100000:1.0:1746126609.423150:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31106:x1830945721314560:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126609.423180:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.423198:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07dc00/0xb50e8258676129ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d40b expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.423299:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.423314:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e825867612973 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b7 expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.423321:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3be expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.423328:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.423360:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3be expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.423370:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612996 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3be expref: 17 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.423382:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721316224:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.423481:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e825867612973 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b7 expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.423489:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e825867612973 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b7 expref: 225 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.423501:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721316352:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.423520:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.423738:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721314688 00000100:00100000:3.0:1746126609.423742:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721314688 00000100:00100000:3.0:1746126609.423767:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13193 00000100:00100000:3.0:1746126609.423772:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+29:31103:x1830945721314688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.423780:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.423790:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d412 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.423808:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 13 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.423814:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126609.423816:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126609.423818:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d412 expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.423852:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 13 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.423860:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 13 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.423867:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721316480:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.423899:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.425470:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721316224:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.425480:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721316352:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.425498:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126609.426104:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721314304:12345-192.168.203.2@tcp:4:cat.0 Request processed in 13285us (15094us total) trans 21474840284 rc 0/0 00000100:00100000:1.0:1746126609.426123:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1712 00000100:00100000:3.0:1746126609.426275:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721316480:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126609.426275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126609.426295:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d412 expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.426313:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35e00, rc 0) 00000100:00100000:0.0:1746126609.426331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.426332:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+30:31103:x1830945721314688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2561us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.426339:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13193 00000100:00100000:3.0:1746126609.426365:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721315072 00000100:00100000:0.0:1746126609.426367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.426371:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721315072 00002000:00100000:3.0:1746126609.426396:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3227647) req@ffff880099252a00 x1830945721315072/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.426410:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099252a00 with x1830945721315072 ext(3145728->3227647) 00010000:00010000:3.0:1746126609.426416:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 14 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.426425:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edd4400/0xb50e82586761291f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d38d expref: 14 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.426431:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099252a00 00000100:00100000:3.0:1746126609.426444:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1713 00000100:00100000:3.0:1746126609.426450:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721315072:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126609.426612:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6873 00000100:00100000:0.0:1746126609.426619:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+226:1963:x1830945721314944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126609.426625:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126609.426629:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e825867612973 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b7 expref: 226 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.426637:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e825867612973 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b7 expref: 226 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.426648:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34a00/0xb50e825867612973 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3b7 expref: 226 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.426662:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126609.426664:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.426672:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.426678:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126609.426692:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746126609.427252:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3547136->4194303) req@ffff8800a5956680 x1830945721314304/t21474840284(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.427261:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956680 with x1830945721314304 ext(3547136->4194303) 00010000:00010000:1.0:1746126609.427268:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.427276:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.427282:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5956680 00010000:00010000:1.0:1746126609.427306:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.427312:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126609.427331:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126609.427442:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07dc00/0xb50e8258676129ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.427457:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.427464:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.427466:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126609.427468:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c07de00, rc 0) 00000100:00100000:0.0:1746126609.427821:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:1963:x1830945721314944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1202us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126609.427838:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6873 00000100:00100000:1.0:1746126609.428008:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31106:x1830945721314560:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4857us (5104us total) trans 8589943018 rc 0/0 00000100:00100000:1.0:1746126609.428014:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8859 00000100:00100000:0.0:1746126609.431156:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721315200 00000100:00100000:0.0:1746126609.431166:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721315200 00010000:00010000:0.0:1746126609.431207:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126609.431235:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6874 00000100:00100000:0.0:1746126609.431242:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721315200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126609.431256:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126609.431277:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126608 -> 1746126609 00002000:00010000:0.0:1746126609.431280:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126608 -> 1746126609 00010000:00010000:0.0:1746126609.431286:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.431297:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.431320:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e8258676129b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3da expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.431339:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126609.431341:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126609.431349:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.431358:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126609.431396:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126609.431409:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721316608:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126609.432763:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.438743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.439899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.446068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.446306:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721315840 00000100:00100000:1.0:1746126609.446313:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721315840 00002000:00100000:1.0:1746126609.446351:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099250000 x1830945721315840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.446361:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250000 with x1830945721315840 ext(2097152->3145727) 00002000:00010000:1.0:1746126609.446367:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099250000 00000100:00100000:1.0:1746126609.446382:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7523 00000100:00100000:1.0:1746126609.446388:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721315840:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.460689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.461909:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721315968 00000100:00100000:3.0:1746126609.461921:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721315968 00000100:00100000:3.0:1746126609.461982:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13194 00000100:00100000:3.0:1746126609.461991:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31100:x1830945721315968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.462010:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.462028:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34200/0xb50e825867612a06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d419 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.462055:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.462056:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.462063:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34200/0xb50e825867612a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d419 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.462076:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a34200/0xb50e825867612a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d419 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.462086:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34200, rc 0) 00000100:00100000:3.0:1746126609.462152:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31100:x1830945721315968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 162us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.462157:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13194 00000100:00100000:1.0:1746126609.474721:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721315840:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28320us (28650us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126609.474738:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7523 00002000:00100000:1.0:1746126609.474752:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099250000 x1830945721315840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.474762:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250000 with x1830945721315840 ext(2097152->3145727) 00002000:00010000:1.0:1746126609.474769:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099250000 00000100:00100000:0.0:1746126609.480689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.480727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.480749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.480783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.481487:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7525 00000100:00100000:3.0:1746126609.481496:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721316864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.482672:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7526 00000100:00100000:1.0:1746126609.482685:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721316608:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.490244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.490314:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721317120 00000100:00100000:1.0:1746126609.490444:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721317120 00000100:00100000:1.0:1746126609.490506:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8860 00000100:00100000:1.0:1746126609.490515:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31108:x1830945721317120:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126609.490541:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126609.491098:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721316864:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9595us (10338us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.491119:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7525 00002000:00100000:3.0:1746126609.491131:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880099253800 x1830945721316864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.491140:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253800 with x1830945721316864 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.491147:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253800 00010000:00010000:1.0:1746126609.491227:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09de00/0xb50e825867612a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d427 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.491347:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491362:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491374:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491863:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491871:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491877:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491988:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.491997:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492002:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126609.492011:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126609.492097:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492103:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492117:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492123:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f09dc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.492126:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492133:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492143:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126609.492146:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.492150:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492155:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09dc00/0xb50e825867612a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492184:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492189:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492193:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492197:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f09da00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.492199:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492203:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492209:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4300) 00010000:00010000:1.0:1746126609.492210:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.492213:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492216:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.492251:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09de00/0xb50e825867612a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 228 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.492260:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.492266:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.492268:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126609.492275:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09d800, rc 0) 00000100:00100000:1.0:1746126609.492311:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+227:31108:x1830945721317120:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1797us (2078us total) trans 8589943019 rc 0/0 00000100:00100000:1.0:1746126609.492319:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8860 00000100:00100000:0.0:1746126609.494650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.494698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.494777:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721317376 00000100:00100000:3.0:1746126609.494786:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721317376 00002000:00100000:3.0:1746126609.494849:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093231f80 x1830945721317376/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.494859:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093231f80 with x1830945721317376 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.494865:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093231f80 00000100:00100000:3.0:1746126609.494881:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721317632 00000100:00100000:3.0:1746126609.494884:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721317632 00002000:00100000:3.0:1746126609.494897:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093233480 x1830945721317632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.494903:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233480 with x1830945721317632 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.494906:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093233480 00000100:00100000:3.0:1746126609.494917:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7527 00000100:00100000:3.0:1746126609.494924:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721317376:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.500919:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721316608:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18229us (20127us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126609.500928:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7526 00002000:00100000:1.0:1746126609.500937:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880099253480 x1830945721316608/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.500945:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253480 with x1830945721316608 ext(3145728->4194303) 00002000:00010000:1.0:1746126609.500950:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099253480 00000100:00100000:0.0:1746126609.525814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.525892:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721317888 00000100:00100000:1.0:1746126609.525901:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721317888 00002000:00100000:1.0:1746126609.525946:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093232300 x1830945721317888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.525955:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232300 with x1830945721317888 ext(4194304->4976639) 00002000:00010000:1.0:1746126609.525961:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093232300 00000100:00100000:1.0:1746126609.525983:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7529 00000100:00100000:1.0:1746126609.525990:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721317888:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126609.526330:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721317376:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31405us (31686us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.526337:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7527 00002000:00100000:3.0:1746126609.526343:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093231f80 x1830945721317376/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.526349:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093231f80 with x1830945721317376 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.526353:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093231f80 00000100:00100000:0.0:1746126609.534239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.544327:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721317888:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18324us (18514us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126609.544341:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7529 00002000:00100000:1.0:1746126609.544353:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093232300 x1830945721317888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.544370:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232300 with x1830945721317888 ext(4194304->4976639) 00002000:00010000:1.0:1746126609.544375:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093232300 00000100:00100000:0.0:1746126609.557328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.562375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.562754:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721318272 00000100:00100000:3.0:1746126609.562766:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721318272 00000100:00100000:3.0:1746126609.562810:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721318400 00000100:00100000:3.0:1746126609.562813:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721318400 00000100:00100000:3.0:1746126609.563657:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13196 00000100:00100000:3.0:1746126609.563668:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:31108:x1830945721318272:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126609.563686:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.563703:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d42e expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.563732:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d412 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.563741:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a34200/0xb50e825867612a06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d419 expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.563747:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.563749:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.563752:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3256320->3719167] (req 3256320->3719167) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.563781:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a34200/0xb50e825867612a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d419 expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.563792:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a34200/0xb50e825867612a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d419 expref: 15 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.563803:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721316864:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.563914:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d412 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.563922:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d412 expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.563930:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721316992:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.563950:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.563968:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13197 00000100:00100000:3.0:1746126609.563974:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31106:x1830945721318400:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126609.563983:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.563992:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d435 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.564006:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676129b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3d3 expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.564013:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da80c00/0xb50e8258676129c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e8 expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.564018:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.564019:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.564022:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [483328->1048575] (req 483328->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.564036:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da80c00/0xb50e8258676129c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e8 expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.564043:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da80c00/0xb50e8258676129c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e8 expref: 19 pid: 4640 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746126609.564050:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721317120:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.564075:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676129b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3d3 expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.564087:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e8258676129b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3d3 expref: 19 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.564095:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721317248:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.564122:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.569094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.569122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.569141:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.570173:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721316864:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.570280:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35e00/0xb50e8258676129f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d412 expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.570312:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721316992:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.570340:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3256320->3719167] (req 3256320->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 30 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.570352:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009204aa00, rc 0) 00000100:00100000:3.0:1746126609.571939:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:31108:x1830945721318272:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8269us (14618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.571947:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13196 00000100:00100000:0.0:1746126609.572509:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.573806:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721317376:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126609.573821:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126609.574062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.574133:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721318528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4154us (4989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.574142:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6878 00000100:00100000:0.0:1746126609.576194:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721317504:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126609.576212:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126609.576237:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721318912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3600us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126609.576246:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6879 00000100:00100000:1.0:1746126609.576314:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721319424 00000100:00100000:1.0:1746126609.576320:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721319424 00002000:00100000:1.0:1746126609.576345:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3256320->3260415) req@ffff880092ad3800 x1830945721319424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.576358:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3800 with x1830945721319424 ext(3256320->3260415) 00002000:00010000:1.0:1746126609.576362:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad3800 00000100:00100000:1.0:1746126609.576375:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7532 00000100:00100000:1.0:1746126609.576380:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721319424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.576503:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721319424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 122us (281us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126609.576509:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7532 00002000:00100000:1.0:1746126609.576513:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3256320->3260415) req@ffff880092ad3800 x1830945721319424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.576519:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3800 with x1830945721319424 ext(3256320->3260415) 00002000:00010000:1.0:1746126609.576522:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad3800 00000100:00100000:0.0:1746126609.581278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.587017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.587607:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.587625:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721319680 00000100:00100000:0.0:1746126609.587628:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721319680 00010000:00010000:0.0:1746126609.587644:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801365b1600/0xb50e8258676129dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3fd expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126609.587677:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6880 00000100:00100000:0.0:1746126609.587684:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721319680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126609.587696:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126609.587719:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801365b1600/0xb50e8258676129dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3fd expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.587730:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801365b1600/0xb50e8258676129dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3fd expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126609.587752:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801365b1600/0xb50e8258676129dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3fd expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.588790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.588810:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721320064 00000100:00100000:3.0:1746126609.588816:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721320064 00010000:00010000:0.0:1746126609.588852:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126609.588915:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e8258676129c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e1 expref: 16 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.588934:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6881 00000100:00100000:3.0:1746126609.588940:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721320064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.588948:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.588960:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e8258676129c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e1 expref: 16 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.588963:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721319680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1279us (1357us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126609.588969:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e8258676129c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e1 expref: 16 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.588969:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6880 00010000:00010000:3.0:1746126609.588985:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac3200/0xb50e8258676129c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d3e1 expref: 16 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.589190:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.589192:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.589199:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.589208:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.589248:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.589260:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721317888:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126609.589329:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.590737:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721317888:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126609.590755:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.590971:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721320064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2029us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.590981:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6881 00000100:00100000:0.0:1746126609.591741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.591887:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721320320 00000100:00100000:3.0:1746126609.591895:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721320320 00000100:00100000:3.0:1746126609.592050:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3725 00000100:00100000:3.0:1746126609.592059:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:31108:x1830945721320320:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126609.592261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.592267:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+228:31108:x1830945721320320:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 210us (528us total) trans 8589943020 rc 0/0 00000100:00100000:3.0:1746126609.592637:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3725 00000100:00100000:0.0:1746126609.702919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.703215:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721318016:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126609.703297:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc240 going to sleep for 11 seconds 00002000:00010000:2.0:1746126609.705611:0:9686:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126609.705618:0:9686:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126608 -> 1746126609 00000100:00100000:2.0:1746126609.705644:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721318016:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126609.705674:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fa1a00/0xb50e825867612a4c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d443 expref: 16 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.705686:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1a00/0xb50e825867612a4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d443 expref: 16 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.705714:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa1a00, rc 0) 00000100:00100000:2.0:1746126609.705755:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721320704:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2657us (2846us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126609.705764:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13199 00000100:00100000:0.0:1746126609.711998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.712300:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721320960 00000100:00100000:1.0:1746126609.712312:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721320960 00000100:00100000:1.0:1746126609.712372:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8861 00000100:00100000:1.0:1746126609.712381:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+228:31118:x1830945721320960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.712407:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.712426:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d000/0xb50e825867612a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d44a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.712537:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712549:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712559:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712571:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712577:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712583:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712685:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ca00/0xb50e825867612a68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712694:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ca00/0xb50e825867612a68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712700:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ca00/0xb50e825867612a68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126609.712707:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126609.712784:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712790:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712796:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712800:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f09ce00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.712803:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712809:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712817:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126609.712819:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.712822:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712862:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ce00/0xb50e825867612a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712883:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712888:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712892:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712895:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f09cc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.712897:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712905:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712911:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4300) 00010000:00010000:1.0:1746126609.712913:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.712915:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712919:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09cc00/0xb50e825867612a61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.712954:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d000/0xb50e825867612a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d44a expref: 231 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.712966:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ca00/0xb50e825867612a68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d44a expref: 230 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.712973:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.712974:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126609.712977:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09ca00, rc 0) 00000100:00100000:1.0:1746126609.713029:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+230:31118:x1830945721320960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 649us (1042us total) trans 8589943021 rc 0/0 00000100:00100000:1.0:1746126609.713035:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8861 00000100:00100000:0.0:1746126609.718215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.718387:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721321216 00000100:00100000:2.0:1746126609.718399:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721321216 00002000:00100000:2.0:1746126609.718446:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->483327) req@ffff8800918e8700 x1830945721321216/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.718456:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8700 with x1830945721321216 ext(0->483327) 00002000:00010000:2.0:1746126609.718460:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918e8700 00000100:00100000:0.0:1746126609.718486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.719666:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721321472 00000100:00100000:2.0:1746126609.719673:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721321472 00002000:00100000:2.0:1746126609.719709:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1196032->2097151) req@ffff8800918e9880 x1830945721321472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.719716:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e9880 with x1830945721321472 ext(1196032->2097151) 00002000:00010000:2.0:1746126609.719720:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918e9880 00000100:00100000:3.0:1746126609.719759:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7535 00000100:00100000:3.0:1746126609.719770:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721321216:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126609.720285:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7536 00000100:00100000:2.0:1746126609.720291:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721321472:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.723297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.723337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.724544:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721321856 00000100:00100000:2.0:1746126609.724554:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721321856 00000100:00100000:2.0:1746126609.724598:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3726 00000100:00100000:2.0:1746126609.724605:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:31118:x1830945721321856:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126609.726904:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721321600 00000100:00100000:3.0:1746126609.726920:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721321600 00000100:00100000:3.0:1746126609.726973:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 677 00000100:00100000:3.0:1746126609.726981:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+231:1966:x1830945721321600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.726997:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.727029:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09ca00/0xb50e825867612a68 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d44a expref: 231 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.728136:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126609.728142:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.728205:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1966:x1830945721321600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1222us (4916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.728214:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 677 00000100:00100000:2.0:1746126609.728470:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:31118:x1830945721321856:12345-192.168.203.2@tcp:35:cat.0 Request processed in 3864us (5131us total) trans 8589943022 rc 0/0 00000100:00100000:2.0:1746126609.728478:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3726 00000100:00100000:2.0:1746126609.730742:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721321216:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10965us (12533us total) trans 0 rc 483328/483328 00000100:00100000:2.0:1746126609.730752:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7535 00002000:00100000:2.0:1746126609.730764:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->483327) req@ffff8800918e8700 x1830945721321216/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.730774:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8700 with x1830945721321216 ext(0->483327) 00002000:00010000:2.0:1746126609.730779:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918e8700 00000100:00100000:0.0:1746126609.742414:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.742505:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721321984 00000100:00100000:2.0:1746126609.742521:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721321984 00000100:00100000:2.0:1746126609.742573:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13200 00000100:00100000:2.0:1746126609.742581:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721321984:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126609.742599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126609.742600:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.742617:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fa1600/0xb50e825867612a76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d451 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.742633:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322112 00000100:00100000:3.0:1746126609.742640:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322112 00000100:00100000:2.0:1746126609.742674:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721318144:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126609.742765:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.745272:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13201 00000100:00100000:3.0:1746126609.745285:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721322112:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.745299:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.745313:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009204a400/0xb50e825867612a7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d458 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.745351:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721318272:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126609.745422:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126609.746764:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721321472:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26463us (28266us total) trans 0 rc 901120/901120 00000100:00100000:2.0:1746126609.746776:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7536 00002000:00100000:2.0:1746126609.746791:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1196032->2097151) req@ffff8800918e9880 x1830945721321472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.746801:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e9880 with x1830945721321472 ext(1196032->2097151) 00002000:00010000:2.0:1746126609.746808:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918e9880 00002000:00010000:2.0:1746126609.751171:0:9686:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126609.751180:0:9686:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126609.751182:0:9686:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126608 -> 1746126609 00000100:00100000:2.0:1746126609.751207:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721318144:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126609.751241:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fa1600/0xb50e825867612a76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d451 expref: 20 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.751253:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fa1600/0xb50e825867612a76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d451 expref: 20 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.751270:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa1600, rc 0) 00000100:00100000:2.0:1746126609.751314:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721321984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8733us (8910us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126609.751323:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13200 00002000:00010000:3.0:1746126609.751568:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126608 -> 1746126609 00000100:00100000:3.0:1746126609.751588:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721318272:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126609.751607:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009204a400/0xb50e825867612a7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d458 expref: 30 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.751616:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009204a400/0xb50e825867612a7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d458 expref: 30 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.751985:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009204a400, rc 0) 00000100:00100000:3.0:1746126609.752012:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721322112:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6731us (9413us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126609.752018:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13201 00000100:00100000:0.0:1746126609.764414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.765991:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322240 00000100:00100000:3.0:1746126609.766002:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322240 00000100:00100000:3.0:1746126609.766065:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13202 00000100:00100000:3.0:1746126609.766073:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+19:31118:x1830945721322240:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.766093:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.766117:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d45f expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.766145:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.766153:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126609.766154:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126609.766158:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 20 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.766189:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.766201:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 17 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.766214:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721318400:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.766289:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.766363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.766377:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322368 00000100:00100000:2.0:1746126609.766382:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322368 00000100:00100000:2.0:1746126609.766403:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13203 00000100:00100000:2.0:1746126609.766409:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31117:x1830945721322368:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126609.766417:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.766588:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d466 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.766605:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.766611:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126609.766612:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126609.766615:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.766632:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.766640:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 28 pid: 4640 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.766649:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721318528:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.767388:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.770631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.770758:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721318400:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.770788:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 20 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.770811:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009204a200, rc 0) 00000100:00100000:3.0:1746126609.770882:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:31118:x1830945721322240:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4809us (7342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.770891:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13202 00000100:00100000:2.0:1746126609.770979:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721318528:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126609.770996:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.771006:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa0000, rc 0) 00000100:00100000:2.0:1746126609.771023:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31117:x1830945721322368:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4614us (4661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.771029:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13203 00000100:00100000:2.0:1746126609.771052:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322496 00000100:00100000:2.0:1746126609.771057:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322496 00002000:00100000:2.0:1746126609.771091:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (483328->1048575) req@ffff8800918e8000 x1830945721322496/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.771099:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8000 with x1830945721322496 ext(483328->1048575) 00010000:00010000:2.0:1746126609.771117:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 18 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.771128:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 18 pid: 9686 timeout: 831 lvb_type: 0 00002000:00010000:2.0:1746126609.771134:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918e8000 00000100:00100000:2.0:1746126609.771150:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1714 00000100:00100000:2.0:1746126609.771156:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721322496:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126609.772285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.772480:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322624 00000100:00100000:3.0:1746126609.772485:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322624 00002000:00100000:3.0:1746126609.772508:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3256320->3719167) req@ffff88009e9d4e00 x1830945721322624/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.772516:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4e00 with x1830945721322624 ext(3256320->3719167) 00010000:00010000:3.0:1746126609.772522:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 29 pid: 4640 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.772530:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 29 pid: 4640 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.772536:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9d4e00 00000100:00100000:3.0:1746126609.772557:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1715 00000100:00100000:3.0:1746126609.772563:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721322624:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126609.783319:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721322496:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12150us (12686us total) trans 21474840285 rc 0/0 00000100:00100000:2.0:1746126609.783332:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1714 00002000:00100000:2.0:1746126609.783345:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (483328->1048575) req@ffff8800918e8000 x1830945721322496/t21474840285(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.783355:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8000 with x1830945721322496 ext(483328->1048575) 00010000:00010000:2.0:1746126609.783366:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.783381:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00002000:00010000:2.0:1746126609.783387:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918e8000 00000100:00100000:3.0:1746126609.788719:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721322624:12345-192.168.203.2@tcp:4:cat.0 Request processed in 16142us (16424us total) trans 17179873133 rc 0/0 00000100:00100000:3.0:1746126609.788731:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1715 00002000:00100000:3.0:1746126609.788745:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3256320->3719167) req@ffff88009e9d4e00 x1830945721322624/t17179873133(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.788760:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4e00 with x1830945721322624 ext(3256320->3719167) 00010000:00010000:3.0:1746126609.788770:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.788783:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.788790:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9d4e00 00000100:00100000:0.0:1746126609.789119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.789691:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322752 00000100:00100000:3.0:1746126609.789700:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322752 00010000:00010000:3.0:1746126609.789724:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.790477:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6882 00000100:00100000:3.0:1746126609.790486:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721322752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.790501:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.790523:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.790534:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.790555:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009204b400/0xb50e825867612a3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d435 expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.791747:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.791752:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.791760:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.791769:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.791802:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 19 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.791812:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721318656:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126609.792300:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.794193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.794496:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721318656:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126609.794519:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.794557:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721322752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4071us (5451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.794568:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6882 00000100:00100000:3.0:1746126609.794594:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721322880 00000100:00100000:3.0:1746126609.794600:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721322880 00010000:00010000:3.0:1746126609.794623:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.794640:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6883 00000100:00100000:3.0:1746126609.794646:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721322880:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.794656:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.794676:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.794692:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.794714:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009204aa00/0xb50e825867612a37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3719167) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d42e expref: 31 pid: 4640 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.794727:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.794729:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.794735:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.794742:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.794766:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126609.794776:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721318784:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126609.794863:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.796377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.796536:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721323136 00000100:00100000:2.0:1746126609.796542:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721323136 00002000:00100000:2.0:1746126609.796582:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e9d5180 x1830945721323136/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.796591:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5180 with x1830945721323136 ext(0->1048575) 00002000:00010000:2.0:1746126609.796595:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d5180 00000100:00100000:2.0:1746126609.796613:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7537 00000100:00100000:2.0:1746126609.796619:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721323136:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126609.802033:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721318784:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126609.802058:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.802121:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721322880:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7472us (7931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.802132:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6883 00010000:00010000:0.0:1746126609.812770:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126609.816695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.816742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.816816:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721323392 00000100:00100000:2.0:1746126609.816850:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721323392 00002000:00100000:2.0:1746126609.816896:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e9d7100 x1830945721323392/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.816906:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7100 with x1830945721323392 ext(2097152->3145727) 00002000:00010000:2.0:1746126609.816911:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d7100 00000100:00100000:2.0:1746126609.816926:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721323520 00000100:00100000:2.0:1746126609.816928:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721323520 00002000:00100000:2.0:1746126609.816937:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e9d6300 x1830945721323520/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.816944:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6300 with x1830945721323520 ext(3145728->4194303) 00002000:00010000:2.0:1746126609.816946:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d6300 00000100:00100000:2.0:1746126609.816958:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7538 00000100:00100000:2.0:1746126609.816965:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721323392:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.817783:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7539 00000100:00100000:1.0:1746126609.817792:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721323520:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126609.825465:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721323136:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28833us (29079us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126609.825479:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7537 00002000:00100000:2.0:1746126609.825490:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e9d5180 x1830945721323136/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.825500:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5180 with x1830945721323136 ext(0->1048575) 00002000:00010000:2.0:1746126609.825506:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d5180 00000100:00100000:0.0:1746126609.831766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.832451:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721323904 00000100:00100000:1.0:1746126609.832460:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721323904 00000100:00100000:1.0:1746126609.832507:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8862 00000100:00100000:1.0:1746126609.832513:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+230:31123:x1830945721323904:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126609.832537:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.832555:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d46d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.832667:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832680:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832689:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832701:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832705:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832710:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832802:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4aba00/0xb50e825867612aa7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832809:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4aba00/0xb50e825867612aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832814:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4aba00/0xb50e825867612aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126609.832821:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126609.832926:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832933:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832938:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832943:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e4abe00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.832946:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832951:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832960:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126609.832963:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.832966:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832970:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867612a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832985:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832988:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832992:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.832996:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e4abc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126609.832997:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.833002:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.833007:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4200) 00010000:00010000:1.0:1746126609.833008:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126609.833010:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.833013:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612aa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126609.833043:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136974400/0xb50e825867612a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d46d expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.833051:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4aba00/0xb50e825867612aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d46d expref: 232 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.833056:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.833058:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126609.833059:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4aba00, rc 0) 00000100:00100000:1.0:1746126609.833102:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+232:31123:x1830945721323904:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 589us (1346us total) trans 8589943023 rc 0/0 00000100:00100000:1.0:1746126609.833119:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8862 00000100:00100000:3.0:1746126609.833680:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721323392:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16714us (16993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.833688:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7538 00002000:00100000:3.0:1746126609.833696:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e9d7100 x1830945721323392/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.833703:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7100 with x1830945721323392 ext(2097152->3145727) 00002000:00010000:3.0:1746126609.833707:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d7100 00000100:00100000:1.0:1746126609.839489:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721323520:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21686us (22733us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126609.839501:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7539 00002000:00100000:1.0:1746126609.839512:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e9d6300 x1830945721323520/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.839525:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6300 with x1830945721323520 ext(3145728->4194303) 00002000:00010000:1.0:1746126609.839531:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d6300 00000100:00100000:0.0:1746126609.846069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.846178:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324032 00000100:00100000:2.0:1746126609.846187:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324032 00000100:00100000:2.0:1746126609.846237:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13204 00000100:00100000:2.0:1746126609.846244:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+30:31118:x1830945721324032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126609.846265:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.846282:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d474 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.846314:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.846322:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126609.846324:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126609.846328:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.846356:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 15 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.846369:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 15 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.846381:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721318912:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.846462:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.848974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.849492:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324160 00000100:00100000:3.0:1746126609.849499:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324160 00000100:00100000:3.0:1746126609.849552:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 678 00000100:00100000:3.0:1746126609.849558:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:1963:x1830945721324160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126609.849572:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126609.849595:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4aba00/0xb50e825867612aa7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d46d expref: 232 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.849623:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126609.849627:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126609.849665:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+231:1963:x1830945721324160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 107us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.849671:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 678 00000100:00100000:2.0:1746126609.850014:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721318912:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126609.850040:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.850056:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f41c00, rc 0) 00000100:00100000:2.0:1746126609.850131:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+31:31118:x1830945721324032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3886us (4070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.850138:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13204 00000100:00100000:2.0:1746126609.858218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.858394:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324288 00000100:00100000:1.0:1746126609.858405:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324288 00002000:00100000:1.0:1746126609.858451:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1196031) req@ffff880092ad0380 x1830945721324288/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.858462:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0380 with x1830945721324288 ext(1048576->1196031) 00010000:00010000:1.0:1746126609.858472:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 16 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.858485:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 16 pid: 9686 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746126609.858493:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad0380 00000100:00100000:0.0:1746126609.858680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.858708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.859771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.859811:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1716 00000100:00100000:1.0:1746126609.859820:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721324288:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126609.860253:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324416 00000100:00100000:2.0:1746126609.860259:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324416 00000100:00100000:2.0:1746126609.860287:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324544 00000100:00100000:1.0:1746126609.860327:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324672 00000100:00100000:1.0:1746126609.860331:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324672 00000100:00100000:1.0:1746126609.860352:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13205 00000100:00100000:1.0:1746126609.860356:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721324416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.860367:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.860383:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d47b expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.860403:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.860405:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.860414:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.860428:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126609.860431:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324544 00010000:00010000:1.0:1746126609.860440:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4ab000, rc 0) 00000100:00100000:1.0:1746126609.860469:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721324416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 111us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.860474:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13205 00000100:00100000:1.0:1746126609.860491:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13206 00000100:00100000:1.0:1746126609.860495:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d44a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:31123:x1830945721324672:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126609.860501:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.860507:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d489 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.860520:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.860527:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.860532:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.860533:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.860535:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [618496->802815] (req 618496->802815) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.860567:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.860576:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 19 pid: 4641 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.860585:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319040:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.860632:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.860639:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.860645:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319168:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.860659:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126609.860728:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13207 00000100:00100000:2.0:1746126609.860737:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721324544:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126609.860745:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.860755:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f41800/0xb50e825867612aca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d482 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126609.861165:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721319296:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126609.861211:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1746126609.864017:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721324288:12345-192.168.203.2@tcp:4:cat.0 Request processed in 4191us (5802us total) trans 17179873134 rc 0/0 00000100:00100000:2.0:1746126609.864028:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1716 00002000:00100000:2.0:1746126609.864038:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1196031) req@ffff880092ad0380 x1830945721324288/t17179873134(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.864046:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0380 with x1830945721324288 ext(1048576->1196031) 00010000:00010000:2.0:1746126609.864055:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.864067:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 20 pid: 9686 timeout: 831 lvb_type: 0 00002000:00010000:2.0:1746126609.864073:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad0380 00000100:00100000:0.0:1746126609.866614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.866936:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319040:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.866948:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319168:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.866977:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [618496->802815] (req 618496->802815) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.866993:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4aae00, rc 0) 00000100:00100000:1.0:1746126609.867032:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d44a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:31123:x1830945721324672:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6535us (7262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.867044:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13206 00000100:00100000:1.0:1746126609.867078:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324800 00000100:00100000:1.0:1746126609.867084:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324800 00010000:00010000:1.0:1746126609.867116:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 20 pid: 4641 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.867148:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6884 00000100:00100000:1.0:1746126609.867155:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721324800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.867168:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.867188:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 20 pid: 4641 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.867198:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 20 pid: 4641 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.867218:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612abc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d47b expref: 20 pid: 4641 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126609.867234:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.867251:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721324800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 97us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.867257:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6884 00000100:00100000:2.0:1746126609.867376:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721319296:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126609.867397:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f41800/0xb50e825867612aca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d482 expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.867406:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f41800/0xb50e825867612aca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d482 expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.867430:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f41800, rc 0) 00000100:00100000:2.0:1746126609.867449:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721324544:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6716us (8740us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126609.867455:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13207 00000100:00100000:0.0:1746126609.868569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.868601:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324928 00000100:00100000:1.0:1746126609.868605:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324928 00010000:00010000:1.0:1746126609.868621:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.868654:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6885 00000100:00100000:1.0:1746126609.868659:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721324928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.868668:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.868679:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.868687:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.868702:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009204a200/0xb50e825867612a84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d45f expref: 21 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.868710:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.868712:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.868718:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.868726:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.868751:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.868760:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721319424:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126609.868849:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.870676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.871632:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721319424:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126609.871652:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.871696:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721324928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3036us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.871706:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6885 00000100:00100000:1.0:1746126609.871731:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325056 00000100:00100000:1.0:1746126609.871736:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325056 00010000:00010000:1.0:1746126609.871756:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 18 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.871790:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6886 00000100:00100000:1.0:1746126609.871797:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721325056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.871808:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.871846:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 18 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.871857:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 18 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.871878:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612a45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d43c expref: 18 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.871890:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.871892:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.871899:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.871911:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.871937:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.871947:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721319552:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126609.871997:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.872904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.873954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.874435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.874510:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325312 00000100:00100000:2.0:1746126609.874517:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325312 00002000:00100000:2.0:1746126609.874552:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (618496->622591) req@ffff8800a448e680 x1830945721325312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.874561:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448e680 with x1830945721325312 ext(618496->622591) 00002000:00010000:2.0:1746126609.874566:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448e680 00000100:00100000:2.0:1746126609.874586:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7540 00000100:00100000:2.0:1746126609.874592:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721325312:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126609.874754:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721325312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 162us (1851us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126609.874761:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7540 00002000:00100000:2.0:1746126609.874766:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (618496->622591) req@ffff8800a448e680 x1830945721325312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.874772:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448e680 with x1830945721325312 ext(618496->622591) 00002000:00010000:2.0:1746126609.874775:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448e680 00000100:00100000:3.0:1746126609.876330:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325440 00000100:00100000:3.0:1746126609.876336:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325440 00000100:00100000:3.0:1746126609.876465:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325568 00000100:00100000:3.0:1746126609.876468:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325568 00000100:00100000:1.0:1746126609.876512:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13208 00000100:00100000:1.0:1746126609.876520:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721325440:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.876533:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.876549:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612ad1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d490 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.876596:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319680:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.877219:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.877875:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13209 00000100:00100000:3.0:1746126609.877884:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721325568:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126609.877896:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.877910:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d497 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.877926:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.877928:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.877936:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.877949:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.877959:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09d200, rc 0) 00000100:00100000:3.0:1746126609.878003:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721325568:12345-192.168.203.2@tcp:101:cat.0 Request processed in 121us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.878009:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13209 00000100:00100000:2.0:1746126609.880820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.880917:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721319552:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126609.880939:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.880976:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721325056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9178us (10304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.880986:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6886 00000100:00100000:3.0:1746126609.881343:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325824 00000100:00100000:3.0:1746126609.881350:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325824 00002000:00100000:3.0:1746126609.881389:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092ad2a00 x1830945721325824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.881399:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad2a00 with x1830945721325824 ext(1048576->2097151) 00002000:00010000:3.0:1746126609.881408:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad2a00 00000100:00100000:3.0:1746126609.881429:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7541 00000100:00100000:3.0:1746126609.881436:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721325824:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126609.883135:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319680:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.883171:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612ad1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d490 expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.883184:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab000/0xb50e825867612ad1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d490 expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.883195:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4ab000, rc 0) 00000100:00100000:1.0:1746126609.884639:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721325440:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8113us (10679us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.884648:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13208 00000100:00100000:1.0:1746126609.884717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.884952:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326080 00000100:00100000:2.0:1746126609.884960:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326080 00002000:00100000:2.0:1746126609.884996:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (798720->802815) req@ffff8801367ebb80 x1830945721326080/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.885005:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ebb80 with x1830945721326080 ext(798720->802815) 00002000:00010000:2.0:1746126609.885010:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367ebb80 00000100:00100000:2.0:1746126609.885034:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7542 00000100:00100000:2.0:1746126609.885041:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721326080:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126609.885197:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721326080:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 156us (479us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126609.885203:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7542 00002000:00100000:2.0:1746126609.885208:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (798720->802815) req@ffff8801367ebb80 x1830945721326080/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.885215:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ebb80 with x1830945721326080 ext(798720->802815) 00002000:00010000:2.0:1746126609.885218:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367ebb80 00000100:00100000:0.0:1746126609.891169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.891290:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326208 00000100:00100000:1.0:1746126609.891301:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326208 00000100:00100000:1.0:1746126609.891353:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13210 00000100:00100000:1.0:1746126609.891361:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721326208:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.891379:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.891397:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab200/0xb50e825867612adf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d49e expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.891448:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319808:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.891528:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.892444:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721325824:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 11005us (11630us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.892453:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7541 00002000:00100000:3.0:1746126609.892462:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092ad2a00 x1830945721325824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.892472:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad2a00 with x1830945721325824 ext(1048576->2097151) 00002000:00010000:3.0:1746126609.892476:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad2a00 00000100:00100000:0.0:1746126609.894902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.895052:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326464 00000100:00100000:2.0:1746126609.895060:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326464 00000100:00100000:1.0:1746126609.895239:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319808:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126609.895270:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab200/0xb50e825867612adf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d49e expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.895283:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4ab200/0xb50e825867612adf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d49e expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.895301:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4ab200, rc 0) 00000100:00100000:2.0:1746126609.895368:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3727 00000100:00100000:2.0:1746126609.895376:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+231:31123:x1830945721326464:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126609.896557:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721326208:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5193us (5395us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.896566:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13210 00000100:00100000:2.0:1746126609.896852:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+232:31123:x1830945721326464:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 1453us (1932us total) trans 8589943024 rc 0/0 00000100:00100000:2.0:1746126609.896859:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3727 00000100:00100000:0.0:1746126609.904119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.904287:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326720 00000100:00100000:3.0:1746126609.904297:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326720 00002000:00100000:3.0:1746126609.904345:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a448ea00 x1830945721326720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.904355:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ea00 with x1830945721326720 ext(2097152->3145727) 00002000:00010000:3.0:1746126609.904360:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ea00 00000100:00100000:3.0:1746126609.904385:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7543 00000100:00100000:3.0:1746126609.904394:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721326720:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126609.910966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.911515:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326848 00000100:00100000:2.0:1746126609.911525:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326848 00000100:00100000:2.0:1746126609.911957:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13211 00000100:00100000:2.0:1746126609.911967:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31122:x1830945721326848:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126609.911987:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.912004:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4a5 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.912035:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.912047:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126609.912049:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126609.912052:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [102400->724991] (req 102400->724991) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.912083:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.912093:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 21 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.912113:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319936:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.912909:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.922036:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721326720:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17631us (17923us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126609.922050:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7543 00002000:00100000:3.0:1746126609.922062:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a448ea00 x1830945721326720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.922071:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ea00 with x1830945721326720 ext(2097152->3145727) 00002000:00010000:3.0:1746126609.922077:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ea00 00000100:00100000:0.0:1746126609.923121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.923289:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326976 00000100:00100000:3.0:1746126609.923297:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326976 00002000:00100000:3.0:1746126609.923333:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (618496->802815) req@ffff8800a448d180 x1830945721326976/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.923340:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448d180 with x1830945721326976 ext(618496->802815) 00010000:00010000:3.0:1746126609.923348:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.923363:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.923369:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448d180 00000100:00100000:2.0:1746126609.923378:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721319936:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.923394:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1717 00000100:00100000:3.0:1746126609.923400:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721326976:12345-192.168.203.2@tcp:4:cat.0 00010000:00010000:2.0:1746126609.923403:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [102400->724991] (req 102400->724991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.923416:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878c00, rc 0) 00000100:00100000:2.0:1746126609.923455:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31122:x1830945721326848:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11490us (12500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.923462:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13211 00000100:00100000:0.0:1746126609.924823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.924892:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327104 00000100:00100000:2.0:1746126609.924897:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327104 00000100:00100000:2.0:1746126609.924939:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8863 00000100:00100000:2.0:1746126609.924945:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721327104:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126609.924964:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.924982:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878e00/0xb50e825867612aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4ac expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.925037:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925049:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925058:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925071:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925076:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925081:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925196:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925207:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.925214:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.925242:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.925256:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.925267:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721320064:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.925356:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.929464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.930292:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721326976:12345-192.168.203.2@tcp:4:cat.0 Request processed in 6888us (7170us total) trans 21474840286 rc 0/0 00000100:00100000:3.0:1746126609.930304:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1717 00002000:00100000:3.0:1746126609.930316:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (618496->802815) req@ffff8800a448d180 x1830945721326976/t21474840286(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/448 e 0 to 0 dl 1746126620 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.930325:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448d180 with x1830945721326976 ext(618496->802815) 00010000:00010000:3.0:1746126609.930336:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 22 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126609.930348:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 22 pid: 4641 timeout: 831 lvb_type: 0 00002000:00010000:3.0:1746126609.930355:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448d180 00000100:00100000:2.0:1746126609.930502:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327232 00000100:00100000:2.0:1746126609.930510:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327232 00000100:00100000:2.0:1746126609.930557:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13212 00000100:00100000:2.0:1746126609.930564:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+31:31118:x1830945721327232:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126609.930577:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.930595:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4b3 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.930616:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126609.930618:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126609.930624:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 32 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.930637:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 32 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.930648:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4879e00, rc 0) 00000100:00100000:2.0:1746126609.930681:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:31118:x1830945721327232:12345-192.168.203.2@tcp:101:cat.0 Request processed in 117us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.930686:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13212 00000100:00100000:0.0:1746126609.931156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.931226:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327360 00000100:00100000:1.0:1746126609.931231:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327360 00010000:00010000:1.0:1746126609.931251:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 17 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.931281:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6887 00000100:00100000:1.0:1746126609.931286:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721327360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.931301:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.931306:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 17 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.931314:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 17 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.931330:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.931335:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126609.931344:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126609.931351:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126609.931370:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.931391:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721327360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126609.931396:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6887 00010000:00010000:2.0:1746126609.931895:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c07de00/0xb50e8258676129f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d40b expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.931923:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721320064:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126609.931940:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.931948:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.931952:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126609.931993:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126609.931997:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126609.932013:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932022:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932031:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932037:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932043:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932048:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4879000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126609.932052:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932058:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932066:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126609.932069:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126609.932072:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932076:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879000/0xb50e825867612af4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932085:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932090:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932094:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932098:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4879200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126609.932100:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932112:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932119:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a496ac00) 00010000:00010000:2.0:1746126609.932121:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126609.932124:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932127:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879200/0xb50e825867612afb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.932158:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878e00/0xb50e825867612aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.932169:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.932174:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126609.932176:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126609.932178:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4879400, rc 0) 00000100:00100000:2.0:1746126609.932216:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31126:x1830945721327104:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7270us (7396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.932221:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8863 00000100:00100000:0.0:1746126609.935295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.935439:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327488 00000100:00100000:2.0:1746126609.935448:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327488 00010000:00010000:2.0:1746126609.935481:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 22 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.935504:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6888 00000100:00100000:2.0:1746126609.935510:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721327488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126609.935522:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126609.935543:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 22 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.935553:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 22 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.935574:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aae00/0xb50e825867612ac3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 618496->802815) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d489 expref: 22 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.935593:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126609.935595:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126609.935602:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.935609:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.935636:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126609.935646:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721320192:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126609.935707:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.936013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.936454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.936857:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327616 00000100:00100000:1.0:1746126609.936862:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327616 00000100:00100000:1.0:1746126609.936887:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327744 00000100:00100000:1.0:1746126609.936889:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327744 00000100:00100000:1.0:1746126609.936903:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13213 00000100:00100000:1.0:1746126609.936908:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721327616:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126609.936921:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.936934:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e4aaa00/0xb50e825867612b10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4ba expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.936968:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721320320:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.937017:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.937230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.937270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.938524:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327872 00000100:00100000:3.0:1746126609.938532:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327872 00000100:00100000:3.0:1746126609.938544:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328000 00000100:00100000:3.0:1746126609.938545:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328000 00000100:00100000:3.0:1746126609.938576:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13214 00000100:00100000:3.0:1746126609.938582:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721327744:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126609.938596:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.938610:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4c1 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.938627:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.938628:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.938635:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.938649:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.938658:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09c400, rc 0) 00000100:00100000:3.0:1746126609.938693:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721327744:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 111us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.938699:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13214 00000100:00100000:3.0:1746126609.938716:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13215 00000100:00100000:3.0:1746126609.938720:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721328000:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126609.938726:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.938732:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4cf expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.938742:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.938743:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.938747:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.938756:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.938763:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09c200, rc 0) 00000100:00100000:3.0:1746126609.938779:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721328000:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 58us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.938783:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13215 00000100:00100000:3.0:1746126609.938807:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13216 00000100:00100000:3.0:1746126609.938812:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721327872:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126609.938818:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.938925:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4c8 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.938939:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.938940:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.938945:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.938955:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.938961:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09c000, rc 0) 00000100:00100000:3.0:1746126609.938979:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721327872:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 167us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126609.938984:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13216 00000100:00100000:0.0:1746126609.939901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.939933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.942208:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721320192:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126609.942230:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126609.942272:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721327488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6760us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.942281:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6888 00000100:00100000:3.0:1746126609.942496:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328256 00000100:00100000:3.0:1746126609.942503:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328256 00002000:00100000:3.0:1746126609.942544:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e805180 x1830945721328256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.942554:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805180 with x1830945721328256 ext(2097152->3145727) 00002000:00010000:3.0:1746126609.942559:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e805180 00000100:00100000:3.0:1746126609.942572:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328512 00000100:00100000:3.0:1746126609.942575:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328512 00002000:00100000:3.0:1746126609.942587:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e804e00 x1830945721328512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.942593:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804e00 with x1830945721328512 ext(3145728->4194303) 00002000:00010000:3.0:1746126609.942595:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e804e00 00000100:00100000:3.0:1746126609.942614:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7544 00000100:00100000:3.0:1746126609.942620:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721328256:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126609.943344:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7545 00000100:00100000:2.0:1746126609.943351:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721328512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126609.944135:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721320320:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126609.944148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126609.944164:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e4aaa00/0xb50e825867612b10 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ba expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.944175:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aaa00/0xb50e825867612b10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ba expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.944190:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4aaa00, rc 0) 00000100:00100000:1.0:1746126609.944310:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721327616:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7401us (8296us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.944320:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13213 00000100:00100000:1.0:1746126609.944347:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328768 00000100:00100000:1.0:1746126609.944353:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328768 00002000:00100000:1.0:1746126609.944372:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (102400->106495) req@ffff88012b163480 x1830945721328768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.944380:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163480 with x1830945721328768 ext(102400->106495) 00002000:00010000:1.0:1746126609.944384:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b163480 00000100:00100000:1.0:1746126609.944396:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7546 00000100:00100000:1.0:1746126609.944400:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721328768:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126609.944522:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721328768:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 120us (373us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126609.944527:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7546 00002000:00100000:1.0:1746126609.944532:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (102400->106495) req@ffff88012b163480 x1830945721328768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126609.944538:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163480 with x1830945721328768 ext(102400->106495) 00002000:00010000:1.0:1746126609.944540:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b163480 00000100:00100000:1.0:1746126609.954159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.954274:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329024 00000100:00100000:3.0:1746126609.954285:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329024 00000100:00100000:3.0:1746126609.954332:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8864 00000100:00100000:3.0:1746126609.954339:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31126:x1830945721329024:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126609.954361:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.954381:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d600/0xb50e825867612b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4d6 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.954479:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126609.954493:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.954500:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126609.954536:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.954546:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 10 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.954557:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721320448:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.954618:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.960513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.960601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.960952:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329408 00000100:00100000:2.0:1746126609.960961:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329408 00010000:00010000:2.0:1746126609.960998:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 11 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.961047:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6889 00000100:00100000:2.0:1746126609.961054:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721329408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126609.961068:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126609.961073:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 11 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.961085:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 11 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.961115:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126609.961120:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.961129:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.961136:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.961153:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126609.961193:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721329408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 140us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.961198:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6889 00010000:00010000:3.0:1746126609.961212:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4879400/0xb50e825867612b02 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4ac expref: 10 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.961238:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721320448:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.961261:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126609.961267:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126609.961272:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126609.961295:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126609.961861:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d600/0xb50e825867612b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 11 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.961874:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.961880:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126609.961883:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126609.961886:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09d400, rc 0) 00000100:00100000:3.0:1746126609.961913:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31126:x1830945721329024:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7574us (7765us total) trans 8589943025 rc 0/0 00000100:00100000:3.0:1746126609.961919:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8864 00000100:00100000:3.0:1746126609.961941:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329280 00000100:00100000:3.0:1746126609.961945:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329280 00002000:00100000:3.0:1746126609.961968:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (720896->724991) req@ffff88012b163100 x1830945721329280/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/0 e 0 to 0 dl 1746126620 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.961976:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163100 with x1830945721329280 ext(720896->724991) 00002000:00010000:3.0:1746126609.961980:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b163100 00000100:00100000:3.0:1746126609.961993:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7547 00000100:00100000:3.0:1746126609.961998:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721329280:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126609.962121:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721329280:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 122us (1618us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126609.962127:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7547 00002000:00100000:3.0:1746126609.962132:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (720896->724991) req@ffff88012b163100 x1830945721329280/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:370/0 lens 488/4536 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126609.962138:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163100 with x1830945721329280 ext(720896->724991) 00002000:00010000:3.0:1746126609.962141:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b163100 00000100:00100000:2.0:1746126609.962533:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721328256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19912us (22633us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126609.962539:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7544 00002000:00100000:2.0:1746126609.962545:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e805180 x1830945721328256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.962553:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805180 with x1830945721328256 ext(2097152->3145727) 00002000:00010000:2.0:1746126609.962556:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e805180 00000100:00100000:2.0:1746126609.964066:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721328512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20708us (24124us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126609.964077:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7545 00002000:00100000:2.0:1746126609.964085:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e804e00 x1830945721328512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:370/0 lens 488/440 e 0 to 0 dl 1746126620 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126609.964092:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804e00 with x1830945721328512 ext(3145728->4194303) 00002000:00010000:2.0:1746126609.964097:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e804e00 00000100:00100000:2.0:1746126609.967948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.968046:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329536 00000100:00100000:3.0:1746126609.968056:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329536 00000100:00100000:3.0:1746126609.968212:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8865 00000100:00100000:3.0:1746126609.968222:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31126:x1830945721329536:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126609.968250:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126609.968269:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09de00/0xb50e825867612b41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4dd expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.968354:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126609.968367:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 11 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.968373:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126609.968404:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 11 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.968414:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 11 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.968425:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721320576:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126609.968445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.969517:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329792 00000100:00100000:2.0:1746126609.969524:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329792 00000100:00100000:2.0:1746126609.969560:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3728 00000100:00100000:2.0:1746126609.969566:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31122:x1830945721329792:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126609.969725:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126609.969741:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31122:x1830945721329792:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 174us (1297us total) trans 8589943026 rc 0/0 00000100:00100000:2.0:1746126609.969748:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3728 00000100:00100000:0.0:1746126609.970731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126609.970798:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329920 00000100:00100000:1.0:1746126609.970803:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329920 00000100:00100000:1.0:1746126609.970859:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13217 00000100:00100000:1.0:1746126609.970865:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721329920:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126609.970878:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126609.970892:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fa1000/0xb50e825867612b4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4e4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126609.970943:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721320704:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.971635:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.972256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.972341:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721320576:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126609.972363:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126609.972381:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330048 00000100:00100000:1.0:1746126609.972387:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330048 00010000:00010000:1.0:1746126609.972410:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 12 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.972440:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6890 00000100:00100000:1.0:1746126609.972445:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721330048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126609.972456:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126609.972461:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 12 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.972470:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 12 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.972489:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d400/0xb50e825867612b33 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4d6 expref: 12 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126609.973376:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126609.973383:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126609.973393:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126609.973400:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126609.973432:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126609.973482:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721330048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1034us (1226us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126609.973518:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.973524:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126609.973566:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126609.973570:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126609.973589:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.973620:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09de00/0xb50e825867612b41 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4dd expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.973633:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4dd expref: 11 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.973639:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126609.973641:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126609.973643:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09da00, rc 0) 00000100:00100000:2.0:1746126609.973680:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31126:x1830945721329536:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5460us (5744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126609.973687:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8865 00000100:00100000:1.0:1746126609.973749:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6890 00000100:00100000:0.0:1746126609.976358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.976436:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330176 00000100:00100000:2.0:1746126609.976445:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330176 00000100:00100000:2.0:1746126609.976491:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13218 00000100:00100000:2.0:1746126609.976497:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721330176:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:1.0:1746126609.976501:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721320704:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126609.976513:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.976528:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4879800/0xb50e825867612b56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4eb expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.976533:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fa1000/0xb50e825867612b4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4e4 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.976543:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fa1000/0xb50e825867612b4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4e4 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.976553:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa1000, rc 0) 00000100:00100000:2.0:1746126609.976570:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721320832:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126609.976595:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721329920:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5729us (5869us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126609.976602:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13217 00000100:00100000:2.0:1746126609.976618:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126609.981971:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721320832:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126609.982008:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4879800/0xb50e825867612b56 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4eb expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.982024:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4879800/0xb50e825867612b56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4eb expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.982034:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4879800, rc 0) 00000100:00100000:2.0:1746126609.982094:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721330176:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5595us (5743us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126609.982102:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13218 00000100:00100000:0.0:1746126609.984411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.984649:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330304 00000100:00100000:2.0:1746126609.984657:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330304 00000100:00100000:0.0:1746126609.984728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.984791:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13219 00000100:00100000:2.0:1746126609.984800:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721330304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126609.984816:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.984863:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4879200/0xb50e825867612b5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4f2 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126609.984921:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721320960:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126609.985000:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126609.985017:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330560 00000100:00100000:2.0:1746126609.985020:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330560 00000100:00100000:2.0:1746126609.985045:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8866 00000100:00100000:2.0:1746126609.985054:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31126:x1830945721330560:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126609.985063:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126609.985076:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878600/0xb50e825867612b64 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d4f9 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.985320:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.985335:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126609.985345:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126609.985357:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126609.985529:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878600/0xb50e825867612b64 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.985544:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.985552:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126609.985554:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126609.985557:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878400, rc 0) 00000100:00100000:2.0:1746126609.985631:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31126:x1830945721330560:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 575us (902us total) trans 8589943027 rc 0/0 00000100:00100000:2.0:1746126609.985636:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8866 00000100:00100000:2.0:1746126609.987033:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721320960:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126609.987059:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4879200/0xb50e825867612b5d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f2 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.987071:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4879200/0xb50e825867612b5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f2 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.987080:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4879200, rc 0) 00000100:00100000:2.0:1746126609.987125:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721330304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2325us (2720us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126609.987132:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13219 00000100:00100000:0.0:1746126609.989248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.989579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.989610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126609.989861:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330816 00000100:00100000:0.0:1746126609.989870:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.989896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.989930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126609.989988:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330688 00000100:00100000:3.0:1746126609.989996:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330688 00000100:00100000:3.0:1746126609.990031:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330944 00000100:00100000:3.0:1746126609.990033:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330944 00000100:00100000:3.0:1746126609.990162:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331200 00000100:00100000:3.0:1746126609.990165:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331200 00000100:00100000:1.0:1746126609.990194:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331072 00000100:00100000:1.0:1746126609.990198:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331072 00000100:00100000:2.0:1746126609.990295:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330816 00000100:00100000:3.0:1746126609.990489:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331328 00000100:00100000:3.0:1746126609.990492:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331328 00000100:00100000:3.0:1746126609.990512:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13220 00000100:00100000:3.0:1746126609.990518:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721330688:12345-192.168.203.2@tcp:1:lfs.0 00000100:00100000:1.0:1746126609.990609:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13221 00000100:00100000:1.0:1746126609.990615:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721330944:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126609.990642:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990660:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.990668:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990676:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990683:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.990685:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.990688:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990719:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990733:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 17 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.990745:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721321088:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.990819:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990845:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.990854:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721321216:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.990883:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.990894:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 14 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126609.990902:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721321344:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.990920:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.990942:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13222 00000100:00100000:1.0:1746126609.990947:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721331200:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126609.990967:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990978:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990985:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.990992:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.990997:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.990999:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126609.991001:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.991018:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.991026:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.991035:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721321472:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.991066:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126609.991073:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 12 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.991151:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991162:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991168:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126609.991169:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126609.991171:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991189:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991197:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 19 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.991204:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721321728:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.991226:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.991243:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13223 00000100:00100000:3.0:1746126609.991249:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721331072:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126609.991264:0:20294:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991274:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.991281:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991291:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991297:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.991298:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.991300:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991314:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991321:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 19 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.991328:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721321856:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.991355:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991363:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126609.991371:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721321984:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.991394:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.991406:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746126609.991414:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721322112:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.991434:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126609.991450:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13224 00000100:00100000:3.0:1746126609.991455:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721331328:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126609.991475:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991484:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991490:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 14 pid: 20294 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126609.991493:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13225 00010000:00010000:3.0:1746126609.991497:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 31 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126609.991498:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721330816:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126609.991502:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.991503:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126609.991505:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.991513:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991518:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 31 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.991522:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126609.991526:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 31 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.991528:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 14 pid: 20294 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126609.991534:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721322240:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126609.991534:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.991539:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126609.991540:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126609.991542:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.991555:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.991559:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 14 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126609.991562:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126609.991566:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 14 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:2.0:1746126609.991570:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721322368:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.991572:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721322496:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.991586:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 17 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.991589:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 14 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126609.991593:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 17 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126609.991597:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 14 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746126609.991600:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721322624:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.991603:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721322752:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.991611:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b50000 going to sleep for 11 seconds 00010000:00010000:2.0:1746126609.991617:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126609.991623:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126609.991629:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721322880:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.991640:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.991847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126609.991867:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331456 00000100:00100000:0.0:1746126609.991871:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331456 00000100:00100000:0.0:1746126609.991890:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13226 00000100:00100000:0.0:1746126609.991894:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721331456:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126609.991903:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126609.991912:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e825867612ba3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d500 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126609.991941:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721323008:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126609.991960:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da099c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126609.992230:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721321600:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126609.992270:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126609.992279:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 19 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126609.992286:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721323136:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.992302:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126609.998451:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721323008:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126609.998483:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e825867612ba3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d500 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126609.998497:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a35800/0xb50e825867612ba3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d500 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126609.998515:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35800, rc 0) 00000100:00100000:2.0:1746126609.998589:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721322752:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126609.998597:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721322880:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.998671:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721321472:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.998685:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721321088:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126609.998692:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721321216:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126609.998755:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721321728:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126609.998776:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.000502:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721331456:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8598us (8647us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126610.000512:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13226 00000100:00100000:1.0:1746126610.000824:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721321344:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.000870:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.001009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.001039:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331712 00000100:00100000:1.0:1746126610.001045:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331712 00000100:00100000:0.0:1746126610.001062:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721321600:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.001071:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721323136:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.001073:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 15 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746126610.001088:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.001094:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6891 00000100:00100000:1.0:1746126610.001100:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1965:x1830945721331712:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126610.001137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.001154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.001167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.001179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.001190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.001201:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331968 00000100:00100000:0.0:1746126610.001204:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331968 00010000:00010000:0.0:1746126610.001216:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126610.001225:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332992 00000100:00100000:0.0:1746126610.001227:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332992 00010000:00010000:0.0:1746126610.001384:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.001397:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331840 00000100:00100000:0.0:1746126610.001400:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331840 00010000:00010000:0.0:1746126610.001414:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 18 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.001421:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332224 00000100:00100000:0.0:1746126610.001426:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332224 00010000:00010000:0.0:1746126610.001436:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.001445:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6892 00000100:00100000:0.0:1746126610.001449:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721331968:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.001459:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.001478:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746126610.001487:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746126610.001506:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f09c000/0xb50e825867612b25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c8 expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746126610.001519:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.001547:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721331968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 97us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.001552:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6892 00000100:00100000:0.0:1746126610.001562:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6893 00000100:00100000:0.0:1746126610.001566:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721332992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.001574:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.001583:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001591:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001602:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.001614:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721332992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 48us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.001619:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6893 00000100:00100000:0.0:1746126610.001629:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6894 00000100:00100000:0.0:1746126610.001633:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721331840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.001639:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.001651:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 18 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001659:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 18 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001670:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612815 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2bb expref: 18 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001679:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.001687:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721322368:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.001691:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721331840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 59us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.001699:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6894 00010000:00010000:2.0:1746126610.001708:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.001708:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6895 00000100:00100000:0.0:1746126610.001712:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721332224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.001717:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.001724:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.001725:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721331584 00000100:00100000:2.0:1746126610.001728:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721331584 00010000:00010000:0.0:1746126610.001731:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001741:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a26800/0xb50e825867612838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d7 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.001749:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746126610.001756:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (102400->724991) req@ffff88009204ca80 x1830945721331584/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746126610.001761:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721332224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 49us (571us total) trans 0 rc 0/0 00002000:00100000:2.0:1746126610.001765:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ca80 with x1830945721331584 ext(102400->724991) 00000100:00100000:0.0:1746126610.001766:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6895 00010000:00010000:2.0:1746126610.001771:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126610.001779:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00002000:00010000:2.0:1746126610.001785:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204ca80 00000100:00100000:2.0:1746126610.001804:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1718 00000100:00100000:2.0:1746126610.001809:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721331584:12345-192.168.203.2@tcp:4:multiop.0 00010000:00010000:1.0:1746126610.001921:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.001933:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 15 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126610.001942:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 15 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126610.001954:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f09c400/0xb50e825867612b17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4c1 expref: 15 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126610.001971:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.001978:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721322240:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.001986:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721322496:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.001991:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1965:x1830945721331712:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 892us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.001993:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721322624:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.001996:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6891 00010000:00010000:3.0:1746126610.002012:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746126610.002016:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746126610.002019:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746126610.002031:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce18c00/0xb50e825867612854 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2f3 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126610.002043:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721321856:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.002052:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721321984:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.002059:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721322112:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.002072:0:20294:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.002894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.003028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.003042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.003219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.003334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.003348:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332096 00000100:00100000:1.0:1746126610.003353:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332096 00010000:00010000:1.0:1746126610.003378:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 14 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746126610.003380:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333120 00000100:00100000:3.0:1746126610.003382:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333120 00010000:00010000:3.0:1746126610.003396:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 21 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126610.003396:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332480 00000100:00100000:1.0:1746126610.003397:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332480 00010000:00010000:1.0:1746126610.003405:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746126610.003409:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332736 00000100:00100000:3.0:1746126610.003410:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332736 00000100:00100000:1.0:1746126610.003415:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6896 00010000:00010000:3.0:1746126610.003418:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 15 pid: 20294 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746126610.003420:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945721332096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746126610.003427:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6897 00010000:00010000:1.0:1746126610.003429:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126610.003431:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721333120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.003438:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.003443:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 15 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.003447:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 21 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.003452:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 15 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.003454:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 21 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126610.003469:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801365b1000/0xb50e8258676129e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d404 expref: 21 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.003469:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2800/0xb50e825867612720 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d252 expref: 15 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126610.003479:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.003481:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.003485:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.003498:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.003518:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.003540:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945721332096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.003547:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6896 00000100:00100000:1.0:1746126610.003560:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6898 00000100:00100000:1.0:1746126610.003564:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1966:x1830945721332480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.003571:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.003580:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.003641:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.003660:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721333120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 227us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.003665:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6897 00000100:00100000:3.0:1746126610.003700:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6899 00000100:00100000:3.0:1746126610.003705:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945721332736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.003710:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.003720:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.003727:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.003743:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f09c200/0xb50e825867612b1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4cf expref: 13 pid: 20294 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.003752:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.003766:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1966:x1830945721332736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 62us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.003771:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6899 00000100:00100000:0.0:1746126610.003885:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333248 00000100:00100000:2.0:1746126610.003888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.003889:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333248 00010000:00010000:0.0:1746126610.003904:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 31 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.003912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.003914:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332352 00000100:00100000:0.0:1746126610.003916:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332352 00010000:00010000:0.0:1746126610.003932:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 21 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.003936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.003945:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332608 00000100:00100000:0.0:1746126610.003947:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332608 00010000:00010000:0.0:1746126610.003953:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.003960:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721332864 00000100:00100000:0.0:1746126610.003962:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721332864 00010000:00010000:0.0:1746126610.003969:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746126610.003978:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6900 00000100:00100000:0.0:1746126610.003982:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721333248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.003988:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.003991:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126610.004003:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2a00/0xb50e82586761270b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d259 expref: 12 pid: 8436 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746126610.004011:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.004029:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721332480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 465us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.004034:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6898 00000100:00100000:1.0:1746126610.004044:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6901 00000100:00100000:1.0:1746126610.004049:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721332352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.004056:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.004063:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 21 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.004071:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 21 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.004081:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e465000/0xb50e825867612862 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2fa expref: 21 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.004090:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.004091:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.004094:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.004100:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.004169:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 32 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.004177:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 32 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.004180:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.004195:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721332352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.004200:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6901 00000100:00100000:3.0:1746126610.004206:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6902 00000100:00100000:1.0:1746126610.004210:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6903 00000100:00100000:3.0:1746126610.004211:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721332608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126610.004214:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721332864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.004218:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.004218:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.004226:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.004228:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126610.004235:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 32 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.004256:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4879e00/0xb50e825867612b09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4b3 expref: 32 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126610.004257:0:20294:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.004265:0:20294:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.004265:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126610.004284:0:20294:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.004291:0:20294:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.004298:0:20294:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.004310:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.004321:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f41c00/0xb50e825867612ab5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d474 expref: 31 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126610.004329:0:20294:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f09d000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126610.004333:0:20294:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.004340:0:20294:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.004345:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721333248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 298us (947us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126610.004350:0:20294:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.004351:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6900 00010000:00010000:2.0:1746126610.004355:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f09d000/0xb50e825867612b8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.004412:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.004412:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f09d200/0xb50e825867612ad8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d497 expref: 17 pid: 9686 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746126610.004413:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.004416:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.004422:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.004431:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126610.004439:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.004468:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721331072:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 13148us (14499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.004477:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13223 00010000:00010000:2.0:1746126610.004497:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.004503:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005784:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005792:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005797:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005803:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4879000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126610.005805:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005811:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005824:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.005842:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4879000/0xb50e825867612b9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.006045:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721332864:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1826us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.006052:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6903 00010000:00010000:1.0:1746126610.006077:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006084:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.006085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126610.006099:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006117:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006122:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006127:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eac2400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126610.006130:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006136:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006145:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006151:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2400/0xb50e825867612b79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.006183:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721330944:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 15568us (16571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.006189:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13221 00000100:00080000:1.0:1746126610.006209:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126610.006223:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333376 00000100:00100000:1.0:1746126610.006227:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333376 00010000:00010000:1.0:1746126610.006245:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 16 pid: 9686 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126610.006272:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6904 00000100:00100000:1.0:1746126610.006278:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721333376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.006289:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.006299:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 16 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.006312:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 16 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.006323:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867612a8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d466 expref: 16 pid: 9686 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.006331:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.006333:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.006336:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.006342:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.006355:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721332608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2141us (2439us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126610.006358:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.006360:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6902 00000100:00100000:1.0:1746126610.006371:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721333376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.006376:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6904 00010000:00010000:3.0:1746126610.006381:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006387:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006399:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006405:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006410:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006415:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb19000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126610.006417:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006423:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006444:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.006450:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb19000/0xb50e825867612b95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.006481:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721331328:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 15026us (16550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.006487:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13224 00000100:00100000:2.0:1746126610.006719:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721330816:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 15219us (17477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.006725:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13225 00000100:00100000:2.0:1746126610.021305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.021646:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333504 00000100:00100000:1.0:1746126610.021656:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333504 00010000:00010000:1.0:1746126610.021695:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126610.021724:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6905 00000100:00100000:1.0:1746126610.021732:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721333504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.021747:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.021771:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.021783:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.021806:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbc400/0xb50e825867612a0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d420 expref: 20 pid: 20294 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.021823:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.021839:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.021844:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.021852:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.021875:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.021918:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721333504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 188us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.021924:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6905 00010000:00010000:0.0:1746126610.022644:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022653:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022673:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022680:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022687:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022692:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c2a1a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126610.022696:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022703:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022714:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.022719:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a1a00/0xb50e825867612b80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.022775:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721331200:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 31826us (32903us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.022783:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13222 00000100:00100000:2.0:1746126610.026564:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721331584:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 24742us (25417us total) trans 21474840287 rc 0/0 00000100:00100000:2.0:1746126610.026578:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1718 00002000:00100000:2.0:1746126610.026590:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (102400->724991) req@ffff88009204ca80 x1830945721331584/t21474840287(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/448 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.026600:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ca80 with x1830945721331584 ext(102400->724991) 00010000:00010000:2.0:1746126610.026611:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126610.026628:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00002000:00010000:2.0:1746126610.026635:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204ca80 00000100:00100000:0.0:1746126610.029779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.029965:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333632 00000100:00100000:1.0:1746126610.029974:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333632 00010000:00010000:1.0:1746126610.030009:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746126610.030037:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6906 00000100:00100000:1.0:1746126610.030046:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721333632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.030064:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.030088:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.030099:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.030133:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878c00/0xb50e825867612ae6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->724991) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4a5 expref: 20 pid: 4641 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746126610.030148:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.030150:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.030154:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.030162:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.031207:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126610.031406:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.031418:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.031489:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721333632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1442us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.031498:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6906 00010000:00010000:3.0:1746126610.031977:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.031986:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.031993:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.032000:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f09dc00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126610.032003:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.032012:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.032026:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.032031:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f09dc00/0xb50e825867612b87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.032081:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721330688:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 41562us (42502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.032088:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13220 00000100:00100000:1.0:1746126610.032168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.032297:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333760 00000100:00100000:2.0:1746126610.032303:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333760 00000100:00100000:2.0:1746126610.032336:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13227 00000100:00100000:2.0:1746126610.032342:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721333760:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.032356:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.032370:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d507 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126610.032389:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c711, atime: 0x6813c711, ctime: 0x6813c711, blocks: 0x7a1 00010000:00010000:2.0:1746126610.032404:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.032405:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.032412:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 20 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.032424:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 20 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.032432:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb200, rc 0) 00000100:00100000:2.0:1746126610.032451:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721333760:12345-192.168.203.2@tcp:101:cat.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.032456:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13227 00000100:00100000:1.0:1746126610.032530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.032579:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334016 00000100:00100000:2.0:1746126610.032583:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334016 00000100:00100000:2.0:1746126610.032599:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13228 00000100:00100000:2.0:1746126610.032603:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721334016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.032611:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126610.032704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126610.032751:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d515 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.032751:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721333888 00000100:00100000:0.0:1746126610.032754:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721333888 00002000:00010000:2.0:1746126610.032768:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c710, atime: 0x6813c710, ctime: 0x6813c710, blocks: 0x81f 00010000:00010000:2.0:1746126610.032778:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.032779:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.032783:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 17 pid: 4642 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126610.032784:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13229 00000100:00100000:0.0:1746126610.032789:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721333888:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.032795:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.032797:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 17 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.032803:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d50e expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.032804:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb400, rc 0) 00002000:00010000:0.0:1746126610.032814:0:23766:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c711, atime: 0x6813c711, ctime: 0x6813c711, blocks: 0x821 00010000:00010000:0.0:1746126610.032821:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.032822:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746126610.032823:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721334016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 219us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.032844:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13228 00010000:00010000:0.0:1746126610.032844:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.032854:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 17 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.032860:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34a00, rc 0) 00000100:00100000:2.0:1746126610.033287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.033312:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.033323:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721333888:12345-192.168.203.2@tcp:101:cat.0 Request processed in 533us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.033324:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334144 00000100:00100000:2.0:1746126610.033326:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334144 00000100:00100000:1.0:1746126610.033328:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13229 00000100:00100000:2.0:1746126610.033339:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334272 00000100:00100000:2.0:1746126610.033341:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334272 00000100:00100000:1.0:1746126610.033341:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13230 00000100:00100000:1.0:1746126610.033346:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721334144:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:2.0:1746126610.033351:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13231 00010000:00010000:1.0:1746126610.033352:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746126610.033354:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721334272:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.033359:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.033359:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d51c expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.033365:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d523 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126610.033371:0:23766:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c710, atime: 0x6813c710, ctime: 0x6813c710, blocks: 0x81d 00002000:00010000:2.0:1746126610.033373:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c711, atime: 0x6813c710, ctime: 0x6813c711, blocks: 0x163f 00010000:00010000:1.0:1746126610.033377:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.033379:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.033380:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.033383:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 23 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.033392:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 23 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.033399:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb800, rc 0) 00000100:00100000:2.0:1746126610.033416:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721334272:12345-192.168.203.2@tcp:101:cat.0 Request processed in 60us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.033420:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13231 00000100:00100000:2.0:1746126610.033461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.033473:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334400 00000100:00100000:2.0:1746126610.033476:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334400 00000100:00100000:2.0:1746126610.033495:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13232 00000100:00100000:2.0:1746126610.033499:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721334400:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.033505:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.033513:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d52a expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126610.033525:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c711, atime: 0x6813c711, ctime: 0x6813c711, blocks: 0x1029 00010000:00010000:2.0:1746126610.033532:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.033533:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.033537:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 18 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.033545:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 18 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.033550:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fbc00, rc 0) 00000100:00100000:2.0:1746126610.033564:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721334400:12345-192.168.203.2@tcp:101:cat.0 Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.033571:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13232 00010000:00010000:1.0:1746126610.034748:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.034754:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 22 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126610.034766:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 22 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126610.034774:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b239a00, rc 0) 00000100:00100000:1.0:1746126610.034812:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721334144:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1466us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.034817:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13230 00000100:00100000:0.0:1746126610.036290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.036385:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334656 00000100:00100000:2.0:1746126610.036392:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334656 00000100:00080000:1.0:1746126610.036537:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126610.036649:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8867 00000100:00100000:2.0:1746126610.036657:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31126:x1830945721334656:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:2.0:1746126610.036708:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.036734:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09da00/0xb50e825867612b48 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4dd expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037445:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.037451:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126610.037482:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.037495:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037805:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 16 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037812:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 231 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037819:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037825:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 231 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037852:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.037886:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 231 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.037897:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 231 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.037911:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323264:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.038267:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.038276:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.038285:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323392:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.038314:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 231 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.038321:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 231 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.038328:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323520:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.038350:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 16 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.038361:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 16 pid: 15560 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.038368:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323648:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.038390:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.038397:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746126610.038404:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e722d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323776:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.038418:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.040887:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323264:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.041268:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323392:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.041457:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323520:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.041465:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323648:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.041470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.041472:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e722d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721323776:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.041485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.041497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126610.041500:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126610.041526:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335296 00000100:00100000:0.0:1746126610.041531:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335296 00000100:00100000:2.0:1746126610.041539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126610.041573:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 17 pid: 15560 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.041595:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335168 00000100:00100000:0.0:1746126610.041598:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335168 00010000:00010000:0.0:1746126610.041607:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 18 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.041617:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334784 00000100:00100000:0.0:1746126610.041619:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334784 00010000:00010000:0.0:1746126610.041635:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 232 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.041643:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335040 00000100:00100000:0.0:1746126610.041645:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335040 00010000:00010000:0.0:1746126610.041651:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 233 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.041661:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6907 00000100:00100000:0.0:1746126610.041667:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721335296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.041679:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.041684:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 18 pid: 15560 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041697:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 18 pid: 15560 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041719:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612831 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2d0 expref: 18 pid: 15560 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041739:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.041743:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126610.041752:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.041791:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721335296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 124us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.041797:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6907 00000100:00100000:0.0:1746126610.041813:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6908 00000100:00100000:0.0:1746126610.041818:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721335168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.041824:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.041848:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041855:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041866:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3400/0xb50e82586761282a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2c2 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041876:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.041880:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126610.041885:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.041899:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721335168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 81us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.041904:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6908 00000100:00100000:0.0:1746126610.041914:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6909 00000100:00100000:0.0:1746126610.041919:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:1964:x1830945721334784:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.041925:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.041928:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 233 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041936:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 233 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041946:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f09d800/0xb50e825867612a29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d427 expref: 233 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746126610.041954:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.041957:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:2.0:1746126610.041959:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6910 00010000:00010000:0.0:1746126610.041962:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.041965:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:1964:x1830945721335040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.041971:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126610.041974:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:1964:x1830945721334784:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 55us (476us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126610.041975:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 232 pid: 20362 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746126610.041979:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6909 00010000:00010000:2.0:1746126610.041987:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 231 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126610.041997:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e82586761283f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d2de expref: 231 pid: 20362 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746126610.042007:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.042010:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.042014:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.042030:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1964:x1830945721335040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.042034:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6910 00000100:00080000:1.0:1746126610.042363:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126610.042478:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.042520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.042537:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335424 00000100:00100000:0.0:1746126610.042540:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335424 00000100:00100000:0.0:1746126610.042568:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8868 00000100:00100000:0.0:1746126610.042573:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31131:x1830945721335424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.042593:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126610.042629:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721334912 00000100:00100000:3.0:1746126610.042633:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721334912 00010000:00010000:3.0:1746126610.042647:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746126610.042662:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6911 00000100:00100000:3.0:1746126610.042667:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721334912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.042673:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.042676:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126610.042683:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126610.042698:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e8258676128e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d371 expref: 16 pid: 14548 timeout: 831 lvb_type: 0 00010000:00010000:3.0:1746126610.042712:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.042715:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126610.042722:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126610.042733:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126610.042749:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.042777:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721334912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 109us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.042783:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6911 00010000:00010000:0.0:1746126610.043142:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d531 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.043189:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126610.043197:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.043210:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126610.043219:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.043228:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.043231:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126610.043233:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.043239:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34200, rc 0) 00010000:00010000:3.0:1746126610.043386:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126610.043392:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126610.043654:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31131:x1830945721335424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1079us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.043660:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8868 00000040:00080000:3.0:1746126610.044260:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2603, 88 off220912 00000004:00080000:3.0:1746126610.044267:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958439554ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044313:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2714, 88 off230784 00000004:00080000:3.0:1746126610.044316:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958488998ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044361:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2715, 88 off230872 00000004:00080000:3.0:1746126610.044364:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958536645ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044373:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2604, 88 off221000 00000004:00080000:3.0:1746126610.044376:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958548254ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044381:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2605, 88 off221088 00000004:00080000:3.0:1746126610.044383:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958555287ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044387:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2716, 88 off230960 00000004:00080000:3.0:1746126610.044390:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958562134ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044397:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2717, 88 off231048 00000004:00080000:3.0:1746126610.044400:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958572407ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044432:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2607, 88 off221272 00000004:00080000:3.0:1746126610.044435:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958607445ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044442:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2718, 88 off231136 00000004:00080000:3.0:1746126610.044445:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958617332ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044455:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2608, 88 off221360 00000004:00080000:3.0:1746126610.044458:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958630708ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044464:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2719, 88 off231224 00000004:00080000:3.0:1746126610.044466:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958639052ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044476:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2609, 88 off221448 00000004:00080000:3.0:1746126610.044479:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958651275ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044485:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2720, 88 off231312 00000004:00080000:3.0:1746126610.044488:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958660378ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044497:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2610, 88 off221536 00000004:00080000:3.0:1746126610.044500:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958672483ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126610.044506:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2721, 88 off231400 00000004:00080000:3.0:1746126610.044508:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958681095ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044517:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2722, 88 off231488 00000004:00080000:3.0:1746126610.044520:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731958692570ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126610.044528:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2611, 88 off221624 00000004:00080000:3.0:1746126610.044530:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731958702672ns, next at 687927188999ns, rc = 0 00000001:00080000:0.0:1746126610.063673:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943023 is committed 00000004:00010000:2.0:1746126610.063686:0:20362:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009204ed80 reply state ffff880136a20800 transno 8589943028 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00000001:00080000:0.0:1746126610.063693:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943018 is committed 00000100:00100000:2.0:1746126610.063697:0:20362:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746126610.063703:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943013 is committed 00000001:00080000:0.0:1746126610.063718:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943027 is committed 00000001:00080000:0.0:1746126610.063724:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943026 is committed 00000001:00080000:0.0:1746126610.063726:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943024 is committed 00000001:00080000:0.0:1746126610.063741:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943028 is committed 00000004:00080000:0.0:1746126610.063753:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1996 committed 00000004:00080000:0.0:1746126610.063769:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2104 committed 00000004:00080000:0.0:1746126610.063774:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2103 committed 00000004:00080000:0.0:1746126610.063776:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1995 committed 00000004:00080000:0.0:1746126610.063777:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2102 committed 00000004:00080000:0.0:1746126610.063778:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746126610.063781:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2101 committed 00000004:00080000:0.0:1746126610.063783:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746126610.063785:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2100 committed 00000004:00080000:0.0:1746126610.063786:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746126610.063788:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2099 committed 00000004:00080000:0.0:1746126610.063789:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2098 committed 00000004:00080000:0.0:1746126610.063790:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746126610.063792:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746126610.063793:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2097 committed 00000004:00080000:0.0:1746126610.063794:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2096 committed 00000004:00080000:0.0:1746126610.063796:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1989 committed 00010000:00080000:2.0:1746126610.063804:0:20362:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746126610.063820:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721334656:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 27158us (27532us total) trans 8589943028 rc 0/0 00000100:00100000:2.0:1746126610.063847:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8867 00000100:00100000:3.0:1746126610.064442:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721323904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.064486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126610.064500:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.064509:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.064516:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.064522:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57fbe00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.064527:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.064533:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.064549:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.064552:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126610.064557:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.064568:0:3281:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.064575:0:3281:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.064601:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721323904 00010000:00010000:2.0:1746126610.064602:0:3281:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.064609:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721323904 00000100:00100000:2.0:1746126610.064611:0:3281:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721325952:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126610.064647:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13233 00000100:00100000:1.0:1746126610.064653:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721323904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.064722:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.064741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.064755:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.064768:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.064778:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721325440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.064790:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.064802:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746126610.064805:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.064817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.064849:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.064865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746126610.064909:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126610.064920:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324416 00000100:00100000:0.0:1746126610.064923:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324416 00000100:00100000:0.0:1746126610.064940:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324928 00000100:00100000:0.0:1746126610.064942:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324928 00000100:00100000:0.0:1746126610.064957:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325440 00000100:00100000:0.0:1746126610.064959:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325440 00000100:00100000:0.0:1746126610.064966:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324032 00000100:00100000:0.0:1746126610.064968:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324032 00000100:00100000:0.0:1746126610.064977:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324544 00000100:00100000:0.0:1746126610.064978:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324544 00000100:00100000:0.0:1746126610.064985:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13234 00000100:00100000:0.0:1746126610.064990:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721324416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126610.065154:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721324416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (411us total) trans 21474840288 rc 0/0 00000100:00100000:0.0:1746126610.065159:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13234 00000100:00100000:0.0:1746126610.065169:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13235 00000100:00100000:0.0:1746126610.065173:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3294:x1830945721324928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126610.065264:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126610.065267:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.065269:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.065271:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.065273:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126610.065286:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3294:x1830945721324928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (517us total) trans 17179873135 rc 0/0 00000100:00100000:0.0:1746126610.065290:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13235 00000100:00100000:0.0:1746126610.065297:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13236 00000100:00100000:0.0:1746126610.065300:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3294:x1830945721325440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126610.065352:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126610.065355:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126610.065356:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126610.065358:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126610.065360:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126610.065373:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3294:x1830945721325440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (581us total) trans 17179873136 rc 0/0 00000100:00100000:0.0:1746126610.065377:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13236 00000100:00100000:0.0:1746126610.065385:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13237 00000100:00100000:0.0:1746126610.065389:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721324032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126610.065419:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13238 00000100:00100000:2.0:1746126610.065426:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721324544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126610.065446:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126610.065448:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126610.065449:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126610.065451:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126610.065453:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746126610.065466:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721324032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (648us total) trans 21474840289 rc 0/0 00000100:00100000:0.0:1746126610.065470:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13237 00000100:00080000:0.0:1746126610.065484:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746126610.065522:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721325056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.065528:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721324544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (661us total) trans 21474840290 rc 0/0 00000100:00100000:2.0:1746126610.065533:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13238 00000100:00100000:3.0:1746126610.065545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.065564:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721325568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.065578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746126610.065692:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126610.065695:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126610.065697:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126610.065699:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126610.065701:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:1.0:1746126610.065723:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721323904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1071us (1237us total) trans 21474840291 rc 0/0 00000100:00100000:1.0:1746126610.065728:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13233 00000004:00080000:3.0:1746126610.065803:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11e300/2, rc 0, transno 21474840291 00000100:00100000:3.0:1746126610.065811:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721323904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126610.065817:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11fb80/2, rc 0, transno 21474840288 00000100:00100000:3.0:1746126610.065819:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324416:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126610.065842:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093230a80/2, rc 0, transno 17179873135 00000100:00100000:3.0:1746126610.065848:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126610.065853:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918ead80/2, rc 0, transno 17179873136 00000100:00100000:3.0:1746126610.065856:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721325440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126610.065863:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11c380/2, rc 0, transno 21474840289 00000100:00100000:3.0:1746126610.065865:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324032:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126610.065870:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11c000/2, rc 0, transno 21474840290 00000100:00100000:3.0:1746126610.065872:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721324544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.065886:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.065902:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.065970:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325056 00000100:00100000:1.0:1746126610.065974:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325056 00000100:00100000:1.0:1746126610.065988:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325568 00000100:00100000:1.0:1746126610.065990:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325568 00000100:00100000:1.0:1746126610.065999:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13239 00000100:00100000:1.0:1746126610.066002:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3294:x1830945721325056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126610.066079:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126610.066082:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126610.066088:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126610.066090:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126610.066091:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746126610.066123:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3294:x1830945721325056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (577us total) trans 17179873137 rc 0/0 00000100:00100000:1.0:1746126610.066128:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13239 00000100:00100000:1.0:1746126610.066138:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13240 00000100:00100000:1.0:1746126610.066142:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3294:x1830945721325568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126610.066215:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3294:x1830945721325568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (635us total) trans 17179873138 rc 0/0 00000100:00100000:1.0:1746126610.066220:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13240 00000100:00100000:2.0:1746126610.066311:0:3281:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.066320:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126610.066321:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324160 00000100:00100000:2.0:1746126610.066324:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324160 00000100:00100000:3.0:1746126610.066338:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.066338:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13241 00000100:00100000:2.0:1746126610.066343:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3296:x1830945721324160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.066348:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.066361:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.066370:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.066382:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.066393:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746126610.066398:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.066411:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.066417:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324800:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126610.066421:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:2.0:1746126610.066424:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.066426:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:2.0:1746126610.066427:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00000100:00100000:3.0:1746126610.066428:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746126610.066429:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:3.0:1746126610.066434:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.066449:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.066453:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3296:x1830945721324160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (550us total) trans 21474840292 rc 0/0 00000100:00100000:3.0:1746126610.066455:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.066458:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13241 00000100:00100000:3.0:1746126610.066466:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.066467:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324672 00000100:00100000:2.0:1746126610.066469:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324672 00000100:00100000:2.0:1746126610.066476:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325184 00000100:00100000:2.0:1746126610.066478:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325184 00000004:00080000:3.0:1746126610.066479:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11f800/2, rc 0, transno 21474840292 00000100:00100000:3.0:1746126610.066482:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126610.066483:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325696 00000100:00100000:2.0:1746126610.066485:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325696 00000100:00100000:2.0:1746126610.066490:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324288 00000100:00100000:2.0:1746126610.066492:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324288 00000100:00100000:2.0:1746126610.066498:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721324800 00000100:00100000:3.0:1746126610.066500:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325312 00000100:00100000:2.0:1746126610.066500:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721324800 00000100:00100000:3.0:1746126610.066503:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325312 00000100:00100000:2.0:1746126610.066505:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721325824 00000100:00100000:2.0:1746126610.066507:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721325824 00000100:00100000:2.0:1746126610.066517:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13242 00000100:00100000:2.0:1746126610.066520:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721324672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126610.066700:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721324672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (360us total) trans 21474840293 rc 0/0 00000100:00100000:3.0:1746126610.066740:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13243 00000100:00100000:3.0:1746126610.066746:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3296:x1830945721325184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126610.067092:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746126610.067095:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:3.0:1746126610.067097:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:3.0:1746126610.067098:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:3.0:1746126610.067100:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746126610.067132:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721325184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 386us (769us total) trans 17179873139 rc 0/0 00000100:00100000:3.0:1746126610.067138:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13243 00000100:00100000:3.0:1746126610.067148:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13244 00000100:00100000:3.0:1746126610.067152:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3296:x1830945721325696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126610.067323:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13245 00000100:00100000:1.0:1746126610.067331:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721324288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126610.067468:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13246 00000100:00100000:2.0:1746126610.067475:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13242 00000100:00100000:0.0:1746126610.067476:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721324800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126610.067488:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13247 00000100:00100000:2.0:1746126610.067494:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3296:x1830945721325312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.067965:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721325312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 471us (1514us total) trans 17179873140 rc 0/0 00000100:00100000:2.0:1746126610.067971:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13247 00000100:00100000:1.0:1746126610.067986:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13248 00000100:00100000:1.0:1746126610.067992:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3296:x1830945721325824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126610.068071:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721325824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1603us total) trans 17179873141 rc 0/0 00000100:00100000:1.0:1746126610.068076:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13248 00000100:00100000:3.0:1746126610.068373:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721325696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1219us (1989us total) trans 17179873142 rc 0/0 00000100:00100000:3.0:1746126610.068378:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13244 00000100:00100000:0.0:1746126610.068461:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3296:x1830945721324800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 986us (2031us total) trans 21474840294 rc 0/0 00000100:00100000:0.0:1746126610.068466:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13246 00000004:00080000:2.0:1746126610.068692:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad0a80/2, rc 0, transno 21474840294 00000100:00100000:2.0:1746126610.068698:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126610.068708:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093231c00/2, rc 0, transno 17179873140 00000100:00100000:2.0:1746126610.068712:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.068719:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e9180/2, rc 0, transno 17179873141 00000100:00100000:3.0:1746126610.068721:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746126610.068721:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325824:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.068728:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11ca80/2, rc 0, transno 21474840293 00000100:00100000:2.0:1746126610.068730:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.068732:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721326080:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.068737:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093232a00/2, rc 0, transno 17179873139 00000100:00100000:2.0:1746126610.068739:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.068745:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e9c00/2, rc 0, transno 17179873142 00000100:00100000:2.0:1746126610.068747:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721325696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126610.068950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.069078:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721324288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1748us (2666us total) trans 21474840295 rc 0/0 00000100:00100000:3.0:1746126610.069361:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746126610.069391:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093232680/2, rc 0, transno 17179873137 00000100:00100000:3.0:1746126610.069394:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721325056:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126610.069402:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8380/2, rc 0, transno 17179873138 00000100:00100000:3.0:1746126610.069405:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721325568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126610.069438:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13245 00000100:00100000:1.0:1746126610.069550:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326080 00000100:00100000:1.0:1746126610.069555:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326080 00000100:00100000:1.0:1746126610.069578:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13249 00000100:00100000:1.0:1746126610.069583:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830945721326080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126610.069692:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3295:x1830945721326080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (330us total) trans 17179873143 rc 0/0 00000100:00100000:1.0:1746126610.069697:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13249 00000100:00100000:2.0:1746126610.069770:0:3281:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721325952:192.168.203.2@tcp:105: 00000004:00080000:3.0:1746126610.069773:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df7100/2, rc 0, transno 17179873143 00000100:00100000:3.0:1746126610.069777:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721326080:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126610.069790:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.069797:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbe00/0xb50e825867612bd4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20362 initiator: MDT0 00000100:00100000:2.0:1746126610.069822:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335552 00000100:00100000:2.0:1746126610.069843:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335552 00000100:00100000:2.0:1746126610.069867:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8869 00000100:00100000:2.0:1746126610.069872:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31126:x1830945721335552:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126610.069887:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.069899:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d538 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.069951:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.069965:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.069981:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.069984:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126610.069986:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29200, rc 0) 00000100:00100000:3.0:1746126610.069990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.070018:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721335552:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 146us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.070023:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8869 00000100:00100000:2.0:1746126610.070039:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335680 00000100:00100000:2.0:1746126610.070042:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335680 00000100:00100000:2.0:1746126610.070057:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3729 00000100:00100000:2.0:1746126610.070062:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31131:x1830945721335680:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:2.0:1746126610.070133:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31131:x1830945721335680:12345-192.168.203.2@tcp:49:cat.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.070142:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3729 00000004:00080000:2.0:1746126610.070182:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11d880/2, rc 0, transno 21474840295 00000100:00100000:2.0:1746126610.070186:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721324288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126610.071755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.071900:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335808 00000100:00100000:2.0:1746126610.071906:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335808 00000100:00100000:2.0:1746126610.072235:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8870 00000100:00100000:2.0:1746126610.072243:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721335808:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126610.072259:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.072277:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867612be9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d53f expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.072347:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612bf0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.072359:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.072369:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126610.072395:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126610.072398:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126610.072412:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126610.072434:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867612be9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d53f expref: 10 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.072447:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d53f expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.072454:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.072457:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126610.072459:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28800, rc 0) 00000100:00100000:2.0:1746126610.072510:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31126:x1830945721335808:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 269us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.072515:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8870 00000100:00100000:0.0:1746126610.074037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.074132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.074159:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.074173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.074185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.074237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.074258:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721335936 00000100:00100000:0.0:1746126610.074265:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721335936 00000100:00100000:0.0:1746126610.074293:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721336192 00000100:00100000:0.0:1746126610.074295:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721336192 00000100:00100000:0.0:1746126610.074319:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721336448 00000100:00100000:0.0:1746126610.074321:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721336448 00000100:00100000:0.0:1746126610.074333:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721336064 00000100:00100000:0.0:1746126610.074334:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721336064 00000100:00100000:0.0:1746126610.074343:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721336320 00000100:00100000:0.0:1746126610.074344:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721336320 00000100:00100000:0.0:1746126610.074352:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721336576 00000100:00100000:0.0:1746126610.074353:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721336576 00000100:00100000:0.0:1746126610.074364:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13250 00000100:00100000:0.0:1746126610.074370:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721335936:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126610.074384:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.074400:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d546 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.074418:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074420:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074427:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074439:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074449:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd4400, rc 0) 00000100:00100000:0.0:1746126610.074478:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721335936:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 108us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.074482:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13250 00000100:00100000:0.0:1746126610.074497:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13251 00000100:00100000:0.0:1746126610.074502:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721336192:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126610.074508:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.074517:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d554 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.074527:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074528:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074531:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074540:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074546:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb000, rc 0) 00000100:00100000:0.0:1746126610.074560:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721336192:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 58us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.074565:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13251 00000100:00100000:0.0:1746126610.074573:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13252 00000100:00100000:0.0:1746126610.074577:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721336448:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126610.074582:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.074588:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d562 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.074596:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074597:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074600:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074612:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074618:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fba00, rc 0) 00000100:00100000:0.0:1746126610.074630:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721336448:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.074634:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13252 00000100:00100000:0.0:1746126610.074643:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13253 00000100:00100000:0.0:1746126610.074646:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721336064:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126610.074650:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.074656:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d54d expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.074664:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074665:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074667:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074674:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074680:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb600, rc 0) 00000100:00100000:0.0:1746126610.074690:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721336064:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.074694:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13253 00000100:00100000:0.0:1746126610.074705:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13254 00000100:00100000:0.0:1746126610.074709:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721336320:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126610.074713:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.074718:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d55b expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.074726:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074728:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074731:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074738:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074745:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb19000, rc 0) 00000100:00100000:0.0:1746126610.074757:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721336320:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 48us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.074761:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13254 00000100:00100000:0.0:1746126610.074768:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13255 00000100:00100000:0.0:1746126610.074772:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721336576:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126610.074776:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.074782:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d569 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.074789:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074791:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.074794:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074802:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.074808:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878c00, rc 0) 00000100:00100000:0.0:1746126610.074819:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721336576:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 48us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.074823:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13255 00000100:00100000:0.0:1746126610.085383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.085488:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721337088 00000100:00100000:2.0:1746126610.085499:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721337088 00002000:00100000:2.0:1746126610.085549:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009204fb80 x1830945721337088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.085559:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204fb80 with x1830945721337088 ext(1048576->2097151) 00002000:00010000:2.0:1746126610.085565:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204fb80 00000100:00100000:2.0:1746126610.085599:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7548 00000100:00100000:2.0:1746126610.085606:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721337088:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.097619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.097656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.097681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.097709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.097721:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721336960 00000100:00100000:1.0:1746126610.097731:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721336960 00002000:00100000:1.0:1746126610.097776:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009204f480 x1830945721336960/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.097787:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f480 with x1830945721336960 ext(1048576->2097151) 00002000:00010000:1.0:1746126610.097793:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204f480 00000100:00100000:2.0:1746126610.098098:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721337344 00000100:00100000:2.0:1746126610.098111:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721337344 00002000:00100000:2.0:1746126610.098131:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008dab9c00 x1830945721337344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746126610.098131:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721337472 00000100:00100000:1.0:1746126610.098134:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721337472 00002000:00100000:2.0:1746126610.098138:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9c00 with x1830945721337344 ext(0->1048575) 00002000:00010000:2.0:1746126610.098142:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9c00 00002000:00100000:1.0:1746126610.098144:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008dabaa00 x1830945721337472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126610.098152:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721338112 00000100:00100000:2.0:1746126610.098154:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721338112 00002000:00100000:1.0:1746126610.098156:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabaa00 with x1830945721337472 ext(1048576->2097151) 00002000:00010000:1.0:1746126610.098159:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabaa00 00000100:00100000:2.0:1746126610.098169:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7549 00000100:00100000:2.0:1746126610.098175:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721336960:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126610.098210:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7550 00000100:00100000:1.0:1746126610.098224:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721337344:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.098704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.098801:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721338368 00000100:00100000:0.0:1746126610.098804:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721338368 00000100:00100000:0.0:1746126610.098821:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721338880 00000100:00100000:0.0:1746126610.098823:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721338880 00000100:00100000:0.0:1746126610.098845:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721337984 00000100:00100000:0.0:1746126610.098847:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721337984 00000100:00100000:0.0:1746126610.098854:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721339008 00000100:00100000:0.0:1746126610.098856:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721339008 00000100:00100000:0.0:1746126610.098863:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721338240 00000100:00100000:0.0:1746126610.098865:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721338240 00000100:00100000:0.0:1746126610.098871:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721338496 00000100:00100000:0.0:1746126610.098873:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721338496 00000100:00100000:0.0:1746126610.098880:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721338624 00000100:00100000:0.0:1746126610.098881:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721338624 00000100:00100000:0.0:1746126610.098890:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7551 00000100:00100000:0.0:1746126610.098893:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721338112:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126610.098916:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.098929:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.098931:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.098936:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.098949:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.099925:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7552 00000100:00100000:2.0:1746126610.099933:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721337472:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.101222:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7553 00000100:00100000:2.0:1746126610.101230:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721338368:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126610.101260:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.101272:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.101274:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.101278:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.101293:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.101761:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7554 00000100:00100000:3.0:1746126610.101771:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721338880:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126610.101788:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.101795:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.101796:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.101799:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.101806:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.103341:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7555 00000100:00100000:3.0:1746126610.103352:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1964:x1830945721337984:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126610.103388:0:21461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.103398:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.103400:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.103403:0:21461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.103413:0:21461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.105726:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7556 00000100:00100000:1.0:1746126610.105738:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721339008:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126610.105773:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.105785:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.105787:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.105792:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.105804:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.105882:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7557 00000100:00100000:2.0:1746126610.105890:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945721338240:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126610.105908:0:21464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.105915:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.105916:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.105919:0:21464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.105926:0:21464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.107100:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1830945721326336:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107159:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.107206:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830945721326848:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107228:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.107245:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126610.107249:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721326464:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107263:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.107287:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326336 00000100:00100000:1.0:1746126610.107293:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326336 00000100:00100000:1.0:1746126610.107325:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326848 00000100:00100000:1.0:1746126610.107327:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326848 00000100:00100000:1.0:1746126610.107336:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326464 00000100:00100000:1.0:1746126610.107337:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326464 00000100:00100000:1.0:1746126610.107348:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1746126610.107353:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830945721326336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107384:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830945721326336:12345-0@lo:400:kworker.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.107390:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1746126610.107403:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746126610.107406:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830945721326848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107421:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830945721326848:12345-0@lo:400:kworker.0 Request processed in 14us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.107425:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746126610.107431:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1746126610.107434:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721326464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107447:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721326464:12345-0@lo:400:kworker.0 Request processed in 13us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.107451:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1746126610.107480:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721326464:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107487:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1830945721326336:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107493:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830945721326848:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107510:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721326592:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.107550:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126610.107554:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721326208:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.107587:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721326720:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.107615:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326208 00000100:00100000:1.0:1746126610.107618:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326208 00000100:00100000:1.0:1746126610.107634:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1746126610.107638:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3294:x1830945721326208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107657:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3294:x1830945721326208:12345-0@lo:400:kworker.0 Request processed in 19us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.107661:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1746126610.107678:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326592 00000100:00100000:1.0:1746126610.107680:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326592 00000100:00100000:1.0:1746126610.107693:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326720 00000100:00100000:1.0:1746126610.107694:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326720 00000100:00100000:1.0:1746126610.107704:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1746126610.107708:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3294:x1830945721326592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107725:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3294:x1830945721326592:12345-0@lo:400:kworker.0 Request processed in 17us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.107730:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1746126610.107736:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1746126610.107739:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3294:x1830945721326720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107754:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3294:x1830945721326720:12345-0@lo:400:kworker.0 Request processed in 14us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.107761:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1746126610.107775:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721326208:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107783:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721326720:0@lo:400:kworker.0 00000100:00100000:1.0:1746126610.107789:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721326592:0@lo:400:kworker.0 00000100:00100000:0.0:1746126610.120467:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746126610.120492:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721326976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746126610.120550:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.120669:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721326976 00000100:00100000:3.0:1746126610.120678:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721326976 00000100:00100000:3.0:1746126610.120721:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1746126610.120728:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3296:x1830945721326976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746126610.120771:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 545587200 pending 18743296 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746126610.120811:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3296:x1830945721326976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.120817:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1746126610.121094:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721337088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35486us (35719us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.121102:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7548 00002000:00100000:3.0:1746126610.121122:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009204fb80 x1830945721337088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.121131:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204fb80 with x1830945721337088 ext(1048576->2097151) 00002000:00010000:3.0:1746126610.121137:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204fb80 00000100:00100000:3.0:1746126610.121151:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7558 00000100:00100000:3.0:1746126610.121157:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1964:x1830945721338496:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126610.121182:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.121195:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.121197:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.121203:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.121219:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.122559:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721326976:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1746126610.125029:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126610.125345:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721336960:12345-192.168.203.2@tcp:3:cat.0 Request processed in 27163us (27730us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.125356:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7549 00002000:00100000:2.0:1746126610.125365:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009204f480 x1830945721336960/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.125374:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f480 with x1830945721336960 ext(1048576->2097151) 00002000:00010000:2.0:1746126610.125379:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204f480 00000100:00100000:2.0:1746126610.125406:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7559 00000100:00100000:2.0:1746126610.125415:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945721338624:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126610.125445:0:21198:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.125458:0:21198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.125459:0:21198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.125463:0:21198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.125475:0:21198:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.126924:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721327104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746126610.126972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126610.129007:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721327104 00000100:00100000:0.0:1746126610.129021:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721327104 00000100:00100000:0.0:1746126610.129947:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1746126610.129958:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3294:x1830945721327104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746126610.129987:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 523567104 pending 18743296 free 3847225344 avail 3845128192 00000100:00100000:0.0:1746126610.130055:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3294:x1830945721327104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (3082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.130061:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:0.0:1746126610.130316:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.130329:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.130337:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.130345:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e4ab200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126610.130350:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.130358:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.130376:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.130383:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e4ab200/0xb50e825867612c21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.130458:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721327104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746126610.131972:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1964:x1830945721338112:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 33066us (34250us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.131982:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7551 00000100:00100000:2.0:1746126610.148624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.150510:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721337472:12345-192.168.203.2@tcp:3:cat.0 Request processed in 50565us (52814us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.150522:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7552 00002000:00100000:2.0:1746126610.150534:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008dabaa00 x1830945721337472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.150544:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabaa00 with x1830945721337472 ext(1048576->2097151) 00002000:00010000:2.0:1746126610.150550:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabaa00 00010000:00010000:3.0:1746126610.151807:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.151820:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.151854:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.151860:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a35c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126610.151864:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.151872:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.151891:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.151896:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612c2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.151950:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945721338880:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 50179us (53226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.151960:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7554 00000100:00100000:1.0:1746126610.152260:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721339392 00000100:00100000:1.0:1746126610.152270:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721339392 00000100:00100000:1.0:1746126610.152307:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8871 00000100:00100000:1.0:1746126610.152314:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31133:x1830945721339392:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126610.152330:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.152346:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d570 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.152448:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152461:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152472:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152484:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152488:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152492:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152590:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152599:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.152606:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.152633:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.152645:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 8 pid: 20362 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.152656:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327232:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.152718:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.153055:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721337344:12345-192.168.203.2@tcp:3:cat.0 Request processed in 54830us (55396us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126610.153063:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7550 00002000:00100000:0.0:1746126610.153070:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008dab9c00 x1830945721337344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.153078:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9c00 with x1830945721337344 ext(0->1048575) 00002000:00010000:0.0:1746126610.153082:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9c00 00000100:00100000:1.0:1746126610.160877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.160945:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721339648 00000100:00100000:2.0:1746126610.160952:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721339648 00000100:00100000:1.0:1746126610.160966:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327232:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.160989:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126610.160994:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8872 00000100:00100000:2.0:1746126610.161000:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+221:31135:x1830945721339648:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126610.161023:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.161040:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093694000/0xb50e825867612c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d577 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.161159:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161171:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161181:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161190:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161195:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161201:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161307:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161317:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.161324:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126610.164032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.164773:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721339776 00000100:00100000:1.0:1746126610.164785:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721339776 00010000:00010000:1.0:1746126610.164822:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 9 pid: 20362 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.164889:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6912 00000100:00100000:1.0:1746126610.164896:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721339776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.164909:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.164914:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 9 pid: 20362 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.164925:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 9 pid: 20362 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.164947:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4878400/0xb50e825867612b6b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d4f9 expref: 9 pid: 20362 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.164963:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126610.164968:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.164977:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.164982:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.164989:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.164997:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.165000:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.165021:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.165068:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721339776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 173us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.165074:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6912 00010000:00010000:2.0:1746126610.165148:0:21462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165158:0:21462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165165:0:21462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165172:0:21462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c29000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126610.165176:0:21462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165185:0:21462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165198:0:21462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165203:0:21462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867612c28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.165246:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126610.165258:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721338368:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 64029us (66554us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.165267:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7553 00010000:00010000:2.0:1746126610.165301:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165307:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126610.165326:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126610.165369:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126610.165379:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126610.165510:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165516:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165520:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165524:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec78e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.165527:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165532:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165539:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.165542:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126610.165544:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165548:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78e00/0xb50e825867612c8a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165562:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165567:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165572:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165576:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec78a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.165578:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165582:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165587:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126610.165588:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.165590:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165594:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec78a00/0xb50e825867612c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165601:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165606:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165610:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165614:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec79200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.165615:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165623:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165628:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8100) 00010000:00010000:2.0:1746126610.165630:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.165632:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165637:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec79200/0xb50e825867612c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.165676:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093694000/0xb50e825867612c75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d577 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165682:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093694000/0xb50e825867612c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d577 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.165690:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093694000, rc 0) 00000100:00100000:2.0:1746126610.165711:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:31135:x1830945721339648:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4711us (4844us total) trans 8589943029 rc 301/301 00000100:00100000:2.0:1746126610.165717:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8872 00010000:00010000:0.0:1746126610.165789:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165794:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165798:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165804:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b238800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126610.165806:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165810:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165818:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.165820:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126610.165822:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165863:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238800/0xb50e825867612c6e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165881:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165885:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165890:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165894:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b239000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126610.165896:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165900:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165906:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126610.165907:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126610.165909:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165913:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239000/0xb50e825867612c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165920:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165924:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165929:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165932:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b239600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126610.165934:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165939:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165943:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8100) 00010000:00010000:0.0:1746126610.165945:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126610.165946:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165949:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612c67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.165985:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612c59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d570 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.165990:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d570 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.165996:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b239e00, rc 0) 00000100:00100000:0.0:1746126610.166012:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31133:x1830945721339392:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 13700us (17402us total) trans 8589943030 rc 301/301 00000100:00100000:0.0:1746126610.166017:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8871 00010000:00010000:1.0:1746126610.173405:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.173422:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.173430:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.173437:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b239400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126610.173442:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.173449:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.173468:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.173478:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b239400/0xb50e825867612c3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.174507:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721339008:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 68764us (75751us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.174518:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7556 00010000:00010000:3.0:1746126610.183067:0:21464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.183083:0:21464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.183090:0:21464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.183096:0:21464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c29800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126610.183099:0:21464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.183116:0:21464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.183132:0:21464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.183138:0:21464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29800/0xb50e825867612c44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.183227:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1964:x1830945721338240:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 77334us (84466us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.183236:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7557 00010000:00010000:3.0:1746126610.193303:0:21461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.193319:0:21461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193323:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.193327:0:21461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.193333:0:21461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a35a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126610.193336:0:21461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193337:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.193343:0:21461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193344:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193354:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a34800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126610.193357:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.193358:0:21461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.193364:0:21461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a35a00/0xb50e825867612c36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193364:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193379:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.193385:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a34800/0xb50e825867612c4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.193454:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721337984:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 90101us (94716us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.193464:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7555 00000100:00100000:2.0:1746126610.193496:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721338496:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 72334us (94726us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.193505:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7558 00000100:00100000:0.0:1746126610.194237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.195982:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721340288 00000100:00100000:2.0:1746126610.195995:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721340288 00002000:00100000:2.0:1746126610.196044:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880135bcf480 x1830945721340288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.196053:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf480 with x1830945721340288 ext(2097152->3145727) 00002000:00010000:2.0:1746126610.196059:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcf480 00000100:00100000:2.0:1746126610.196296:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7560 00000100:00100000:2.0:1746126610.196305:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721340288:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.201261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.201703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.202359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.202372:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721340032 00000100:00100000:3.0:1746126610.202382:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721340032 00002000:00100000:3.0:1746126610.202423:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880135bced80 x1830945721340032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.202439:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bced80 with x1830945721340032 ext(2097152->3145727) 00002000:00010000:3.0:1746126610.202444:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bced80 00000100:00100000:3.0:1746126610.202469:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721340544 00000100:00100000:3.0:1746126610.202471:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721340544 00002000:00100000:3.0:1746126610.202479:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135bcc000 x1830945721340544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.202484:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc000 with x1830945721340544 ext(3145728->4194303) 00002000:00010000:3.0:1746126610.202486:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcc000 00000100:00100000:3.0:1746126610.202496:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7561 00000100:00100000:3.0:1746126610.202503:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721340032:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126610.204713:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7562 00000100:00100000:1.0:1746126610.204726:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721340544:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.206898:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721340800 00000100:00100000:2.0:1746126610.206912:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721340800 00002000:00100000:2.0:1746126610.206957:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a4f56300 x1830945721340800/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.206967:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56300 with x1830945721340800 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.206973:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f56300 00000100:00100000:2.0:1746126610.206989:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7563 00000100:00100000:2.0:1746126610.206996:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721340800:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:3.0:1746126610.208871:0:21198:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.208885:0:21198:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.208892:0:21198:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.208898:0:21198:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093694e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126610.208901:0:21198:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.208908:0:21198:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.208928:0:21198:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.208933:0:21198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093694e00/0xb50e825867612c52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.209019:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721338624:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 83602us (110228us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.209028:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7559 00000100:00100000:2.0:1746126610.217137:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721340288:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20822us (22892us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.217149:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7560 00002000:00100000:2.0:1746126610.217161:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880135bcf480 x1830945721340288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.217170:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf480 with x1830945721340288 ext(2097152->3145727) 00002000:00010000:2.0:1746126610.217177:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcf480 00000100:00100000:0.0:1746126610.220010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.220091:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721341056 00000100:00100000:2.0:1746126610.220101:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721341056 00000100:00100000:2.0:1746126610.220155:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8873 00000100:00100000:2.0:1746126610.220163:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31138:x1830945721341056:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.220187:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.220206:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2800/0xb50e825867612c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d57e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.220328:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220343:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220356:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220371:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220376:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220382:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220506:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220516:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220522:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126610.220533:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126610.220622:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220630:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220637:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220642:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800997d2e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.220646:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220653:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220665:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.220668:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126610.220672:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220677:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2e00/0xb50e825867612cb4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220728:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220734:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220739:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220742:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800997d2a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.220745:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220749:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220756:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126610.220757:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.220760:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220764:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2a00/0xb50e825867612ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220773:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220778:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220782:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220785:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800997d2c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.220788:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220792:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220798:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec44f00) 00010000:00010000:2.0:1746126610.220800:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.220802:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220806:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2c00/0xb50e825867612cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.220883:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2800/0xb50e825867612c9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d57e expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.220891:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2800/0xb50e825867612c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d57e expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.220899:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d2800, rc 0) 00000100:00100000:2.0:1746126610.223485:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31138:x1830945721341056:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3309us (3473us total) trans 8589943031 rc 301/301 00000100:00100000:2.0:1746126610.223496:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8873 00000100:00100000:3.0:1746126610.228278:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721340032:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25765us (27018us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.228291:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7561 00002000:00100000:3.0:1746126610.228304:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880135bced80 x1830945721340032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.228312:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bced80 with x1830945721340032 ext(2097152->3145727) 00002000:00010000:3.0:1746126610.228318:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bced80 00000100:00100000:1.0:1746126610.235289:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721340544:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30558us (33578us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.235298:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7562 00002000:00100000:1.0:1746126610.235307:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135bcc000 x1830945721340544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.235314:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc000 with x1830945721340544 ext(3145728->4194303) 00002000:00010000:1.0:1746126610.235319:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcc000 00000100:00100000:2.0:1746126610.242002:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721340800:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34992us (39630us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.242016:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7563 00002000:00100000:2.0:1746126610.242028:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a4f56300 x1830945721340800/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.242038:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56300 with x1830945721340800 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.242044:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f56300 00000100:00100000:0.0:1746126610.242791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.242902:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721341312 00000100:00100000:2.0:1746126610.242910:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721341312 00000100:00100000:2.0:1746126610.242941:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3730 00000100:00100000:2.0:1746126610.242947:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:31138:x1830945721341312:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126610.243368:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31138:x1830945721341312:12345-192.168.203.2@tcp:35:cat.0 Request processed in 420us (581us total) trans 8589943032 rc 0/0 00000100:00100000:2.0:1746126610.243374:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3730 00000100:00100000:0.0:1746126610.247629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.247686:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721341440 00000100:00100000:2.0:1746126610.247698:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721341440 00000100:00100000:2.0:1746126610.247751:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8874 00000100:00100000:2.0:1746126610.247757:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31138:x1830945721341440:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.247775:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.247790:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2600/0xb50e825867612cc2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d585 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.247867:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.247878:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.247886:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126610.247904:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126610.247907:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126610.247918:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.247938:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2600/0xb50e825867612cc2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.247965:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.247972:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.247974:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126610.247977:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3000, rc 0) 00000100:00100000:2.0:1746126610.248033:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31138:x1830945721341440:12345-192.168.203.2@tcp:101:cat.0 Request processed in 275us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.248039:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8874 00000100:00100000:1.0:1746126610.248197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.248366:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721341696 00000100:00100000:0.0:1746126610.248375:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721341696 00000100:00100000:0.0:1746126610.248425:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8875 00000100:00100000:0.0:1746126610.248433:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721341696:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1746126610.248477:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.248500:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612bf0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d53f expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.248530:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.248534:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126610.248565:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.248575:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.248581:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.248613:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.248625:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 224 pid: 14548 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746126610.248636:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721327360:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.248727:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008da09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.250308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.250342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.250365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.250379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.250399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.250438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.250494:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721341952 00000100:00100000:1.0:1746126610.250503:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721341952 00000100:00100000:2.0:1746126610.250551:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342208 00000100:00100000:2.0:1746126610.250555:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342208 00000100:00100000:2.0:1746126610.250578:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13256 00000100:00100000:2.0:1746126610.250584:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721341952:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.250599:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.250613:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d593 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.250633:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250635:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250642:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 30 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.250655:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 30 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.250664:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3400, rc 0) 00000100:00100000:2.0:1746126610.250703:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721341952:12345-192.168.203.2@tcp:101:cat.0 Request processed in 119us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.250709:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13256 00000100:00100000:2.0:1746126610.250721:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342464 00000100:00100000:2.0:1746126610.250724:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342464 00000100:00100000:2.0:1746126610.250746:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721341824 00000100:00100000:2.0:1746126610.250749:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721341824 00000100:00100000:2.0:1746126610.250758:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342080 00000100:00100000:2.0:1746126610.250760:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342080 00000100:00100000:2.0:1746126610.250769:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342336 00000100:00100000:2.0:1746126610.250770:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342336 00000100:00100000:2.0:1746126610.250778:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13257 00000100:00100000:2.0:1746126610.250783:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721342208:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.250790:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126610.250791:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13258 00010000:00010000:2.0:1746126610.250798:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5a1 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.250801:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721342464:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.250810:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250812:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.250815:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.250816:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.250823:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.250854:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5af expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.250856:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3e00, rc 0) 00000100:00100000:2.0:1746126610.250873:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721342208:12345-192.168.203.2@tcp:101:cat.0 Request processed in 89us (530us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126610.250873:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.250875:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746126610.250878:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13257 00010000:00010000:0.0:1746126610.250882:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126610.250889:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13259 00000100:00100000:2.0:1746126610.250894:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721341824:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.250894:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.250899:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.250902:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933efc00, rc 0) 00010000:00010000:2.0:1746126610.250905:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d58c expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.250914:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250915:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250919:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.250927:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126610.250931:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721342464:12345-192.168.203.2@tcp:101:cat.0 Request processed in 133us (564us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126610.250933:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3200, rc 0) 00000100:00100000:0.0:1746126610.250937:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13258 00000100:00100000:2.0:1746126610.250949:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721341824:12345-192.168.203.2@tcp:101:cat.0 Request processed in 55us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.250954:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13260 00000100:00100000:2.0:1746126610.250958:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13259 00000100:00100000:0.0:1746126610.250959:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721342080:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.250966:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746126610.250968:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13261 00000100:00100000:2.0:1746126610.250972:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721342336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.250973:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d59a expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.250977:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.250982:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5a8 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.250984:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.250985:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250989:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.250989:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.250990:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.250994:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.250997:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.251001:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126610.251004:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933efa00, rc 0) 00010000:00010000:2.0:1746126610.251008:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3800, rc 0) 00000100:00100000:0.0:1746126610.251021:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721342080:12345-192.168.203.2@tcp:101:cat.0 Request processed in 62us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.251024:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721342336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.251027:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13260 00000100:00100000:2.0:1746126610.251723:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13261 00000100:00100000:1.0:1746126610.253798:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721327360:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.253820:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126610.254330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.254379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.254383:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342592 00000100:00100000:2.0:1746126610.254429:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342848 00000100:00100000:2.0:1746126610.254434:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342848 00000100:00100000:2.0:1746126610.254468:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8876 00000100:00100000:2.0:1746126610.254474:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31133:x1830945721342848:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126610.254490:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.254492:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126610.254510:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a34200/0xb50e825867612bdb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d531 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.254527:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.254530:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.254537:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126610.254545:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2600/0xb50e825867612d01 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5b6 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.254582:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.254589:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.254594:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.254598:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126610.254609:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.254627:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.254636:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 7 pid: 20362 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.254646:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327488:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.254720:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d5e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.254921:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342592 00010000:00010000:3.0:1746126610.254940:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 225 pid: 14548 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746126610.255653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.255674:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721342976 00000100:00100000:0.0:1746126610.255680:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721342976 00000100:00100000:0.0:1746126610.255713:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8877 00000100:00100000:0.0:1746126610.255719:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:31138:x1830945721342976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.255733:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.255748:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5bd expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.255792:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6913 00010000:00010000:0.0:1746126610.255796:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126610.255800:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:1963:x1830945721342592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.255804:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 227 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.255809:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.255814:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 227 pid: 14548 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.255818:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.255823:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 227 pid: 14548 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.256822:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 227 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.256851:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.256853:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126610.256856:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126610.256862:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933ef600, rc 0) 00000100:00100000:0.0:1746126610.256905:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:31138:x1830945721342976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1186us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.256912:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8877 00000100:00100000:2.0:1746126610.257134:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327488:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.257152:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126610.257190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126610.257224:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612cc9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d585 expref: 226 pid: 14548 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.257247:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:0.0:1746126610.257249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126610.257251:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.257258:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.257264:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.257271:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.257276:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.257293:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.257333:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:1963:x1830945721342592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1533us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.257340:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6913 00000100:00100000:3.0:1746126610.257356:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721343104 00000100:00100000:3.0:1746126610.257361:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721343104 00010000:00010000:3.0:1746126610.257373:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 8 pid: 20362 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.257391:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6914 00000100:00100000:3.0:1746126610.257396:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721343104:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.257403:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.257407:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 8 pid: 20362 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.257415:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 8 pid: 20362 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.257425:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29200/0xb50e825867612be2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d538 expref: 8 pid: 20362 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.257433:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.257436:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.257446:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.257450:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126610.257465:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126610.257466:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721343104:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.257470:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6914 00010000:00010000:0.0:1746126610.257472:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00000100:00100000:2.0:1746126610.257486:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721343360 00000100:00100000:2.0:1746126610.257490:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721343360 00002000:00100000:2.0:1746126610.257521:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e3f4e00 x1830945721343360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.257529:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4e00 with x1830945721343360 ext(4194304->4976639) 00002000:00010000:2.0:1746126610.257533:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4e00 00000100:00100000:2.0:1746126610.257554:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7564 00000100:00100000:2.0:1746126610.257559:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721343360:12345-192.168.203.2@tcp:3:multiop.0 00000004:00010000:0.0:1746126610.257635:0:15560:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880131d55f80 reply state ffff8800920b2000 transno 8589943033 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126610.257641:0:15560:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746126610.258806:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721341696:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 10371us (10606us total) trans 8589943033 rc 0/0 00000100:00100000:3.0:1746126610.258812:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8875 00000100:00100000:0.0:1746126610.264915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126610.265207:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.265224:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.265230:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.265235:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58d1200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126610.265239:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.265246:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126610.265263:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126610.265266:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126610.265269:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126610.265271:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721343488 00010000:00010000:1.0:1746126610.265277:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126610.265279:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721343488 00010000:00010000:1.0:1746126610.265283:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126610.265293:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.265314:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8878 00010000:00010000:1.0:1746126610.265318:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126610.265320:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721343488:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126610.265323:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612cd0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.265340:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.265353:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5c4 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.265395:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.265403:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.265403:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.265413:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.265422:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.265424:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126610.265427:0:15560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.265432:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bf200, rc 0) 00000100:00100000:3.0:1746126610.265467:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721343488:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 147us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.265472:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8878 00000100:00100000:3.0:1746126610.266496:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721343360:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 8931us (9241us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126610.266506:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7564 00002000:00100000:3.0:1746126610.266516:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e3f4e00 x1830945721343360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 782336/782336 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.266529:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4e00 with x1830945721343360 ext(4194304->4976639) 00002000:00010000:3.0:1746126610.266534:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4e00 00000040:00080000:2.0:1746126610.267453:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2612, 88 off221712 00000004:00080000:2.0:1746126610.267460:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181631966ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267518:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2723, 88 off231576 00000004:00080000:2.0:1746126610.267521:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181693820ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267546:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2724, 88 off231664 00000004:00080000:2.0:1746126610.267549:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181721928ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267557:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2613, 88 off221800 00000004:00080000:2.0:1746126610.267559:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181731581ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267566:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2614, 88 off221888 00000004:00080000:2.0:1746126610.267568:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181740927ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267574:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2725, 88 off231752 00000004:00080000:2.0:1746126610.267577:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181749368ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267583:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2726, 88 off231840 00000004:00080000:2.0:1746126610.267585:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181757502ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267592:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2615, 88 off221976 00000004:00080000:2.0:1746126610.267594:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181766546ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267600:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2727, 88 off231928 00000004:00080000:2.0:1746126610.267602:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181774726ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267608:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2616, 88 off222064 00000004:00080000:2.0:1746126610.267610:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181782811ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267616:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2728, 88 off232016 00000004:00080000:2.0:1746126610.267619:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181791107ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267624:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2617, 88 off222152 00000004:00080000:2.0:1746126610.267628:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181800378ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267634:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2729, 88 off232104 00000004:00080000:2.0:1746126610.267637:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181809342ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267643:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2618, 88 off222240 00000004:00080000:2.0:1746126610.267645:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181817540ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126610.267650:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2730, 88 off232192 00000004:00080000:2.0:1746126610.267653:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181825171ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267658:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2731, 88 off232280 00000004:00080000:2.0:1746126610.267661:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732181833517ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126610.267667:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2619, 88 off222328 00000004:00080000:2.0:1746126610.267669:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732181841717ns, next at 687927188999ns, rc = 0 00000100:00100000:1.0:1746126610.270709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.270845:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721343616 00000100:00100000:3.0:1746126610.270854:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721343616 00000100:00100000:3.0:1746126610.270897:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8879 00000100:00100000:3.0:1746126610.270904:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31131:x1830945721343616:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.270925:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.270945:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5cb expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.271001:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.271012:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.271024:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.271026:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126610.271031:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.271037:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bfa00, rc 0) 00000100:00100000:3.0:1746126610.271081:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31131:x1830945721343616:12345-192.168.203.2@tcp:101:cat.0 Request processed in 178us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.271087:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8879 00010000:00010000:3.0:1746126610.295451:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295463:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.295465:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746126610.295470:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295478:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295484:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295490:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295495:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295500:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295506:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295511:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295516:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.295549:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.295560:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327616:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126610.295645:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.295652:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327744:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126610.295673:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.295679:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327872:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126610.295690:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ae40 going to sleep for 11 seconds 00000001:00080000:0.0:1746126610.295813:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943033 is committed 00000001:00080000:0.0:1746126610.295821:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943030 is committed 00000001:00080000:0.0:1746126610.295843:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943034 is committed 00000004:00080000:0.0:1746126610.295847:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2004 committed 00000004:00080000:0.0:1746126610.295853:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2113 committed 00000004:00080000:0.0:1746126610.295858:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2112 committed 00000004:00080000:0.0:1746126610.295859:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2003 committed 00000004:00080000:0.0:1746126610.295860:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2111 committed 00000004:00080000:0.0:1746126610.295862:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2002 committed 00000004:00080000:0.0:1746126610.295863:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2110 committed 00000004:00080000:0.0:1746126610.295864:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2001 committed 00000004:00080000:0.0:1746126610.295866:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2109 committed 00000004:00080000:0.0:1746126610.295867:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2000 committed 00000004:00080000:0.0:1746126610.295868:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2108 committed 00000004:00080000:0.0:1746126610.295869:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2107 committed 00000004:00080000:0.0:1746126610.295871:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1999 committed 00000004:00080000:0.0:1746126610.295872:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1998 committed 00000004:00080000:0.0:1746126610.295873:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2106 committed 00000004:00080000:0.0:1746126610.295874:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2105 committed 00000004:00080000:0.0:1746126610.295875:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1997 committed 00000001:00080000:0.0:1746126610.295878:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943032 is committed 00000100:00100000:2.0:1746126610.296110:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296143:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.296157:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.296177:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746126610.296181:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296191:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.296197:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296205:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.296221:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328000 00000100:00100000:2.0:1746126610.296226:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328000 00000100:00100000:2.0:1746126610.296245:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328512 00000100:00100000:2.0:1746126610.296246:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328512 00000100:00100000:2.0:1746126610.296254:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328384 00000100:00100000:2.0:1746126610.296255:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328384 00000100:00100000:2.0:1746126610.296261:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328896 00000100:00100000:2.0:1746126610.296262:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328896 00000100:00100000:2.0:1746126610.296271:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13262 00000100:00100000:2.0:1746126610.296276:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721328000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126610.296400:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126610.296402:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.296404:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.296406:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.296407:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746126610.296429:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3295:x1830945721328000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (285us total) trans 17179873144 rc 0/0 00000100:00100000:2.0:1746126610.296434:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13262 00000100:00100000:2.0:1746126610.296444:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13263 00000100:00100000:2.0:1746126610.296448:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721328512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126610.296499:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746126610.296501:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:2.0:1746126610.296503:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746126610.296504:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:2.0:1746126610.296506:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:2.0:1746126610.296519:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3295:x1830945721328512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (351us total) trans 17179873145 rc 0/0 00000100:00100000:2.0:1746126610.296523:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13263 00000100:00100000:2.0:1746126610.296529:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13264 00000100:00100000:2.0:1746126610.296533:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721328384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296593:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3295:x1830945721328384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (401us total) trans 17179873146 rc 0/0 00000100:00100000:2.0:1746126610.296597:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13264 00000100:00100000:2.0:1746126610.296603:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13265 00000100:00100000:2.0:1746126610.296607:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721328896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296659:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3295:x1830945721328896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (452us total) trans 17179873147 rc 0/0 00000100:00100000:2.0:1746126610.296663:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13265 00000004:00080000:2.0:1746126610.296689:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c9880/2, rc 0, transno 17179873146 00000100:00100000:2.0:1746126610.296694:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.296699:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed4a680/2, rc 0, transno 17179873147 00000100:00100000:2.0:1746126610.296702:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.296706:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b160000/2, rc 0, transno 17179873144 00000100:00100000:2.0:1746126610.296709:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126610.296713:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c9500/2, rc 0, transno 17179873145 00000100:00100000:2.0:1746126610.296715:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721328512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296733:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721329024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296747:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126610.296759:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329024 00000100:00100000:2.0:1746126610.296761:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329024 00000100:00100000:2.0:1746126610.296770:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13266 00000100:00100000:2.0:1746126610.296773:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3295:x1830945721329024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126610.296855:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3295:x1830945721329024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (107us total) trans 17179873148 rc 0/0 00000100:00100000:2.0:1746126610.296859:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13266 00000004:00080000:2.0:1746126610.296874:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e721880/2, rc 0, transno 17179873148 00000100:00100000:2.0:1746126610.296877:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721329024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297174:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297195:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126610.297207:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297216:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126610.297225:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126610.297228:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297237:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126610.297243:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297251:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126610.297265:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328128 00000100:00100000:0.0:1746126610.297267:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328128 00000100:00100000:0.0:1746126610.297279:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328640 00000100:00100000:0.0:1746126610.297280:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328640 00000100:00100000:0.0:1746126610.297287:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328256 00000100:00100000:0.0:1746126610.297288:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328256 00000100:00100000:0.0:1746126610.297293:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721328768 00000100:00100000:0.0:1746126610.297294:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721328768 00000100:00100000:0.0:1746126610.297299:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13267 00000100:00100000:0.0:1746126610.297303:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721328128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126610.297372:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126610.297374:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126610.297376:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126610.297377:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:0.0:1746126610.297379:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126610.297396:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721328128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (200us total) trans 17179873149 rc 0/0 00000100:00100000:0.0:1746126610.297400:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13267 00000100:00100000:0.0:1746126610.297408:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13268 00000100:00100000:0.0:1746126610.297411:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721328640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297465:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721328640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (247us total) trans 17179873150 rc 0/0 00000100:00100000:0.0:1746126610.297469:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13268 00000100:00100000:0.0:1746126610.297475:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13269 00000100:00100000:0.0:1746126610.297479:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721328256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126610.297528:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126610.297530:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.297532:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.297534:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.297535:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126610.297548:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721328256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (310us total) trans 17179873151 rc 0/0 00000100:00100000:0.0:1746126610.297552:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13269 00000100:00100000:0.0:1746126610.297558:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13270 00000100:00100000:0.0:1746126610.297562:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830945721328768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126610.297613:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721328768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (360us total) trans 17179873152 rc 0/0 00000100:00100000:0.0:1746126610.297616:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13270 00000004:00080000:0.0:1746126610.297635:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c8380/2, rc 0, transno 17179873151 00000100:00100000:0.0:1746126610.297638:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126610.297642:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed49880/2, rc 0, transno 17179873152 00000100:00100000:0.0:1746126610.297644:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126610.297649:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b160e00/2, rc 0, transno 17179873149 00000100:00100000:0.0:1746126610.297650:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126610.297655:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c8e00/2, rc 0, transno 17179873150 00000100:00100000:0.0:1746126610.297656:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721328640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126610.297795:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.297814:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.297824:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.297854:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.297862:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746126610.297866:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.297875:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.297881:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.297890:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126610.297902:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329280 00000100:00100000:3.0:1746126610.297905:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329280 00000100:00100000:3.0:1746126610.297916:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329792 00000100:00100000:3.0:1746126610.297917:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329792 00000100:00100000:3.0:1746126610.297923:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329152 00000100:00100000:3.0:1746126610.297924:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329152 00000100:00100000:3.0:1746126610.297929:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329664 00000100:00100000:3.0:1746126610.297931:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329664 00000100:00100000:3.0:1746126610.297936:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13271 00000100:00100000:3.0:1746126610.297940:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721329280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126610.298025:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126610.298027:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126610.298028:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126610.298030:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126608 -> 1746126608 00002000:00010000:3.0:1746126610.298031:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746126610.298049:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721329280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (234us total) trans 21474840296 rc 0/0 00000100:00100000:3.0:1746126610.298053:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13271 00000100:00100000:3.0:1746126610.298061:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13272 00000100:00100000:3.0:1746126610.298064:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721329792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.298136:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721329792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (281us total) trans 21474840297 rc 0/0 00000100:00100000:3.0:1746126610.298140:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13272 00000100:00100000:3.0:1746126610.298146:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13273 00000100:00100000:3.0:1746126610.298150:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721329152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126610.298200:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746126610.298202:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:3.0:1746126610.298204:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:3.0:1746126610.298205:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:3.0:1746126610.298207:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:3.0:1746126610.298220:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721329152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (344us total) trans 21474840298 rc 0/0 00000100:00100000:3.0:1746126610.298224:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13273 00000100:00100000:3.0:1746126610.298231:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13274 00000100:00100000:3.0:1746126610.298234:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721329664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126610.298287:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721329664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (396us total) trans 21474840299 rc 0/0 00000100:00100000:3.0:1746126610.298291:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13274 00000004:00080000:3.0:1746126610.298308:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b6bb80/2, rc 0, transno 21474840298 00000100:00100000:3.0:1746126610.298311:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126610.298316:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b6a300/2, rc 0, transno 21474840299 00000100:00100000:3.0:1746126610.298318:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126610.298322:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b69f80/2, rc 0, transno 21474840296 00000100:00100000:3.0:1746126610.298324:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329280:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126610.298328:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b68a80/2, rc 0, transno 21474840297 00000100:00100000:3.0:1746126610.298330:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721329792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298374:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721329408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298393:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.298404:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721329920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298412:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.298419:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126610.298422:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721329536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.298436:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721330048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126610.298455:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329408 00000100:00100000:1.0:1746126610.298457:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329408 00000100:00100000:1.0:1746126610.298470:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329920 00000100:00100000:1.0:1746126610.298471:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329920 00000100:00100000:1.0:1746126610.298476:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721329536 00000100:00100000:1.0:1746126610.298477:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721329536 00000100:00100000:1.0:1746126610.298481:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721330048 00000100:00100000:1.0:1746126610.298482:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721330048 00000100:00100000:1.0:1746126610.298488:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13275 00000100:00100000:1.0:1746126610.298491:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3294:x1830945721329408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126610.298552:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126610.298555:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126610.298556:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126608 -> 1746126608 00002000:00010000:1.0:1746126610.298558:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126610.298559:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:1.0:1746126610.298575:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3294:x1830945721329408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (181us total) trans 21474840300 rc 0/0 00000100:00100000:1.0:1746126610.298580:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13275 00000100:00100000:1.0:1746126610.298587:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13276 00000100:00100000:1.0:1746126610.298591:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3294:x1830945721329920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298650:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3294:x1830945721329920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (236us total) trans 21474840301 rc 0/0 00000100:00100000:1.0:1746126610.298654:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13276 00000100:00100000:1.0:1746126610.298660:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13277 00000100:00100000:1.0:1746126610.298663:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3294:x1830945721329536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298719:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3294:x1830945721329536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (286us total) trans 21474840302 rc 0/0 00000100:00100000:1.0:1746126610.298722:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13277 00000100:00100000:1.0:1746126610.298729:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13278 00000100:00100000:1.0:1746126610.298732:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3294:x1830945721330048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126610.298783:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3294:x1830945721330048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (337us total) trans 21474840303 rc 0/0 00000100:00100000:1.0:1746126610.298787:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13278 00000004:00080000:1.0:1746126610.298801:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b69180/2, rc 0, transno 21474840302 00000100:00100000:1.0:1746126610.298804:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721329536:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126610.298808:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937b9f80/2, rc 0, transno 21474840303 00000100:00100000:1.0:1746126610.298810:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721330048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126610.298815:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b69500/2, rc 0, transno 21474840300 00000100:00100000:1.0:1746126610.298817:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721329408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126610.298821:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b6aa00/2, rc 0, transno 21474840301 00000100:00100000:1.0:1746126610.298823:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721329920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126610.299732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.299791:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327616:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126610.299798:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327744:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126610.299803:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721327872:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126610.299853:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2600/0xb50e825867612d01 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 10 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746126610.299870:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.299891:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3a00, rc 0) 00000100:00100000:3.0:1746126610.299918:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31133:x1830945721342848:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 45445us (45539us total) trans 8589943034 rc 0/0 00000100:00100000:3.0:1746126610.299924:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8876 00000100:00100000:2.0:1746126610.300232:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721343744 00000100:00100000:2.0:1746126610.300237:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721343744 00000100:00100000:2.0:1746126610.300662:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3731 00000100:00100000:2.0:1746126610.300669:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31126:x1830945721343744:12345-192.168.203.2@tcp:49:lfs.0 00000100:00100000:2.0:1746126610.301238:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31126:x1830945721343744:12345-192.168.203.2@tcp:49:lfs.0 Request processed in 568us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.301244:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3731 00000100:00100000:1.0:1746126610.301398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.301594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.301618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.301649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.301661:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721343872 00000100:00100000:2.0:1746126610.301665:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721343872 00000100:00100000:2.0:1746126610.301679:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344128 00000100:00100000:2.0:1746126610.301680:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344128 00000100:00100000:2.0:1746126610.301685:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344256 00000100:00100000:2.0:1746126610.301687:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344256 00000100:00100000:2.0:1746126610.301693:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3732 00000100:00100000:2.0:1746126610.301696:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+222:31138:x1830945721343872:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:2.0:1746126610.301735:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+222:31138:x1830945721343872:12345-192.168.203.2@tcp:49:cat.0 Request processed in 38us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.301740:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3732 00000100:00100000:2.0:1746126610.301747:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3733 00000100:00100000:2.0:1746126610.301751:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31131:x1830945721344128:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:2.0:1746126610.301773:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31131:x1830945721344128:12345-192.168.203.2@tcp:49:cat.0 Request processed in 21us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.301777:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3733 00000100:00100000:2.0:1746126610.301783:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3734 00000100:00100000:2.0:1746126610.301786:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb1d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31133:x1830945721344256:12345-192.168.203.2@tcp:49:multiop.0 00000100:00100000:2.0:1746126610.301811:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb1d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31133:x1830945721344256:12345-192.168.203.2@tcp:49:multiop.0 Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.301815:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3734 00000100:00100000:3.0:1746126610.301933:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344000 00000100:00100000:3.0:1746126610.301937:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344000 00000100:00100000:3.0:1746126610.301958:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8880 00000100:00100000:3.0:1746126610.301962:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31135:x1830945721344000:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.301969:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.301981:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612d24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5d2 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.302012:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612d24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d2 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.302022:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612d24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d2 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.302032:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.302035:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126610.302037:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d940400, rc 0) 00000100:00100000:3.0:1746126610.302420:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31135:x1830945721344000:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 455us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.302425:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8880 00000100:00100000:2.0:1746126610.306299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.306378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.306638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.306766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.306797:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344512 00000100:00100000:0.0:1746126610.306803:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344512 00000100:00100000:0.0:1746126610.306858:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344640 00000100:00100000:0.0:1746126610.306861:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344640 00000100:00100000:0.0:1746126610.306872:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344384 00000100:00100000:0.0:1746126610.306874:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344384 00000100:00100000:0.0:1746126610.306892:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13279 00000100:00100000:0.0:1746126610.306897:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721344512:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126610.307030:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126610.307033:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.307035:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.307036:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.307038:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126610.307073:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721344512:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 175us (782us total) trans 17179873153 rc 0/0 00000100:00100000:0.0:1746126610.307078:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13279 00000100:00100000:0.0:1746126610.307090:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13280 00000100:00100000:0.0:1746126610.307094:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721344640:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126610.307157:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126610.307159:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126608 -> 1746126609 00002000:00010000:0.0:1746126610.307161:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126608 -> 1746126609 00002000:00010000:0.0:1746126610.307162:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126608 -> 1746126609 00002000:00010000:0.0:1746126610.307164:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126610.307177:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721344640:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 82us (799us total) trans 17179873154 rc 0/0 00000100:00100000:0.0:1746126610.307181:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13280 00000100:00100000:0.0:1746126610.307189:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13281 00000100:00100000:0.0:1746126610.307192:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721344384:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126610.307252:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746126610.307254:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.307256:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.307258:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:0.0:1746126610.307260:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:0.0:1746126610.307270:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721344384:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 78us (633us total) trans 21474840304 rc 0/0 00000100:00100000:0.0:1746126610.307274:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13281 00000100:00100000:2.0:1746126610.307455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.307467:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344768 00000100:00100000:2.0:1746126610.307471:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344768 00000100:00100000:2.0:1746126610.307482:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345024 00000100:00100000:2.0:1746126610.307484:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345024 00000100:00100000:2.0:1746126610.307493:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13282 00000100:00100000:2.0:1746126610.307496:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721344768:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126610.307559:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126610.307561:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126610.307563:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126610.307565:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126610.307566:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746126610.307582:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721344768:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 85us (816us total) trans 21474840305 rc 0/0 00000100:00100000:2.0:1746126610.307586:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13282 00000100:00100000:2.0:1746126610.307595:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13283 00000100:00100000:2.0:1746126610.307599:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721345024:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126610.307646:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746126610.307648:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.307650:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.307652:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.307653:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746126610.307665:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721345024:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 66us (210us total) trans 17179873155 rc 0/0 00000100:00100000:2.0:1746126610.307669:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13283 00000100:00100000:0.0:1746126610.308819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.309258:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721344896 00000100:00100000:2.0:1746126610.309264:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721344896 00000100:00100000:2.0:1746126610.309286:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13284 00000100:00100000:2.0:1746126610.309292:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721344896:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126610.309386:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:2.0:1746126610.309388:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.309390:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126608 -> 1746126609 00002000:00010000:2.0:1746126610.309391:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:2.0:1746126610.309393:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:2.0:1746126610.309675:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721344896:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 381us (856us total) trans 21474840306 rc 0/0 00000100:00100000:2.0:1746126610.309680:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13284 00000100:00100000:0.0:1746126610.310029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.310092:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345152 00000100:00100000:2.0:1746126610.310095:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345152 00000100:00100000:2.0:1746126610.310117:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13285 00000100:00100000:2.0:1746126610.310121:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:31135:x1830945721345152:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126610.310129:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.310139:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5d9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.310157:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 21 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.310164:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.310170:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 13 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.310179:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.310181:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.310184:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.310203:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 13 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.310212:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 13 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.310221:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330176:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.310783:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.310791:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.310798:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330304:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.310824:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 21 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.310851:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 21 pid: 4642 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.310862:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330432:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.311206:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.315493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.315565:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345280 00000100:00100000:1.0:1746126610.315573:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345280 00000100:00100000:1.0:1746126610.315618:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 679 00000100:00100000:1.0:1746126610.315625:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:1963:x1830945721345280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.315636:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.315657:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940400/0xb50e825867612d24 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d2 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.315671:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126610.315674:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.315721:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:1963:x1830945721345280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.315727:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 679 00000100:00100000:0.0:1746126610.322020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.322049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.323165:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330176:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.323174:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330304:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.323181:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330432:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.323205:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.323219:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b239200, rc 0) 00000100:00100000:2.0:1746126610.323259:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:31135:x1830945721345152:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 13136us (13231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.323265:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13285 00000100:00100000:1.0:1746126610.323683:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345408 00000100:00100000:1.0:1746126610.323690:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345408 00010000:00010000:1.0:1746126610.323717:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.323736:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345536 00000100:00100000:1.0:1746126610.323738:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345536 00010000:00010000:1.0:1746126610.323746:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.323757:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6915 00000100:00100000:1.0:1746126610.323762:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945721345408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.323775:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.323791:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.323799:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.323815:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fba00/0xb50e825867612c05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d562 expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.323842:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.323861:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945721345408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 98us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.323866:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6915 00000100:00100000:1.0:1746126610.323879:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6916 00000100:00100000:1.0:1746126610.323884:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721345536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.323890:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.323897:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.323903:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.323912:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3800/0xb50e825867612cfa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a8 expref: 23 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.323925:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.323940:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721345536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 56us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.323944:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6916 00000100:00100000:0.0:1746126610.324130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.324159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.324295:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346048 00000100:00100000:1.0:1746126610.324299:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346048 00002000:00100000:1.0:1746126610.324324:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e3f5f80 x1830945721346048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.324332:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5f80 with x1830945721346048 ext(1048576->2097151) 00002000:00010000:1.0:1746126610.324336:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f5f80 00000100:00100000:1.0:1746126610.324347:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345920 00000100:00100000:1.0:1746126610.324349:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345920 00002000:00100000:1.0:1746126610.324358:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3f5880 x1830945721345920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.324364:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5880 with x1830945721345920 ext(1048576->2097151) 00002000:00010000:1.0:1746126610.324366:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f5880 00000100:00100000:1.0:1746126610.324374:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7565 00000100:00100000:1.0:1746126610.324378:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721346048:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126610.325372:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7566 00000100:00100000:1.0:1746126610.325380:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721345920:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126610.330401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.330429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.330464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.330493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.330515:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346944 00000100:00100000:3.0:1746126610.330522:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346944 00010000:00010000:3.0:1746126610.330552:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 22 pid: 4642 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.330575:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6917 00000100:00100000:3.0:1746126610.330581:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721346944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.330591:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.330610:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 22 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.330619:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 22 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.330637:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb800/0xb50e825867612bc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d523 expref: 22 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.330654:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.330655:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.330661:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.330668:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.330698:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.330708:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721330560:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126610.330772:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.330855:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346304 00000100:00100000:2.0:1746126610.330859:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346304 00002000:00100000:2.0:1746126610.330881:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800937b8e00 x1830945721346304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.330889:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8e00 with x1830945721346304 ext(0->1048575) 00002000:00010000:2.0:1746126610.330893:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b8e00 00000100:00100000:2.0:1746126610.330902:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346688 00000100:00100000:2.0:1746126610.330904:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346688 00002000:00100000:2.0:1746126610.330910:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800937b9880 x1830945721346688/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.330915:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9880 with x1830945721346688 ext(1048576->2097151) 00002000:00010000:2.0:1746126610.330918:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9880 00000100:00100000:2.0:1746126610.330926:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7567 00000100:00100000:2.0:1746126610.330930:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721346304:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.332033:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7568 00000100:00100000:2.0:1746126610.332041:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721346688:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.333379:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346560 00000100:00100000:0.0:1746126610.333387:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346560 00000100:00100000:0.0:1746126610.333416:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3735 00000100:00100000:0.0:1746126610.333421:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31126:x1830945721346560:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1746126610.333603:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721346560:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 180us (3209us total) trans 8589943035 rc 0/0 00000100:00100000:0.0:1746126610.333608:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3735 00000100:00100000:0.0:1746126610.333667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.336063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.336627:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347072 00000100:00100000:0.0:1746126610.336633:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347072 00000100:00100000:0.0:1746126610.336661:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347200 00000100:00100000:0.0:1746126610.336663:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347200 00000100:00100000:0.0:1746126610.336675:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13286 00000100:00100000:0.0:1746126610.336680:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31131:x1830945721347072:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.336696:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.336709:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5e0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.336731:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.336737:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126610.336738:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126610.336740:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.336762:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.336772:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746126610.336782:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330688:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.336823:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.338365:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13287 00000100:00100000:3.0:1746126610.338376:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31133:x1830945721347200:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.338388:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.338400:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5e7 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.338419:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 25 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.338426:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.338433:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.338439:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.338440:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.338443:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.338468:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.338475:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 12 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.338484:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721330816:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.338539:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.338547:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.338554:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721330944:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.338576:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 25 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.338582:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 25 pid: 23766 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.338589:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721331072:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.338613:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.342376:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721346048:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17987us (18237us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.342386:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7565 00002000:00100000:2.0:1746126610.342396:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e3f5f80 x1830945721346048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.342405:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5f80 with x1830945721346048 ext(1048576->2097151) 00002000:00010000:2.0:1746126610.342410:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f5f80 00000100:00100000:3.0:1746126610.344986:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721330560:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126610.345007:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.345041:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721346944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 14460us (14576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.345050:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6917 00000100:00100000:2.0:1746126610.345541:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721346304:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14609us (15110us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.345548:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7567 00002000:00100000:2.0:1746126610.345555:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800937b8e00 x1830945721346304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.345562:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8e00 with x1830945721346304 ext(0->1048575) 00002000:00010000:2.0:1746126610.345567:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b8e00 00000100:00100000:0.0:1746126610.347474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.347506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.347761:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347712 00000100:00100000:2.0:1746126610.347767:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347712 00002000:00100000:2.0:1746126610.347797:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4009984->4014079) req@ffff880093af5880 x1830945721347712/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.347804:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5880 with x1830945721347712 ext(4009984->4014079) 00010000:00010000:2.0:1746126610.347813:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.347844:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00002000:00010000:2.0:1746126610.347850:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093af5880 00000100:00100000:2.0:1746126610.347867:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1719 00000100:00100000:2.0:1746126610.347873:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721347712:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.348021:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721347712:12345-192.168.203.2@tcp:3:cat.0 Request processed in 147us (512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.348027:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1719 00002000:00100000:2.0:1746126610.348032:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4009984->4014079) req@ffff880093af5880 x1830945721347712/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.348038:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5880 with x1830945721347712 ext(4009984->4014079) 00010000:00010000:2.0:1746126610.348043:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.348050:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00002000:00010000:2.0:1746126610.348054:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093af5880 00000100:00100000:2.0:1746126610.348087:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721330688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.348119:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.348135:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878400, rc 0) 00000100:00100000:2.0:1746126610.348156:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31131:x1830945721347072:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11476us (14488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.348161:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13286 00000100:00100000:3.0:1746126610.348220:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347584 00000100:00100000:3.0:1746126610.348223:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347584 00000100:00100000:3.0:1746126610.348242:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3736 00000100:00100000:3.0:1746126610.348246:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31126:x1830945721347584:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1746126610.348356:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31126:x1830945721347584:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 109us (886us total) trans 8589943036 rc 0/0 00000100:00100000:3.0:1746126610.348360:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3736 00000100:00100000:3.0:1746126610.348380:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721330816:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.348386:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721330944:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.348392:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721331072:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.348407:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.348415:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb99400, rc 0) 00000100:00100000:3.0:1746126610.348428:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31133:x1830945721347200:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10056us (12371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.348432:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13287 00000100:00100000:1.0:1746126610.349319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.349342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.349936:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347840 00000100:00100000:3.0:1746126610.349941:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347840 00010000:00010000:3.0:1746126610.349961:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 13 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.349981:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347968 00000100:00100000:3.0:1746126610.349983:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347968 00010000:00010000:3.0:1746126610.349990:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 23 pid: 23766 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.350001:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6918 00000100:00100000:3.0:1746126610.350006:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721347840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.350015:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.350028:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 13 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.350036:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 13 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.350051:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19000/0xb50e825867612c13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d55b expref: 13 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.350061:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.350088:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721347840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 82us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.350093:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6918 00000100:00100000:3.0:1746126610.350111:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6919 00000100:00100000:3.0:1746126610.350116:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721347968:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.350122:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.350129:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 23 pid: 23766 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.350136:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 23 pid: 23766 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.350147:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b239a00/0xb50e825867612bbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d51c expref: 23 pid: 23766 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.350155:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.350168:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721347968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 52us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.350172:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6919 00000100:00100000:1.0:1746126610.350969:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721345920:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25590us (26807us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.350978:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7566 00002000:00100000:1.0:1746126610.350984:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3f5880 x1830945721345920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.350991:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5880 with x1830945721345920 ext(1048576->2097151) 00002000:00010000:1.0:1746126610.350995:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f5880 00000100:00100000:2.0:1746126610.360291:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721346688:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28243us (29788us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.360300:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7568 00002000:00100000:2.0:1746126610.360309:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800937b9880 x1830945721346688/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.360316:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9880 with x1830945721346688 ext(1048576->2097151) 00010000:00010000:2.0:1746126610.360324:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 22 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.360334:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 22 pid: 17475 timeout: 832 lvb_type: 1 00002000:00010000:2.0:1746126610.360340:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937b9880 00000100:00100000:0.0:1746126610.368367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.368460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.369473:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348352 00000100:00100000:3.0:1746126610.369481:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348352 00000100:00100000:3.0:1746126610.369527:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13288 00000100:00100000:3.0:1746126610.369533:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:31135:x1830945721348352:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.369547:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.369561:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5ee expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.369584:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 17 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.369591:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.369598:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 14 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.369603:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.369605:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.369608:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->3305471] (req 3145728->3305471) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.369633:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 14 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.369641:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.369652:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721331200:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.369729:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.369737:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 33 pid: 4641 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.369743:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721331328:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.369762:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 17 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.369768:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 17 pid: 20294 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.369778:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721331456:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.369788:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.369965:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348224 00000100:00100000:0.0:1746126610.369968:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348224 00002000:00100000:0.0:1746126610.369991:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4009984->4194303) req@ffff880093af4e00 x1830945721348224/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.370005:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4e00 with x1830945721348224 ext(4009984->4194303) 00010000:00010000:0.0:1746126610.370011:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 22 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.370019:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 22 pid: 8437 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746126610.370024:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093af4e00 00000100:00100000:0.0:1746126610.370042:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1720 00000100:00100000:0.0:1746126610.370046:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721348224:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126610.371075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.371148:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348480 00000100:00100000:2.0:1746126610.371152:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348480 00000100:00100000:2.0:1746126610.371179:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13289 00000100:00100000:2.0:1746126610.371184:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31138:x1830945721348480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.371191:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.371200:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5f5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.371215:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.371219:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.371223:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126610.371225:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.371244:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.371252:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.371260:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009204b800, rc 0) 00000100:00100000:2.0:1746126610.371280:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:31138:x1830945721348480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.371285:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13289 00000100:00100000:2.0:1746126610.373429:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721348224:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3376us (5063us total) trans 21474840307 rc 0/0 00000100:00100000:2.0:1746126610.373438:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1720 00002000:00100000:2.0:1746126610.373445:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4009984->4194303) req@ffff880093af4e00 x1830945721348224/t21474840307(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/448 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.373453:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4e00 with x1830945721348224 ext(4009984->4194303) 00010000:00010000:2.0:1746126610.373460:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.373470:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00002000:00010000:2.0:1746126610.373476:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093af4e00 00000100:00100000:0.0:1746126610.373697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.373778:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721331200:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.373935:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348608 00000100:00100000:2.0:1746126610.373940:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348608 00010000:00010000:2.0:1746126610.373957:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 15 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.373984:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6920 00000100:00100000:2.0:1746126610.373989:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1965:x1830945721348608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.373997:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.374010:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 15 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.374017:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 15 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.374031:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4878c00/0xb50e825867612c1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d569 expref: 15 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.374686:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.375066:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1965:x1830945721348608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1074us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.375072:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6920 00000100:00100000:0.0:1746126610.379432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.379455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.379483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.379549:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348864 00000100:00100000:1.0:1746126610.379556:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348864 00010000:00010000:1.0:1746126610.379590:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 34 pid: 4641 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.379613:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348992 00000100:00100000:1.0:1746126610.379615:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348992 00010000:00010000:1.0:1746126610.379624:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 18 pid: 20294 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.379636:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348736 00000100:00100000:1.0:1746126610.379638:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348736 00010000:00010000:1.0:1746126610.379647:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.379660:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6921 00000100:00100000:1.0:1746126610.379667:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721348864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.379678:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.379695:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 34 pid: 4641 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.379708:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 34 pid: 4641 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.379728:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.379763:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721348864:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 97us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.379769:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6921 00000100:00100000:1.0:1746126610.379781:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6922 00000100:00100000:1.0:1746126610.379785:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721348992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.379791:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.379797:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 18 pid: 20294 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.379803:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 18 pid: 20294 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.379812:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.379813:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.379818:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.379846:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.379869:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.379880:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721331712:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126610.379926:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126610.379946:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6923 00000100:00100000:1.0:1746126610.379952:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721348736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.379959:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.379970:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.379977:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.379989:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612cde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5a1 expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.380002:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.380003:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.380007:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.380012:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.380029:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.380041:0:7072:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 21 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.380049:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721331840:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126610.380068:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3300 going to sleep for 11 seconds 00010000:00010000:3.0:1746126610.380154:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800933efc00/0xb50e825867612ce5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5af expref: 33 pid: 4641 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.380167:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721331328:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.380175:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fbc00/0xb50e825867612bcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d52a expref: 18 pid: 20294 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.380182:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721331456:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.380199:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.380205:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570f200, rc 0) 00000100:00100000:3.0:1746126610.380222:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:31135:x1830945721348352:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10689us (11762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.380227:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13288 00000100:00100000:0.0:1746126610.380686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.380738:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349120 00000100:00100000:2.0:1746126610.380742:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349120 00010000:00010000:2.0:1746126610.380755:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.380768:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6924 00000100:00100000:2.0:1746126610.380772:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721349120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.380778:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126610.380785:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126609 -> 1746126610 00002000:00010000:2.0:1746126610.380788:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126609 -> 1746126610 00010000:00010000:2.0:1746126610.380791:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.380797:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.380807:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b239200/0xb50e825867612d2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5d9 expref: 25 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.380841:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.380843:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.380847:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.380853:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.380867:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.380874:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721331968:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.380909:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.386197:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721331840:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.386221:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.386260:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721348736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6307us (6774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.386270:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6923 00000100:00100000:0.0:1746126610.386482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.386525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.386690:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721331712:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126610.386702:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.386724:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721348992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6937us (7267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.386730:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6922 00000100:00100000:0.0:1746126610.388134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.388157:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349376 00000100:00100000:2.0:1746126610.388162:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349376 00002000:00100000:2.0:1746126610.388188:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (2031616->2035711) req@ffff88012d91a680 x1830945721349376/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.388197:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a680 with x1830945721349376 ext(2031616->2035711) 00010000:00010000:2.0:1746126610.388204:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.388215:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:2.0:1746126610.388220:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d91a680 00000100:00100000:2.0:1746126610.388232:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349632 00000100:00100000:2.0:1746126610.388234:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349632 00002000:00100000:2.0:1746126610.388243:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3301376->3305471) req@ffff88012d919c00 x1830945721349632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.388249:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919c00 with x1830945721349632 ext(3301376->3305471) 00002000:00010000:2.0:1746126610.388252:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d919c00 00000100:00100000:2.0:1746126610.388259:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1721 00000100:00100000:2.0:1746126610.388264:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721349376:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.388379:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721349376:12345-192.168.203.2@tcp:3:cat.0 Request processed in 114us (1897us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.388384:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1721 00002000:00100000:2.0:1746126610.388388:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (2031616->2035711) req@ffff88012d91a680 x1830945721349376/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.388394:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a680 with x1830945721349376 ext(2031616->2035711) 00010000:00010000:2.0:1746126610.388398:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.388405:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:2.0:1746126610.388410:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d91a680 00000100:00100000:2.0:1746126610.388418:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7569 00000100:00100000:2.0:1746126610.388421:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721349632:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.388468:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721349632:12345-192.168.203.2@tcp:3:cat.0 Request processed in 46us (1944us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.388472:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7569 00002000:00100000:2.0:1746126610.388476:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3301376->3305471) req@ffff88012d919c00 x1830945721349632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.388482:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919c00 with x1830945721349632 ext(3301376->3305471) 00002000:00010000:2.0:1746126610.388484:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d919c00 00000100:00100000:3.0:1746126610.388581:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721331968:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126610.388592:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.388608:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721349120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7835us (7922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.388614:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6924 00000100:00100000:3.0:1746126610.388982:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349760 00000100:00100000:3.0:1746126610.388986:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349760 00000100:00100000:3.0:1746126610.389006:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13290 00000100:00100000:3.0:1746126610.389011:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721349760:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.389019:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.389029:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867612d4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d5fc expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.389063:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721332096:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126610.389123:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a0c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746126610.391521:0:4640:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126609 -> 1746126610 00002000:00010000:3.0:1746126610.391527:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126609 -> 1746126610 00002000:00010000:3.0:1746126610.391529:0:4640:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126609 -> 1746126610 00000100:00100000:3.0:1746126610.391547:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721332096:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126610.391571:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867612d4e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5fc expref: 18 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.391583:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867612d4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5fc expref: 18 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.391593:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fc00, rc 0) 00000100:00100000:3.0:1746126610.391631:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721349760:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2619us (3499us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126610.391638:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13290 00000100:00100000:0.0:1746126610.393045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.393100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.393132:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350272 00000100:00100000:0.0:1746126610.393138:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350272 00000100:00100000:0.0:1746126610.393166:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3737 00000100:00100000:0.0:1746126610.393172:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31135:x1830945721350272:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126610.393872:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350016 00000100:00100000:1.0:1746126610.393876:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350016 00002000:00100000:1.0:1746126610.393906:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (2031616->2097151) req@ffff88012d918e00 x1830945721350016/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.393915:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918e00 with x1830945721350016 ext(2031616->2097151) 00010000:00010000:1.0:1746126610.393923:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.393935:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126610.393941:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d918e00 00000100:00100000:1.0:1746126610.393953:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1722 00000100:00100000:1.0:1746126610.393959:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721350016:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126610.397859:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31135:x1830945721350272:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 4677us (4749us total) trans 8589943037 rc 0/0 00000100:00100000:0.0:1746126610.397871:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3737 00000100:00100000:0.0:1746126610.398880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.399539:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721350016:12345-192.168.203.2@tcp:4:cat.0 Request processed in 5579us (6496us total) trans 21474840308 rc 0/0 00000100:00100000:1.0:1746126610.399548:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1722 00002000:00100000:1.0:1746126610.399556:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (2031616->2097151) req@ffff88012d918e00 x1830945721350016/t21474840308(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/448 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.399566:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918e00 with x1830945721350016 ext(2031616->2097151) 00010000:00010000:1.0:1746126610.399575:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.399588:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126610.399593:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d918e00 00000100:00100000:1.0:1746126610.399604:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350528 00000100:00100000:1.0:1746126610.399609:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350528 00002000:00100000:1.0:1746126610.399631:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff88012d91b480 x1830945721350528/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.399637:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b480 with x1830945721350528 ext(4972544->4976639) 00002000:00010000:1.0:1746126610.399639:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91b480 00000100:00100000:1.0:1746126610.399649:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7570 00000100:00100000:1.0:1746126610.399654:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721350528:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126610.399717:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721350528:12345-192.168.203.2@tcp:3:cat.0 Request processed in 63us (839us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126610.399722:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7570 00002000:00100000:1.0:1746126610.399726:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff88012d91b480 x1830945721350528/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.399732:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b480 with x1830945721350528 ext(4972544->4976639) 00002000:00010000:1.0:1746126610.399734:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91b480 00000100:00100000:0.0:1746126610.401056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.401136:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350656 00000100:00100000:3.0:1746126610.401141:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350656 00010000:00010000:3.0:1746126610.401161:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.401721:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6925 00000100:00100000:3.0:1746126610.401728:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721350656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.401738:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746126610.401751:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126609 -> 1746126610 00002000:00010000:3.0:1746126610.401753:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126609 -> 1746126610 00010000:00010000:3.0:1746126610.401757:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.401767:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.401783:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb99400/0xb50e825867612d39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.402577:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.402580:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.402587:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.402594:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.402624:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.402640:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721332224:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126610.402714:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.404549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.404676:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721332224:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.404690:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.404719:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721350656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2992us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.404728:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6925 00000100:00100000:3.0:1746126610.404798:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350784 00000100:00100000:3.0:1746126610.404804:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350784 00000100:00100000:3.0:1746126610.404963:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13291 00000100:00100000:3.0:1746126610.404970:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31133:x1830945721350784:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.404983:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.404996:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d603 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.405018:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.405025:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.405026:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.405029:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->2387967] (req 2097152->2387967) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.405050:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.405059:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.405070:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721332352:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.405647:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.408426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.408617:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721351040 00000100:00100000:3.0:1746126610.408636:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721351040 00002000:00100000:3.0:1746126610.408708:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012d91bb80 x1830945721351040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.408716:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91bb80 with x1830945721351040 ext(1048576->2097151) 00002000:00010000:3.0:1746126610.408737:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91bb80 00000100:00100000:0.0:1746126610.408990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.409069:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721332352:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.409096:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->2387967] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126610.409098:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7571 00000100:00100000:3.0:1746126610.409117:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721351040:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:2.0:1746126610.409122:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fa00, rc 0) 00000100:00100000:2.0:1746126610.409166:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31133:x1830945721350784:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4196us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.409174:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13291 00000100:00100000:2.0:1746126610.409400:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721351168 00000100:00100000:2.0:1746126610.409405:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721351168 00010000:00010000:2.0:1746126610.409425:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.409444:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6926 00000100:00100000:2.0:1746126610.409450:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721351168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.409461:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.409531:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.409543:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.409565:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612d32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5e0 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.409626:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.409628:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.409635:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.409643:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.409671:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.409681:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721332480:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.409740:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.413189:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721332480:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.413215:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.413678:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721351168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4225us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.413691:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6926 00000100:00100000:1.0:1746126610.413745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.413772:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721351424 00000100:00100000:2.0:1746126610.413779:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721351424 00002000:00100000:2.0:1746126610.413815:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2383872->2387967) req@ffff880099251c00 x1830945721351424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.413849:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251c00 with x1830945721351424 ext(2383872->2387967) 00002000:00010000:2.0:1746126610.413854:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251c00 00000100:00100000:2.0:1746126610.413873:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7572 00000100:00100000:2.0:1746126610.413880:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721351424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.414031:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721351424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 151us (292us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.414037:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7572 00002000:00100000:2.0:1746126610.414043:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2383872->2387967) req@ffff880099251c00 x1830945721351424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.414049:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251c00 with x1830945721351424 ext(2383872->2387967) 00002000:00010000:2.0:1746126610.414051:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251c00 00000100:00100000:3.0:1746126610.418967:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721351040:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9849us (10537us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.418981:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7571 00002000:00100000:3.0:1746126610.418992:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012d91bb80 x1830945721351040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.419001:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91bb80 with x1830945721351040 ext(1048576->2097151) 00002000:00010000:3.0:1746126610.419007:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91bb80 00000100:00100000:0.0:1746126610.419402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.420502:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721351680 00000100:00100000:2.0:1746126610.420513:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721351680 00000100:00100000:2.0:1746126610.420894:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3738 00000100:00100000:2.0:1746126610.420906:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31133:x1830945721351680:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126610.421370:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31133:x1830945721351680:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 468us (1967us total) trans 8589943038 rc 0/0 00000100:00100000:2.0:1746126610.421377:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3738 00000100:00100000:0.0:1746126610.424139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.424234:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721351808 00000100:00100000:2.0:1746126610.424243:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721351808 00000100:00100000:2.0:1746126610.424293:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13292 00000100:00100000:2.0:1746126610.424300:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:31138:x1830945721351808:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.424317:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.424334:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d60a expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.424361:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.424368:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126610.424370:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126610.424373:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.424401:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.424411:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.424422:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721332608:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.424501:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4acad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.426729:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721332608:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.426762:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.426777:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4aba00, rc 0) 00000100:00100000:2.0:1746126610.426817:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:31138:x1830945721351808:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2516us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.426845:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13292 00000100:00100000:0.0:1746126610.427183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.427287:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721351936 00000100:00100000:3.0:1746126610.427293:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721351936 00002000:00100000:3.0:1746126610.427333:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2387967) req@ffff88009f136a00 x1830945721351936/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.427342:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f136a00 with x1830945721351936 ext(2097152->2387967) 00010000:00010000:3.0:1746126610.427349:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.427361:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:3.0:1746126610.427367:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f136a00 00000100:00100000:3.0:1746126610.427384:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1723 00000100:00100000:3.0:1746126610.427391:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721351936:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126610.432681:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721351936:12345-192.168.203.2@tcp:4:cat.0 Request processed in 5279us (5487us total) trans 21474840309 rc 0/0 00000100:00100000:3.0:1746126610.432694:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1723 00002000:00100000:3.0:1746126610.432707:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2387967) req@ffff88009f136a00 x1830945721351936/t21474840309(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/448 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.432716:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f136a00 with x1830945721351936 ext(2097152->2387967) 00010000:00010000:3.0:1746126610.432727:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.432743:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:3.0:1746126610.432751:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f136a00 00000100:00100000:0.0:1746126610.435755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.435875:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721352064 00000100:00100000:2.0:1746126610.435884:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721352064 00010000:00010000:2.0:1746126610.435921:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.436154:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6927 00000100:00100000:1.0:1746126610.436169:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721352064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.436185:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.436209:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.436222:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.436245:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fa00/0xb50e825867612d55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d603 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.436269:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.436271:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.436278:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.436286:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.436317:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.436333:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721332736:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126610.436408:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.444253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.444285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.444312:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721352320 00000100:00100000:0.0:1746126610.444319:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721352320 00000100:00100000:1.0:1746126610.444332:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099252d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721332736:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126610.444357:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746126610.444362:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f137b80 x1830945721352320/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.444371:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137b80 with x1830945721352320 ext(2097152->3145727) 00002000:00010000:0.0:1746126610.444375:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f137b80 00000100:00100000:0.0:1746126610.444390:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721352576 00000100:00100000:0.0:1746126610.444393:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721352576 00002000:00100000:0.0:1746126610.444401:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f137480 x1830945721352576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746126610.444404:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721352064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8243us (8658us total) trans 0 rc 0/0 00002000:00100000:0.0:1746126610.444407:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137480 with x1830945721352576 ext(3145728->4194303) 00002000:00010000:0.0:1746126610.444410:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f137480 00000100:00100000:1.0:1746126610.444414:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6927 00000100:00100000:0.0:1746126610.444436:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7573 00000100:00100000:0.0:1746126610.444443:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721352320:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126610.444445:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7574 00000100:00100000:1.0:1746126610.444450:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721352576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.444508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.444574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.444650:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721352832 00000100:00100000:3.0:1746126610.444655:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721352832 00002000:00100000:3.0:1746126610.444673:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009f134380 x1830945721352832/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.444680:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134380 with x1830945721352832 ext(2097152->3145727) 00002000:00010000:3.0:1746126610.444683:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f134380 00000100:00100000:3.0:1746126610.444693:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721353088 00000100:00100000:3.0:1746126610.444696:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721353088 00002000:00100000:3.0:1746126610.444705:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3305472->4194303) req@ffff88009f135180 x1830945721353088/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.444712:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135180 with x1830945721353088 ext(3305472->4194303) 00002000:00010000:3.0:1746126610.444714:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f135180 00000100:00100000:3.0:1746126610.444724:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7575 00000100:00100000:3.0:1746126610.444729:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721352832:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.444855:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7576 00000100:00100000:0.0:1746126610.444861:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721353088:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.467624:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721353088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22750us (23036us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746126610.467635:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7576 00002000:00100000:0.0:1746126610.467648:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3305472->4194303) req@ffff88009f135180 x1830945721353088/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.467658:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135180 with x1830945721353088 ext(3305472->4194303) 00002000:00010000:0.0:1746126610.467664:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f135180 00000100:00100000:3.0:1746126610.471325:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721352832:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26584us (26805us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.471336:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7575 00002000:00100000:3.0:1746126610.471347:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009f134380 x1830945721352832/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.471356:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134380 with x1830945721352832 ext(2097152->3145727) 00002000:00010000:3.0:1746126610.471362:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f134380 00000100:00100000:1.0:1746126610.473954:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721352576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29490us (29655us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.473966:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7574 00002000:00100000:1.0:1746126610.473976:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f137480 x1830945721352576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.473984:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137480 with x1830945721352576 ext(3145728->4194303) 00002000:00010000:1.0:1746126610.473990:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f137480 00000100:00100000:2.0:1746126610.482850:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721352320:12345-192.168.203.2@tcp:3:cat.0 Request processed in 38376us (38577us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.482864:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7573 00002000:00100000:2.0:1746126610.482878:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f137b80 x1830945721352320/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.482888:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137b80 with x1830945721352320 ext(2097152->3145727) 00002000:00010000:2.0:1746126610.482894:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f137b80 00000100:00100000:0.0:1746126610.501115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.502530:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721353344 00000100:00100000:2.0:1746126610.502541:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721353344 00002000:00100000:2.0:1746126610.502594:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009f134000 x1830945721353344/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.502605:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134000 with x1830945721353344 ext(4194304->4976639) 00002000:00010000:2.0:1746126610.502611:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f134000 00000100:00100000:2.0:1746126610.502641:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7577 00000100:00100000:2.0:1746126610.502649:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721353344:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.517982:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721353344:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15320us (16873us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126610.517995:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7577 00002000:00100000:2.0:1746126610.518007:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009f134000 x1830945721353344/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.518022:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134000 with x1830945721353344 ext(4194304->4976639) 00002000:00010000:2.0:1746126610.518029:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f134000 00000100:00100000:0.0:1746126610.530492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.532373:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721353600 00000100:00100000:2.0:1746126610.532387:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721353600 00000100:00100000:2.0:1746126610.532463:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8881 00000100:00100000:2.0:1746126610.532471:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31147:x1830945721353600:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.532497:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.532514:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941800/0xb50e825867612d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d611 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.532618:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532629:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532640:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532650:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532655:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532659:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532757:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532767:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532772:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126610.532781:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126610.532889:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532895:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532901:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532906:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d941000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.532910:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532916:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532925:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126610.532928:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.532932:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532936:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941000/0xb50e825867612d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532966:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532974:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532978:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532982:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d940200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.532984:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532988:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.532993:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec44800) 00010000:00010000:2.0:1746126610.532995:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.532997:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.533001:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d940200/0xb50e825867612d71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.533036:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d941800/0xb50e825867612d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.533047:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.533053:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.533055:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126610.533057:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4abc00, rc 0) 00000100:00100000:2.0:1746126610.533132:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31147:x1830945721353600:12345-192.168.203.2@tcp:101:cat.0 Request processed in 662us (2650us total) trans 8589943039 rc 0/0 00000100:00100000:2.0:1746126610.533139:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8881 00000100:00100000:0.0:1746126610.540284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.540454:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721353856 00000100:00100000:2.0:1746126610.540465:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721353856 00000100:00100000:2.0:1746126610.540524:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3739 00000100:00100000:2.0:1746126610.540533:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31147:x1830945721353856:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126610.540744:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31147:x1830945721353856:12345-192.168.203.2@tcp:35:cat.0 Request processed in 212us (470us total) trans 8589943040 rc 0/0 00000100:00100000:2.0:1746126610.540751:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3739 00000100:00100000:1.0:1746126610.541739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.541847:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721354112 00000100:00100000:3.0:1746126610.541853:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721354112 00000100:00100000:3.0:1746126610.541889:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8882 00000100:00100000:3.0:1746126610.541895:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31144:x1830945721354112:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.541909:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.541926:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285200/0xb50e825867612d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d618 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.542017:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542029:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542040:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542054:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542060:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542065:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542169:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542176:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542182:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126610.542190:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126610.542267:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542274:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542280:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542285:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5285400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126610.542289:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542295:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542305:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126610.542307:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126610.542311:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542316:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285400/0xb50e825867612d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542330:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542335:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542340:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542344:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5285600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126610.542345:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542349:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542354:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135613600) 00010000:00010000:3.0:1746126610.542355:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126610.542357:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542362:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285600/0xb50e825867612d94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126610.542392:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285200/0xb50e825867612d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.542403:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.542409:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.542411:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126610.542413:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285800, rc 0) 00000100:00100000:3.0:1746126610.542441:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31144:x1830945721354112:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 545us (703us total) trans 8589943041 rc 0/0 00000100:00100000:3.0:1746126610.542447:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8882 00000100:00100000:0.0:1746126610.547428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.547470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.547561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.547628:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721354240 00000100:00100000:3.0:1746126610.547641:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721354240 00000100:00100000:3.0:1746126610.547685:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721354368 00000100:00100000:3.0:1746126610.547687:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721354368 00000100:00100000:3.0:1746126610.547699:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721354496 00000100:00100000:3.0:1746126610.547701:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721354496 00000100:00100000:3.0:1746126610.547720:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13293 00000100:00100000:3.0:1746126610.547728:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721354240:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.547751:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.547771:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d61f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.547800:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.547802:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.547810:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126610.547864:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13294 00000100:00100000:2.0:1746126610.547872:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721354368:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.547878:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.547888:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d626 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.547899:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.547901:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.547905:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 27 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.547918:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 27 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.547928:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d940200, rc 0) 00000100:00100000:2.0:1746126610.547975:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721354368:12345-192.168.203.2@tcp:101:cat.0 Request processed in 105us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.547981:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13294 00000100:00100000:2.0:1746126610.547997:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13295 00000100:00100000:2.0:1746126610.548001:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721354496:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.548006:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.548015:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e825867612db7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d62d expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.548074:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.548084:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285000, rc 0) 00000100:00100000:3.0:1746126610.548100:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721354240:12345-192.168.203.2@tcp:101:cat.0 Request processed in 373us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.548112:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13293 00000100:00100000:2.0:1746126610.548167:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721332864:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126610.548215:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.550449:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721332864:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126610.550486:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e825867612db7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d62d expref: 18 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.550500:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d941000/0xb50e825867612db7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d62d expref: 18 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.550514:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d941000, rc 0) 00000100:00100000:2.0:1746126610.551751:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721354496:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3743us (4184us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.551761:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13295 00000100:00100000:0.0:1746126610.555558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.557719:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721354624 00000100:00100000:2.0:1746126610.557731:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721354624 00000100:00100000:2.0:1746126610.557790:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13296 00000100:00100000:2.0:1746126610.557797:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:31144:x1830945721354624:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126610.557815:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.557862:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d634 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.557893:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 25 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.557901:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 25 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.557907:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.557912:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.557913:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.557916:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [344064->552959] (req 344064->552959) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.557942:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 11 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.557952:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 11 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.557961:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721332992:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.558057:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 25 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.558064:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.558076:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721333120:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.558094:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 25 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.558109:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 25 pid: 4642 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.558116:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721333248:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.558132:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.563794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.564079:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721354880 00000100:00100000:2.0:1746126610.564088:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721354880 00000100:00100000:2.0:1746126610.564155:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8883 00000100:00100000:2.0:1746126610.564163:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31150:x1830945721354880:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126610.564186:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.564206:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d63b expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.564301:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.564315:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.564322:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.564332:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.564361:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.564370:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 224 pid: 14548 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.564380:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721333376:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126610.564459:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.564466:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 14 pid: 15560 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.564472:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721333504:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.564486:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.565255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.565302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.565335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.565361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.565379:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721355136 00000100:00100000:0.0:1746126610.565383:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721355136 00002000:00100000:0.0:1746126610.565414:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880091da1c00 x1830945721355136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.565423:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1c00 with x1830945721355136 ext(0->1048575) 00010000:00010000:0.0:1746126610.565431:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 26 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746126610.565440:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 26 pid: 4642 timeout: 832 lvb_type: 1 00002000:00010000:0.0:1746126610.565445:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da1c00 00000100:00100000:0.0:1746126610.565458:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721355392 00000100:00100000:0.0:1746126610.565460:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721355392 00002000:00100000:0.0:1746126610.565474:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5967480 x1830945721355392/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.565480:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967480 with x1830945721355392 ext(1048576->2097151) 00002000:00010000:0.0:1746126610.565483:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967480 00000100:00100000:0.0:1746126610.565490:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721355648 00000100:00100000:0.0:1746126610.565492:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721355648 00002000:00100000:0.0:1746126610.565499:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5967100 x1830945721355648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.565505:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967100 with x1830945721355648 ext(1048576->2097151) 00002000:00010000:0.0:1746126610.565508:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967100 00000100:00100000:0.0:1746126610.565514:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721355904 00000100:00100000:0.0:1746126610.565516:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721355904 00002000:00100000:0.0:1746126610.565522:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5966a00 x1830945721355904/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.565528:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966a00 with x1830945721355904 ext(1048576->2097151) 00002000:00010000:0.0:1746126610.565531:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966a00 00000100:00100000:0.0:1746126610.565540:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1724 00000100:00100000:0.0:1746126610.565545:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721355136:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.567817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.567892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.568745:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7578 00000100:00100000:3.0:1746126610.568761:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721355392:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126610.570029:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7579 00000100:00100000:3.0:1746126610.570036:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721355648:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126610.571123:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721356032 00000100:00100000:3.0:1746126610.571132:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721356032 00010000:00010000:3.0:1746126610.571159:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 12 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.571190:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721356160 00000100:00100000:3.0:1746126610.571192:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721356160 00010000:00010000:3.0:1746126610.571201:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 26 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.571216:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6928 00000100:00100000:3.0:1746126610.571220:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1966:x1830945721356032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.571231:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.571249:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 12 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.571260:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 12 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.571287:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.571311:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1966:x1830945721356032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 90us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.571316:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6928 00000100:00100000:3.0:1746126610.571330:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6929 00000100:00100000:3.0:1746126610.571334:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721356160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.571340:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.571347:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 26 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.571353:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 26 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:3.0:1746126610.571362:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.571373:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721356160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 40us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.571377:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6929 00000100:00100000:3.0:1746126610.571397:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7580 00000100:00100000:3.0:1746126610.571403:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721355904:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:1.0:1746126610.573220:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edd4400/0xb50e825867612bf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d546 expref: 11 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.573243:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721332992:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.573282:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3200/0xb50e825867612cec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d58c expref: 25 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.573293:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721333120:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.573303:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721333248:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.573334:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [344064->552959] (req 344064->552959) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.573347:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d941000, rc 0) 00000100:00100000:1.0:1746126610.573382:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:31144:x1830945721354624:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15585us (17835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.573390:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13296 00000100:00100000:2.0:1746126610.583019:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721333376:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126610.583925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.583943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.584097:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721333504:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.584136:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126610.585129:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721356416 00000100:00100000:0.0:1746126610.585138:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721356416 00010000:00010000:0.0:1746126610.585173:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 15 pid: 15560 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746126610.585195:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721356288 00000100:00100000:0.0:1746126610.585197:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721356288 00010000:00010000:0.0:1746126610.585205:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 225 pid: 14548 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746126610.585228:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6930 00000100:00100000:0.0:1746126610.585234:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721356416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.585247:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.585253:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 15 pid: 15560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.585262:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 15 pid: 15560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.585283:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abc00/0xb50e825867612d78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d611 expref: 15 pid: 15560 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.585304:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.585308:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.585316:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.585320:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.585358:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721356416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 124us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.585363:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6930 00000100:00100000:0.0:1746126610.585377:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6931 00000100:00100000:0.0:1746126610.585381:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+225:1964:x1830945721356288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.585387:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.585390:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 225 pid: 14548 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.585398:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 225 pid: 14548 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.585407:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5285800/0xb50e825867612d9b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d618 expref: 225 pid: 14548 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746126610.585415:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.585418:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.585425:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.585431:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126610.585445:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.585455:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+224:1964:x1830945721356288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 74us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.585460:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6931 00000100:00100000:0.0:1746126610.585867:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721355136:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20320us (20613us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126610.585875:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1724 00002000:00100000:0.0:1746126610.585884:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880091da1c00 x1830945721355136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.585892:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1c00 with x1830945721355136 ext(0->1048575) 00010000:00010000:0.0:1746126610.585900:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 28 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746126610.585911:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 28 pid: 4642 timeout: 832 lvb_type: 1 00002000:00010000:0.0:1746126610.585917:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da1c00 00010000:00010000:3.0:1746126610.586336:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.586347:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126610.586365:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126610.587154:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15a00/0xb50e825867612dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 15 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.587182:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.587190:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.587192:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126610.587194:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac15200, rc 0) 00000100:00100000:3.0:1746126610.588338:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31150:x1830945721354880:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 23052us (23430us total) trans 8589943042 rc 0/0 00000100:00100000:3.0:1746126610.588346:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8883 00000100:00100000:3.0:1746126610.595241:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721355392:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26474us (29925us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.595254:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7578 00002000:00100000:3.0:1746126610.595265:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5967480 x1830945721355392/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.595275:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967480 with x1830945721355392 ext(1048576->2097151) 00002000:00010000:3.0:1746126610.595282:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967480 00000100:00100000:3.0:1746126610.597638:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721355648:12345-192.168.203.2@tcp:3:cat.0 Request processed in 27594us (32293us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.597649:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7579 00002000:00100000:3.0:1746126610.597659:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5967100 x1830945721355648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.597668:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967100 with x1830945721355648 ext(1048576->2097151) 00002000:00010000:3.0:1746126610.597673:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967100 00000100:00100000:0.0:1746126610.599195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.599218:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721356544 00000100:00100000:0.0:1746126610.599226:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721356544 00010000:00010000:0.0:1746126610.599255:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 28 pid: 4642 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746126610.599288:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6932 00000100:00100000:0.0:1746126610.599295:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721356544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126610.599307:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126610.599327:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 28 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746126610.599338:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 28 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746126610.599360:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57fb200/0xb50e825867612baa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d507 expref: 28 pid: 4642 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746126610.599376:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.599378:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126610.599384:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.599391:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.599419:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.600471:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5965180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721333632:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126610.601306:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.602172:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721355904:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30765us (36805us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.602182:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7580 00002000:00100000:3.0:1746126610.602193:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5966a00 x1830945721355904/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.602202:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966a00 with x1830945721355904 ext(1048576->2097151) 00002000:00010000:3.0:1746126610.602207:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966a00 00000100:00100000:2.0:1746126610.609269:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5965180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721333632:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.609301:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.609403:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721356544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10107us (10213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.609419:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6932 00000100:00100000:0.0:1746126610.609963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.612057:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721356800 00000100:00100000:3.0:1746126610.612071:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721356800 00002000:00100000:3.0:1746126610.612133:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (344064->348159) req@ffff8800a5965c00 x1830945721356800/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.612144:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965c00 with x1830945721356800 ext(344064->348159) 00002000:00010000:3.0:1746126610.612149:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965c00 00000100:00100000:3.0:1746126610.612176:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7581 00000100:00100000:3.0:1746126610.612183:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721356800:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126610.613634:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721356800:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1444us (3665us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126610.613644:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7581 00002000:00100000:3.0:1746126610.613652:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (344064->348159) req@ffff8800a5965c00 x1830945721356800/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.613660:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965c00 with x1830945721356800 ext(344064->348159) 00002000:00010000:3.0:1746126610.613664:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965c00 00000100:00100000:0.0:1746126610.620298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.620721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.621473:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721357056 00000100:00100000:3.0:1746126610.621486:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721357056 00002000:00100000:3.0:1746126610.621542:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5964a80 x1830945721357056/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.621553:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964a80 with x1830945721357056 ext(2097152->3145727) 00002000:00010000:3.0:1746126610.621559:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5964a80 00000100:00100000:3.0:1746126610.622868:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721357312 00000100:00100000:3.0:1746126610.622876:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721357312 00002000:00100000:3.0:1746126610.622908:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (548864->552959) req@ffff8800a5966680 x1830945721357312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.622916:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966680 with x1830945721357312 ext(548864->552959) 00002000:00010000:3.0:1746126610.622920:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966680 00000100:00100000:1.0:1746126610.623074:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7582 00000100:00100000:1.0:1746126610.623094:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721357056:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.628411:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7583 00000100:00100000:2.0:1746126610.628443:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721357312:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126610.628693:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721357312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 261us (7971us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.628701:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7583 00002000:00100000:2.0:1746126610.628712:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (548864->552959) req@ffff8800a5966680 x1830945721357312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.628721:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966680 with x1830945721357312 ext(548864->552959) 00002000:00010000:2.0:1746126610.628727:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966680 00000100:00100000:0.0:1746126610.632321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.632458:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721357568 00000100:00100000:3.0:1746126610.632469:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721357568 00000100:00100000:1.0:1746126610.633151:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721357056:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10064us (12863us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.633162:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7582 00002000:00100000:1.0:1746126610.633174:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5964a80 x1830945721357056/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.633182:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964a80 with x1830945721357056 ext(2097152->3145727) 00002000:00010000:1.0:1746126610.633188:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5964a80 00000100:00100000:3.0:1746126610.633667:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3740 00000100:00100000:3.0:1746126610.633679:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:31144:x1830945721357568:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126610.633948:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:31144:x1830945721357568:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 271us (1636us total) trans 8589943043 rc 0/0 00000100:00100000:3.0:1746126610.633955:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3740 00000100:00100000:0.0:1746126610.638616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.638714:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721357696 00000100:00100000:1.0:1746126610.638724:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721357696 00000100:00100000:1.0:1746126610.638775:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13297 00000100:00100000:1.0:1746126610.638783:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31147:x1830945721357696:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126610.638805:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.638822:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d642 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.638876:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.638884:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126610.638886:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126610.638889:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.638920:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.638932:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 31 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.638943:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721333760:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.639038:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126610.642886:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721333760:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.642922:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.642939:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4a600, rc 0) 00000100:00100000:1.0:1746126610.643163:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31147:x1830945721357696:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4379us (4555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.643174:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13297 00000100:00100000:0.0:1746126610.643294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.643398:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721357824 00000100:00100000:1.0:1746126610.643404:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721357824 00002000:00100000:1.0:1746126610.643443:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3305471) req@ffff88012d918700 x1830945721357824/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.643452:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918700 with x1830945721357824 ext(3145728->3305471) 00010000:00010000:1.0:1746126610.643459:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 32 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.643470:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 32 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126610.643477:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d918700 00000100:00100000:1.0:1746126610.643492:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1725 00000100:00100000:1.0:1746126610.643499:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721357824:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126610.649743:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721357824:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 6233us (6438us total) trans 17179873156 rc 0/0 00000100:00100000:1.0:1746126610.649755:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1725 00002000:00100000:1.0:1746126610.649767:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3305471) req@ffff88012d918700 x1830945721357824/t17179873156(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/448 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.649776:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918700 with x1830945721357824 ext(3145728->3305471) 00010000:00010000:1.0:1746126610.649785:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 34 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.649804:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 34 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126610.649811:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d918700 00000100:00100000:0.0:1746126610.656926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.657120:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721357952 00000100:00100000:2.0:1746126610.657130:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721357952 00010000:00010000:2.0:1746126610.657169:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 34 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.657198:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6933 00000100:00100000:2.0:1746126610.657206:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721357952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.657223:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.657246:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 34 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.657258:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 34 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.657286:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f200/0xb50e825867612d40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3305471) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5ee expref: 34 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.657312:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.657314:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.657321:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.657329:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.657362:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.657374:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721333888:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.657453:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.661616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.662677:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721358208 00000100:00100000:2.0:1746126610.662686:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721358208 00000100:00100000:2.0:1746126610.662741:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8884 00000100:00100000:2.0:1746126610.662748:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:31154:x1830945721358208:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.662772:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.662791:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3200/0xb50e825867612de1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d649 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.662910:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.662923:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.662932:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.662943:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.662948:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.662953:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663050:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663058:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663063:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126610.663070:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126610.663167:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663173:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663178:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663186:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800997d3600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.663190:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663195:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663204:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126610.663206:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.663209:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663214:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3600/0xb50e825867612de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663224:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663228:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663232:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663237:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800997d2000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126610.663238:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663243:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663248:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec44d00) 00010000:00010000:2.0:1746126610.663250:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126610.663252:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663256:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d2000/0xb50e825867612def lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126610.663288:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3200/0xb50e825867612de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 228 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.663297:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.663303:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.663304:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126610.663306:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3000, rc 0) 00000100:00100000:2.0:1746126610.663350:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+227:31154:x1830945721358208:12345-192.168.203.2@tcp:101:cat.0 Request processed in 602us (1743us total) trans 8589943044 rc 0/0 00000100:00100000:2.0:1746126610.663355:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8884 00000100:00100000:3.0:1746126610.663599:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721333888:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126610.663616:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.663637:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721357952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6433us (6726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.663645:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6933 00000100:00100000:0.0:1746126610.665778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.665814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.665860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.665900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.666048:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721358592 00000100:00100000:2.0:1746126610.666055:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721358592 00002000:00100000:2.0:1746126610.666099:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012d91a300 x1830945721358592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.666119:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a300 with x1830945721358592 ext(2097152->3145727) 00002000:00010000:2.0:1746126610.666124:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91a300 00000100:00100000:2.0:1746126610.666138:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721358720 00000100:00100000:2.0:1746126610.666140:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721358720 00002000:00100000:2.0:1746126610.666150:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d919500 x1830945721358720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.666156:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919500 with x1830945721358720 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.666159:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d919500 00000100:00100000:2.0:1746126610.666168:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721358976 00000100:00100000:2.0:1746126610.666169:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721358976 00002000:00100000:2.0:1746126610.666178:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f134700 x1830945721358976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.666184:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134700 with x1830945721358976 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.666186:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f134700 00000100:00100000:2.0:1746126610.666196:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7584 00000100:00100000:2.0:1746126610.666201:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721358592:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.667099:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7585 00000100:00100000:0.0:1746126610.667118:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721358720:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.667621:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7586 00000100:00100000:2.0:1746126610.667628:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721358976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126610.668551:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721359232 00000100:00100000:3.0:1746126610.668560:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721359232 00000100:00100000:3.0:1746126610.668610:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3741 00000100:00100000:3.0:1746126610.668617:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+227:31154:x1830945721359232:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126610.668816:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+228:31154:x1830945721359232:12345-192.168.203.2@tcp:35:cat.0 Request processed in 198us (2913us total) trans 8589943045 rc 0/0 00000100:00100000:3.0:1746126610.668822:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3741 00000100:00100000:3.0:1746126610.676859:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721358592:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10647us (11077us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.676870:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7584 00002000:00100000:3.0:1746126610.676881:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012d91a300 x1830945721358592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.676890:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a300 with x1830945721358592 ext(2097152->3145727) 00002000:00010000:3.0:1746126610.676895:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91a300 00000100:00100000:2.0:1746126610.685619:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721358720:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18491us (19791us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.685634:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7585 00002000:00100000:2.0:1746126610.685647:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d919500 x1830945721358720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.685656:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919500 with x1830945721358720 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.685662:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d919500 00000100:00100000:0.0:1746126610.685982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.686333:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721359360 00000100:00100000:1.0:1746126610.686341:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721359360 00000100:00100000:1.0:1746126610.686377:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13298 00000100:00100000:1.0:1746126610.686383:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721359360:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126610.686396:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.686413:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d650 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.686436:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.686438:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.686446:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 34 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126610.686460:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 34 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126610.686472:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933ee600, rc 0) 00000100:00100000:1.0:1746126610.686493:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721359360:12345-192.168.203.2@tcp:101:cat.0 Request processed in 110us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.686498:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13298 00000100:00100000:2.0:1746126610.689074:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721358976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21437us (23203us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.689084:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7586 00002000:00100000:2.0:1746126610.689094:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f134700 x1830945721358976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.689121:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134700 with x1830945721358976 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.689126:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f134700 00000100:00100000:0.0:1746126610.695373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.695747:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721359616 00000100:00100000:2.0:1746126610.695757:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721359616 00002000:00100000:2.0:1746126610.695803:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880099370380 x1830945721359616/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 504/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.695813:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370380 with x1830945721359616 ext(0->1048575) 00002000:00010000:2.0:1746126610.695818:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370380 00000100:00100000:2.0:1746126610.695869:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7587 00000100:00100000:2.0:1746126610.695876:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721359616:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126610.696269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.696457:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721359744 00000100:00100000:0.0:1746126610.696461:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721359744 00000100:00100000:0.0:1746126610.696497:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13299 00000100:00100000:0.0:1746126610.696505:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721359744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.696516:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.696551:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800933ee800/0xb50e825867612e0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d657 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.696594:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334016:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126610.696843:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746126610.699992:0:10890:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126609 -> 1746126610 00002000:00010000:2.0:1746126610.699999:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126609 -> 1746126610 00002000:00010000:2.0:1746126610.700001:0:10890:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126609 -> 1746126610 00000100:00100000:2.0:1746126610.700023:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334016:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126610.700059:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800933ee800/0xb50e825867612e0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d657 expref: 26 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.700073:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800933ee800/0xb50e825867612e0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d657 expref: 26 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.700098:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800933ee800, rc 0) 00000100:00100000:2.0:1746126610.700150:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721359744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3645us (3881us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.700223:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13299 00000100:00100000:2.0:1746126610.704923:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721359616:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9035us (9551us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746126610.704935:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7587 00002000:00100000:2.0:1746126610.704948:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880099370380 x1830945721359616/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 504/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.704957:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370380 with x1830945721359616 ext(0->1048575) 00002000:00010000:2.0:1746126610.704962:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370380 00000100:00100000:0.0:1746126610.706371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.706415:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721360000 00000100:00100000:2.0:1746126610.706425:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721360000 00002000:00100000:2.0:1746126610.706460:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099370700 x1830945721360000/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.706469:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370700 with x1830945721360000 ext(4194304->4976639) 00002000:00010000:2.0:1746126610.706473:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370700 00000100:00100000:2.0:1746126610.706504:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7588 00000100:00100000:2.0:1746126610.706512:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721360000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.716251:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721360000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9726us (9870us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126610.716264:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7588 00002000:00100000:2.0:1746126610.716278:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099370700 x1830945721360000/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.716288:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370700 with x1830945721360000 ext(4194304->4976639) 00002000:00010000:2.0:1746126610.716294:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370700 00000100:00100000:0.0:1746126610.716548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.716775:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721360128 00000100:00100000:3.0:1746126610.716783:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721360128 00000100:00100000:3.0:1746126610.716818:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13300 00000100:00100000:3.0:1746126610.716823:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31150:x1830945721360128:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.716864:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.716882:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d65e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.716911:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.716918:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.716923:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.716925:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.716928:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.716956:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.716967:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.716977:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334144:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.717034:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.717042:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 23 pid: 8437 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.717050:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334272:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.717071:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.721303:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334144:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.721321:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334272:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.721350:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.721367:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285400, rc 0) 00000100:00100000:3.0:1746126610.721426:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31150:x1830945721360128:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4601us (4877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.721435:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13300 00000100:00100000:0.0:1746126610.723236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.723325:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721360384 00000100:00100000:3.0:1746126610.723333:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721360384 00010000:00010000:3.0:1746126610.723367:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.723390:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6934 00000100:00100000:3.0:1746126610.723397:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721360384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.723412:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.723435:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.723445:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.723468:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009204b800/0xb50e825867612d47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5f5 expref: 24 pid: 8437 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.723502:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.723534:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721360384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.723540:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6934 00000100:00100000:0.0:1746126610.724676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.724725:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721360256 00000100:00100000:2.0:1746126610.724730:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721360256 00010000:00010000:2.0:1746126610.724754:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.724785:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6935 00000100:00100000:2.0:1746126610.724791:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721360256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.724800:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.724814:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.724823:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.724872:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285000/0xb50e825867612da9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d61f expref: 26 pid: 8437 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.724890:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.724892:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.724898:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.724906:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.724936:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.724947:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721334400:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.725016:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c50b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.725054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.725187:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721360512 00000100:00100000:2.0:1746126610.725191:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721360512 00000100:00100000:2.0:1746126610.725223:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13301 00000100:00100000:2.0:1746126610.725229:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721360512:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.725242:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.725253:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612e19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d665 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.725283:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334528:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126610.725320:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.727359:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721334400:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.727379:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.727413:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721360256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2622us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.727423:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6935 00000100:00100000:0.0:1746126610.727572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.727723:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334528:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126610.727743:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612e19 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d665 expref: 26 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.727753:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612e19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d665 expref: 26 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.727761:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d2e00, rc 0) 00000100:00100000:2.0:1746126610.727780:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721360512:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2552us (2727us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.727786:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13301 00000100:00100000:2.0:1746126610.727808:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721360768 00000100:00100000:2.0:1746126610.727813:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721360768 00002000:00100000:2.0:1746126610.727856:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1814528->1818623) req@ffff880099371880 x1830945721360768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.727864:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371880 with x1830945721360768 ext(1814528->1818623) 00002000:00010000:2.0:1746126610.727868:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099371880 00000100:00100000:2.0:1746126610.727892:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7589 00000100:00100000:2.0:1746126610.727898:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721360768:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126610.728019:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721360768:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 121us (447us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.728025:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7589 00002000:00100000:2.0:1746126610.728030:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1814528->1818623) req@ffff880099371880 x1830945721360768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.728036:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371880 with x1830945721360768 ext(1814528->1818623) 00002000:00010000:2.0:1746126610.728039:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099371880 00000100:00100000:0.0:1746126610.730003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.730048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.730230:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361024 00000100:00100000:2.0:1746126610.730239:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361024 00002000:00100000:2.0:1746126610.730276:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099371c00 x1830945721361024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.730285:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371c00 with x1830945721361024 ext(2097152->3145727) 00002000:00010000:2.0:1746126610.730290:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099371c00 00000100:00100000:2.0:1746126610.730312:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361152 00000100:00100000:2.0:1746126610.730314:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361152 00002000:00100000:2.0:1746126610.730324:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880099371f80 x1830945721361152/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.730341:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371f80 with x1830945721361152 ext(3145728->4194303) 00002000:00010000:2.0:1746126610.730344:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099371f80 00000100:00100000:2.0:1746126610.730356:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7590 00000100:00100000:2.0:1746126610.730364:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721361024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126610.732242:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7591 00000100:00100000:3.0:1746126610.732253:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721361152:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.735301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.735393:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361408 00000100:00100000:2.0:1746126610.735402:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361408 00000100:00100000:2.0:1746126610.735450:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13302 00000100:00100000:2.0:1746126610.735458:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721361408:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.735476:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.735493:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612e20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d66c expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.735545:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334656:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126610.735624:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.742272:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721334656:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126610.742306:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612e20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d66c expref: 26 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.742318:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612e20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d66c expref: 26 pid: 10890 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126610.742726:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721361024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12360us (12731us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.742738:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7590 00002000:00100000:2.0:1746126610.742747:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099371c00 x1830945721361024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.742755:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371c00 with x1830945721361024 ext(2097152->3145727) 00002000:00010000:2.0:1746126610.742759:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099371c00 00010000:00010000:3.0:1746126610.742848:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3c00, rc 0) 00000100:00100000:3.0:1746126610.742878:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721361408:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7420us (7587us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126610.742884:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13302 00000100:00100000:3.0:1746126610.743596:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721361152:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11343us (13549us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126610.743603:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7591 00002000:00100000:3.0:1746126610.743609:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880099371f80 x1830945721361152/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.743616:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371f80 with x1830945721361152 ext(3145728->4194303) 00002000:00010000:3.0:1746126610.743620:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099371f80 00000100:00100000:0.0:1746126610.753301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.753356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.753424:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361536 00000100:00100000:1.0:1746126610.753434:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361536 00000100:00100000:1.0:1746126610.753481:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361664 00000100:00100000:1.0:1746126610.753483:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361664 00000100:00100000:1.0:1746126610.753516:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13303 00000100:00100000:1.0:1746126610.753524:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31150:x1830945721361536:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126610.753544:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.753562:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d673 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.753592:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.753600:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126610.753606:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.753608:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.753611:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.753641:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126610.753658:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.753669:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721334784:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.753749:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.753757:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.753764:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721334912:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.753781:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.754209:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13304 00000100:00100000:0.0:1746126610.754217:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721361664:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126610.754225:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126610.754234:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eac3200/0xb50e825867612e2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d67a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126610.754262:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721335040:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126610.754298:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126610.758067:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721334784:192.168.203.2@tcp:104: 00002000:00010000:2.0:1746126610.760889:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126609 -> 1746126610 00000100:00100000:2.0:1746126610.760918:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721335040:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126610.760957:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eac3200/0xb50e825867612e2e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d67a expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.760972:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eac3200/0xb50e825867612e2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d67a expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.760986:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3200, rc 0) 00000100:00100000:2.0:1746126610.761028:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721361664:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6812us (7671us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.761037:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13304 00000100:00100000:1.0:1746126610.761136:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721334912:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.761164:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.761175:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bfc00, rc 0) 00000100:00100000:1.0:1746126610.761189:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31150:x1830945721361536:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7667us (7900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.761194:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13303 00000100:00100000:0.0:1746126610.763991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.764022:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.764229:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361792 00000100:00100000:2.0:1746126610.764239:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361792 00010000:00010000:2.0:1746126610.764276:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.764306:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721361920 00000100:00100000:2.0:1746126610.764309:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721361920 00010000:00010000:2.0:1746126610.764319:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.764335:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6936 00000100:00100000:2.0:1746126610.764342:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721361792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.764355:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.764376:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.764386:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.764407:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4aba00/0xb50e825867612d5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d60a expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.764421:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.764457:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721361792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 116us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.764463:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6936 00000100:00100000:2.0:1746126610.764477:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6937 00000100:00100000:3.0:1746126610.764618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.764677:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721362048 00000100:00100000:3.0:1746126610.764680:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721362048 00000100:00100000:3.0:1746126610.764700:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13305 00000100:00100000:3.0:1746126610.764705:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:31154:x1830945721362048:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.764719:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.764729:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d681 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.764743:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.764745:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.764752:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.764763:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.764771:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285a00, rc 0) 00000100:00100000:3.0:1746126610.764790:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:31154:x1830945721362048:12345-192.168.203.2@tcp:101:cat.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.764795:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13305 00000100:00100000:2.0:1746126610.765582:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721361920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.765592:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.765607:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.765616:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.765630:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d940200/0xb50e825867612db0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d626 expref: 26 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.765641:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.765643:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.765647:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.765655:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.765685:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.765696:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721335168:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.766297:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.767551:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721335168:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.767570:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.767606:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721361920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3123us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.767615:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6937 00000100:00100000:3.0:1746126610.770761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.770824:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721362304 00000100:00100000:0.0:1746126610.770861:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721362304 00002000:00100000:0.0:1746126610.770910:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093df7480 x1830945721362304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126610.770919:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df7480 with x1830945721362304 ext(4194304->4976639) 00002000:00010000:0.0:1746126610.770925:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df7480 00000100:00100000:0.0:1746126610.770953:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7592 00000100:00100000:0.0:1746126610.770960:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721362304:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.773873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.774715:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721362560 00000100:00100000:2.0:1746126610.774726:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721362560 00002000:00100000:2.0:1746126610.774770:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2633728->2637823) req@ffff880099373800 x1830945721362560/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.774779:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373800 with x1830945721362560 ext(2633728->2637823) 00002000:00010000:2.0:1746126610.774785:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099373800 00000100:00100000:2.0:1746126610.774815:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7593 00000100:00100000:2.0:1746126610.774824:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721362560:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126610.774990:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721362560:12345-192.168.203.2@tcp:3:cat.0 Request processed in 167us (1125us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126610.774997:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7593 00002000:00100000:2.0:1746126610.775002:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2633728->2637823) req@ffff880099373800 x1830945721362560/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.775015:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373800 with x1830945721362560 ext(2633728->2637823) 00002000:00010000:2.0:1746126610.775017:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099373800 00000100:00100000:1.0:1746126610.782189:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721362304:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10495us (10702us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126610.782207:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7592 00002000:00100000:1.0:1746126610.782259:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093df7480 x1830945721362304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.782268:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df7480 with x1830945721362304 ext(4194304->4976639) 00002000:00010000:1.0:1746126610.782274:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df7480 00000100:00100000:0.0:1746126610.787968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.788024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.788058:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721362688 00000100:00100000:3.0:1746126610.788068:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721362688 00000100:00100000:3.0:1746126610.788120:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13306 00000100:00100000:2.0:1746126610.788125:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721362816 00000100:00100000:3.0:1746126610.788127:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721362688:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:2.0:1746126610.788130:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721362816 00010000:00010000:3.0:1746126610.788149:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746126610.788155:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13307 00000100:00100000:2.0:1746126610.788160:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721362816:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.788166:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570ec00/0xb50e825867612e3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d688 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.788167:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.788176:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612e43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d68f expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.788195:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612e43 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d68f expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.788204:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612e43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d68f expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126610.788217:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721335296:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126610.788234:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3c00, rc 0) 00000100:00100000:3.0:1746126610.788293:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.788658:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721362816:12345-192.168.203.2@tcp:101:cat.0 Request processed in 495us (631us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.788665:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13307 00000100:00100000:3.0:1746126610.790818:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721335296:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126610.790889:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570ec00/0xb50e825867612e3c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d688 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.790903:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570ec00/0xb50e825867612e3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d688 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.790922:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570ec00, rc 0) 00000100:00100000:3.0:1746126610.790959:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721362688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2833us (3002us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126610.790967:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13306 00000100:00100000:0.0:1746126610.795216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.795268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.795350:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721362944 00000100:00100000:2.0:1746126610.795359:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721362944 00000100:00100000:3.0:1746126610.795377:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721363072 00000100:00100000:3.0:1746126610.795381:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721363072 00000100:00100000:2.0:1746126610.795398:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13308 00000100:00100000:2.0:1746126610.795408:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721362944:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126610.795410:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13309 00000100:00100000:3.0:1746126610.795415:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721363072:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.795425:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.795425:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.795443:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58d1000/0xb50e825867612e51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d69d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.795443:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d2400/0xb50e825867612e4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d696 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.795473:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58d1000/0xb50e825867612e51 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d69d expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.795484:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58d1000/0xb50e825867612e51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d69d expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.795494:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58d1000, rc 0) 00000100:00100000:2.0:1746126610.795495:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335424:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126610.795614:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721363072:12345-192.168.203.2@tcp:101:cat.0 Request processed in 197us (345us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126610.795620:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13309 00000100:00100000:2.0:1746126610.797006:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.798567:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335424:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126610.798603:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d2400/0xb50e825867612e4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d696 expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.798616:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d2400/0xb50e825867612e4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d696 expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.798642:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d2400, rc 0) 00000100:00100000:2.0:1746126610.798683:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721362944:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3275us (3477us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.798691:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13308 00010000:00010000:0.0:1746126610.813403:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126610.867818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.867919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.868026:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721363328 00000100:00100000:3.0:1746126610.868036:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721363328 00000100:00100000:3.0:1746126610.868075:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721363584 00000100:00100000:3.0:1746126610.868077:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721363584 00000100:00100000:3.0:1746126610.868112:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8885 00000100:00100000:3.0:1746126610.868119:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+228:31159:x1830945721363328:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.868144:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.868163:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570ec00/0xb50e825867612e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6a4 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.868273:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868285:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868296:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868310:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868320:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868325:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868429:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df20200/0xb50e825867612e6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868438:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008df20200/0xb50e825867612e6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868444:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df20200/0xb50e825867612e6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126610.868452:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126610.868538:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868544:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868550:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868555:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570fa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126610.868559:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868565:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868576:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126610.868579:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126610.868582:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868587:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867612e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868605:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868609:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868614:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868618:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570f200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126610.868620:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868625:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868630:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135613600) 00010000:00010000:3.0:1746126610.868632:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126610.868634:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868638:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f200/0xb50e825867612e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868670:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570ec00/0xb50e825867612e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6a4 expref: 231 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.868686:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df20200/0xb50e825867612e6d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6a4 expref: 230 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.868691:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.868693:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126610.868695:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008df20200, rc 0) 00000100:00100000:3.0:1746126610.868738:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:31159:x1830945721363328:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 620us (931us total) trans 8589943046 rc 0/0 00000100:00100000:3.0:1746126610.868745:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8885 00000100:00100000:3.0:1746126610.868759:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8886 00000100:00100000:3.0:1746126610.868765:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31162:x1830945721363584:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.868775:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.868782:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e825867612e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6ab expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.868816:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868822:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868855:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868864:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868869:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868874:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868921:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868927:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868933:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126610.868939:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126610.868971:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868977:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868982:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868985:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008df21200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126610.868988:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868992:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.868999:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126610.869001:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126610.869003:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869011:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21200/0xb50e825867612e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869018:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869022:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869026:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869030:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58d1200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126610.869032:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869037:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869043:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135613a00) 00010000:00010000:3.0:1746126610.869044:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126610.869046:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869051:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e825867612e89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126610.869072:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21e00/0xb50e825867612e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 17 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.869081:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 16 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.869091:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.869093:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126610.869094:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093222200, rc 0) 00000100:00100000:3.0:1746126610.869126:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31162:x1830945721363584:12345-192.168.203.2@tcp:101:cat.0 Request processed in 361us (1206us total) trans 8589943047 rc 0/0 00000100:00100000:3.0:1746126610.869131:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8886 00000100:00100000:0.0:1746126610.877529:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.877592:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721363840 00000100:00100000:3.0:1746126610.877601:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721363840 00000100:00100000:3.0:1746126610.877642:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3742 00000100:00100000:3.0:1746126610.877648:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31162:x1830945721363840:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126610.877877:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31162:x1830945721363840:12345-192.168.203.2@tcp:35:cat.0 Request processed in 228us (355us total) trans 8589943048 rc 0/0 00000100:00100000:3.0:1746126610.877883:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3742 00000100:00100000:3.0:1746126610.880304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.880451:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721363968 00000100:00100000:2.0:1746126610.880461:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721363968 00000100:00100000:2.0:1746126610.882126:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 680 00000100:00100000:2.0:1746126610.882140:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1966:x1830945721363968:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.882156:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.882182:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df20200/0xb50e825867612e6d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6a4 expref: 230 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.882629:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126610.882634:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.882923:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:1966:x1830945721363968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 787us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.882930:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 680 00000100:00100000:0.0:1746126610.883093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.883171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.883375:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721364096 00000100:00100000:2.0:1746126610.883382:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721364096 00000100:00100000:2.0:1746126610.883408:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721364224 00000100:00100000:2.0:1746126610.883410:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721364224 00000100:00100000:2.0:1746126610.883422:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13310 00000100:00100000:2.0:1746126610.883427:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721364096:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.883443:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.883457:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612e9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6b2 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.883501:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335552:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126610.883560:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4acad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.883588:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13311 00000100:00100000:2.0:1746126610.883593:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721364224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126610.883599:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126610.883606:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612ea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6b9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.883621:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612ea5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6b9 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.883630:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3e00/0xb50e825867612ea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6b9 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126610.883643:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3e00, rc 0) 00000100:00100000:2.0:1746126610.883659:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721364224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 65us (487us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126610.883664:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13311 00000100:00100000:3.0:1746126610.888651:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335552:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126610.888688:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612e9e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6b2 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.888702:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612e9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6b2 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.888744:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d2e00, rc 0) 00000100:00100000:3.0:1746126610.889869:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721364096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6436us (6771us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126610.889882:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13310 00000100:00100000:0.0:1746126610.898184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.898327:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721364352 00000100:00100000:3.0:1746126610.898336:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721364352 00000100:00100000:3.0:1746126610.898375:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13312 00000100:00100000:3.0:1746126610.898381:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31162:x1830945721364352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.898399:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.898414:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6c0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.898442:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.898450:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126610.898451:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126610.898455:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.898484:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.898495:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 22 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.898505:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335680:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.899173:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.903396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.903510:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335680:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.903548:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.903565:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008df21e00, rc 0) 00000100:00100000:3.0:1746126610.903610:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31162:x1830945721364352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5229us (5436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.903619:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13312 00000100:00100000:1.0:1746126610.903867:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721364480 00000100:00100000:1.0:1746126610.903874:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721364480 00002000:00100000:1.0:1746126610.903920:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (344064->552959) req@ffff88009f02dc00 x1830945721364480/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.903928:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02dc00 with x1830945721364480 ext(344064->552959) 00010000:00010000:1.0:1746126610.903935:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.903947:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 23 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126610.903953:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f02dc00 00000100:00100000:1.0:1746126610.903973:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1726 00000100:00100000:1.0:1746126610.903980:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721364480:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126610.912939:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721364480:12345-192.168.203.2@tcp:4:cat.0 Request processed in 8950us (9542us total) trans 21474840310 rc 0/0 00000100:00100000:1.0:1746126610.912952:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1726 00002000:00100000:1.0:1746126610.912963:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (344064->552959) req@ffff88009f02dc00 x1830945721364480/t21474840310(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/448 e 0 to 0 dl 1746126621 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126610.912977:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02dc00 with x1830945721364480 ext(344064->552959) 00010000:00010000:1.0:1746126610.912987:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126610.913003:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126610.913009:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f02dc00 00000100:00100000:0.0:1746126610.917480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.917688:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721364608 00000100:00100000:2.0:1746126610.917698:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721364608 00010000:00010000:2.0:1746126610.917737:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.917776:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6938 00000100:00100000:2.0:1746126610.917783:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721364608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.917797:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.917819:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.917860:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.917884:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d941000/0xb50e825867612dbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->552959) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d634 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.917916:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.917918:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.917926:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.917938:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.917969:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.917980:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721335808:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.918065:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.922445:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721335808:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.922469:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.922529:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721364608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4744us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.922538:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6938 00000100:00100000:0.0:1746126610.929269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.929315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.929387:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721364864 00000100:00100000:2.0:1746126610.929397:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721364864 00002000:00100000:2.0:1746126610.929441:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009f02e300 x1830945721364864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.929451:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02e300 with x1830945721364864 ext(0->1048575) 00002000:00010000:2.0:1746126610.929456:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02e300 00000100:00100000:2.0:1746126610.929481:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721365120 00000100:00100000:2.0:1746126610.929483:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721365120 00002000:00100000:2.0:1746126610.929490:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1814527) req@ffff88009f02e680 x1830945721365120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.929495:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02e680 with x1830945721365120 ext(1048576->1814527) 00002000:00010000:2.0:1746126610.929499:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02e680 00000100:00100000:2.0:1746126610.929509:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7594 00000100:00100000:2.0:1746126610.929515:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721364864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126610.931534:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7595 00000100:00100000:3.0:1746126610.931544:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721365120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.936727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.939606:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721364864:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10079us (10336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126610.939617:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7594 00002000:00100000:2.0:1746126610.939627:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009f02e300 x1830945721364864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.939636:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02e300 with x1830945721364864 ext(0->1048575) 00002000:00010000:2.0:1746126610.939642:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02e300 00000100:00100000:3.0:1746126610.940356:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721365248 00000100:00100000:3.0:1746126610.940366:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721365248 00000100:00100000:3.0:1746126610.940414:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13313 00000100:00100000:3.0:1746126610.940421:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:31159:x1830945721365248:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.940435:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.940451:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6c7 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.940476:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.940484:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.940486:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.940489:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [651264->1048575] (req 651264->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.940516:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.940533:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 27 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.940543:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335936:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.942923:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.943944:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721365120:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12397us (14621us total) trans 0 rc 765952/765952 00000100:00100000:3.0:1746126610.943953:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7595 00002000:00100000:3.0:1746126610.943963:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1814527) req@ffff88009f02e680 x1830945721365120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.943971:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02e680 with x1830945721365120 ext(1048576->1814527) 00002000:00010000:3.0:1746126610.943976:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02e680 00000100:00100000:3.0:1746126610.945746:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721335936:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.945769:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [651264->1048575] (req 651264->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.945786:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4a200, rc 0) 00000100:00100000:3.0:1746126610.946251:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:31159:x1830945721365248:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5829us (9533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.946260:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13313 00000100:00100000:0.0:1746126610.952014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.952194:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721365376 00000100:00100000:2.0:1746126610.952203:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721365376 00010000:00010000:2.0:1746126610.952238:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 26 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126610.952274:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6939 00000100:00100000:2.0:1746126610.952281:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721365376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.952295:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.952316:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 26 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.952327:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 26 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.952349:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008df21e00/0xb50e825867612eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c0 expref: 26 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126610.952377:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.952379:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126610.952384:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.952392:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126610.952423:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126610.952435:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721336064:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126610.952512:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126610.956670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.956904:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721336064:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126610.956929:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.956983:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721365376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4702us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.956993:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6939 00000100:00100000:3.0:1746126610.958936:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721365632 00000100:00100000:3.0:1746126610.958948:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721365632 00002000:00100000:3.0:1746126610.958998:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (651264->655359) req@ffff88009f02f100 x1830945721365632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.959013:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02f100 with x1830945721365632 ext(651264->655359) 00002000:00010000:3.0:1746126610.959018:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02f100 00000100:00100000:3.0:1746126610.959054:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7596 00000100:00100000:3.0:1746126610.959060:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721365632:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126610.959231:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721365632:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 171us (2570us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126610.959237:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7596 00002000:00100000:3.0:1746126610.959242:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (651264->655359) req@ffff88009f02f100 x1830945721365632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126610.959248:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02f100 with x1830945721365632 ext(651264->655359) 00002000:00010000:3.0:1746126610.959251:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02f100 00000100:00100000:0.0:1746126610.959598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.959650:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721365760 00000100:00100000:3.0:1746126610.959654:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721365760 00000100:00100000:3.0:1746126610.959674:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13314 00000100:00100000:3.0:1746126610.959679:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31162:x1830945721365760:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126610.959688:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.959703:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6ce expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.959725:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.959727:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.959817:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.959853:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.959863:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4bc00, rc 0) 00000100:00100000:3.0:1746126610.959882:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31162:x1830945721365760:12345-192.168.203.2@tcp:101:cat.0 Request processed in 203us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.959887:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13314 00000100:00100000:0.0:1746126610.968065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.968194:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721365888 00000100:00100000:3.0:1746126610.968204:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721365888 00000100:00100000:3.0:1746126610.968245:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13315 00000100:00100000:3.0:1746126610.968252:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+34:31159:x1830945721365888:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126610.968270:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126610.968287:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6d5 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.968320:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 17 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.968328:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.968334:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 13 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.968340:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.968342:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126610.968345:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1048576->1232895] (req 1048576->1232895) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 35 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.968376:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 13 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.968387:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 13 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.968398:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721336192:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126610.970066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.970108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.970406:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721366272 00000100:00100000:2.0:1746126610.970416:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721366272 00002000:00100000:2.0:1746126610.970462:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3686400->4194303) req@ffff88009f02fb80 x1830945721366272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.970471:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02fb80 with x1830945721366272 ext(3686400->4194303) 00002000:00010000:2.0:1746126610.970476:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02fb80 00000100:00100000:2.0:1746126610.970500:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721366144 00000100:00100000:2.0:1746126610.970503:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721366144 00002000:00100000:2.0:1746126610.970512:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2637824->3686399) req@ffff880099370e00 x1830945721366144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.970518:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370e00 with x1830945721366144 ext(2637824->3686399) 00002000:00010000:2.0:1746126610.970520:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370e00 00000100:00100000:2.0:1746126610.970538:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7597 00000100:00100000:2.0:1746126610.970544:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721366272:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126610.971089:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7598 00000100:00100000:0.0:1746126610.971096:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721366144:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:3.0:1746126610.974285:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.974304:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.974319:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721336320:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.974423:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 17 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126610.974432:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 17 pid: 23766 timeout: 832 lvb_type: 1 00000100:00100000:3.0:1746126610.974440:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721336448:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.974459:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126610.980130:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721336192:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.980300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.981264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126610.981329:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721366656 00000100:00100000:1.0:1746126610.981337:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721366656 00000100:00100000:1.0:1746126610.981388:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8887 00000100:00100000:1.0:1746126610.981395:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31163:x1830945721366656:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126610.981420:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126610.981440:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1a00/0xb50e825867612ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6dc expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.981498:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981510:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981520:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981531:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981539:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981544:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981648:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981657:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 16 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.981665:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126610.981694:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 16 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.981704:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 16 pid: 15560 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126610.981715:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721336576:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126610.981785:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126610.982816:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721366528 00000100:00100000:2.0:1746126610.982849:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721366528 00010000:00010000:2.0:1746126610.982878:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00000100:00100000:2.0:1746126610.982903:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6940 00000100:00100000:2.0:1746126610.982910:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721366528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126610.982922:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126610.982942:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.982953:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.982971:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb600/0xb50e825867612c0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d54d expref: 14 pid: 4640 timeout: 832 lvb_type: 1 00010000:00010000:2.0:1746126610.982997:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126610.983088:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721366528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 178us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126610.983095:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6940 00000100:00100000:2.0:1746126610.983378:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721366272:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12834us (13319us total) trans 0 rc 507904/507904 00000100:00100000:2.0:1746126610.983385:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7597 00002000:00100000:2.0:1746126610.983393:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3686400->4194303) req@ffff88009f02fb80 x1830945721366272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126610.983400:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02fb80 with x1830945721366272 ext(3686400->4194303) 00002000:00010000:2.0:1746126610.983404:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02fb80 00000100:00100000:3.0:1746126610.983506:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721336320:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126610.983514:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721336448:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126610.983539:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->1232895] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 35 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126610.983549:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4ba00, rc 0) 00000100:00100000:3.0:1746126610.983579:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:31159:x1830945721365888:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15326us (15523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.983585:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13315 00000100:00100000:0.0:1746126610.986590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.986622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126610.986647:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721366784 00000100:00100000:2.0:1746126610.986657:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721366784 00010000:00010000:2.0:1746126610.986688:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746126610.988470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126610.988488:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721367168 00000100:00100000:0.0:1746126610.988493:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721367168 00000100:00100000:0.0:1746126610.988525:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3743 00000100:00100000:0.0:1746126610.988532:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:7697:x1830945721367168:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746126610.988740:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:7697:x1830945721367168:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 208us (275us total) trans 8589943049 rc 0/0 00000100:00100000:0.0:1746126610.988747:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3743 00000100:00100000:2.0:1746126610.989245:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721366912 00000100:00100000:2.0:1746126610.989250:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721366912 00010000:00010000:2.0:1746126610.989273:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 18 pid: 23766 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746126610.989376:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6941 00000100:00100000:1.0:1746126610.989390:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721366784:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.989400:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.989423:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.989439:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.989461:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612cd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d593 expref: 35 pid: 17475 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.989485:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126610.989511:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721366784:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 128us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.989517:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6941 00000100:00100000:1.0:1746126610.989530:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6942 00000100:00100000:1.0:1746126610.989534:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721366912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126610.989541:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126610.989547:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 18 pid: 23766 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.989554:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 18 pid: 23766 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.989565:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a34a00/0xb50e825867612bb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d50e expref: 18 pid: 23766 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746126610.989574:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.989575:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126610.989581:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.989590:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126610.989616:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126610.989626:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721336704:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126610.989671:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126610.989698:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721336576:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126610.989717:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126610.990862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126610.990894:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721367296 00000100:00100000:3.0:1746126610.990900:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721367296 00010000:00010000:3.0:1746126610.990921:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 18 pid: 15560 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126610.990946:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6943 00000100:00100000:3.0:1746126610.990952:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721367296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126610.990962:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126610.990967:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 18 pid: 15560 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.990976:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 18 pid: 15560 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.990993:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac15200/0xb50e825867612dcc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d63b expref: 18 pid: 15560 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126610.991013:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126610.991018:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126610.991026:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126610.991032:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126610.991058:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126610.991091:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721367296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 138us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126610.991096:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6943 00010000:00010000:0.0:1746126610.991920:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.991929:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746126610.991971:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126610.991974:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746126610.991978:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721366144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20881us (21876us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126610.991986:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7598 00000004:00010000:0.0:1746126610.991989:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00002000:00100000:1.0:1746126610.991995:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2637824->3686399) req@ffff880099370e00 x1830945721366144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:371/0 lens 488/440 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746126610.991999:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00002000:00100000:1.0:1746126610.992003:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370e00 with x1830945721366144 ext(2637824->3686399) 00002000:00010000:1.0:1746126610.992007:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370e00 00010000:00010000:0.0:1746126610.992008:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992014:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992019:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992024:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c2a0800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126610.992027:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992033:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992042:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126610.992045:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126610.992048:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992053:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867612ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992065:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992070:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992075:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992079:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c2a0000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126610.992081:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992086:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992092:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8100) 00010000:00010000:0.0:1746126610.992093:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126610.992096:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.992107:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0000/0xb50e825867612ed6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126610.994636:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1a00/0xb50e825867612ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.994661:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126610.994670:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126610.994672:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126610.994675:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093222000, rc 0) 00000100:00100000:0.0:1746126610.996375:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721336704:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126610.996402:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126610.996440:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721366912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6903us (9815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126610.996451:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6942 00000100:00100000:1.0:1746126610.996478:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31163:x1830945721366656:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 15083us (15215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126610.996487:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8887 00000100:00100000:0.0:1746126610.998912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.000596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.000644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.000671:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721367680 00000100:00100000:0.0:1746126611.000680:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721367680 00000100:00100000:0.0:1746126611.000740:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721367808 00000100:00100000:0.0:1746126611.000743:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721367808 00000100:00080000:2.0:1746126611.000750:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746126611.000754:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126611.000762:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13316 00000100:00100000:2.0:1746126611.000766:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13317 00000100:00100000:0.0:1746126611.000768:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721367680:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:2.0:1746126611.000771:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945721367808:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126611.000786:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.000786:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.000801:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612eeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6ea expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.000801:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eac3800/0xb50e825867612ee4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6e3 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.000870:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721336960:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126611.000870:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721336832:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.000933:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721367552 00000100:00100000:1.0:1746126611.000937:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721367552 00002000:00100000:1.0:1746126611.000969:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1228800->1232895) req@ffff88008f1e3480 x1830945721367552/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/0 e 0 to 0 dl 1746126621 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.000977:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3480 with x1830945721367552 ext(1228800->1232895) 00002000:00010000:1.0:1746126611.000982:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e3480 00000100:00100000:1.0:1746126611.000996:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7599 00000100:00100000:1.0:1746126611.001001:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721367552:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126611.003247:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4aca180 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.003310:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721367552:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 2303us (4401us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126611.003320:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7599 00002000:00100000:1.0:1746126611.003328:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1228800->1232895) req@ffff88008f1e3480 x1830945721367552/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:371/0 lens 488/4536 e 0 to 0 dl 1746126621 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746126611.003332:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7b40 going to sleep for 11 seconds 00002000:00100000:1.0:1746126611.003335:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3480 with x1830945721367552 ext(1228800->1232895) 00002000:00010000:1.0:1746126611.003340:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e3480 00000100:00100000:0.0:1746126611.003375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.003401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.003448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.003557:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721367936 00000100:00100000:3.0:1746126611.003565:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721367936 00000100:00100000:3.0:1746126611.003589:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368192 00000100:00100000:3.0:1746126611.003591:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368192 00000100:00100000:3.0:1746126611.003600:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368064 00000100:00100000:3.0:1746126611.003602:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368064 00000100:00100000:3.0:1746126611.003613:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13318 00000100:00100000:3.0:1746126611.003619:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945721367936:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126611.003630:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.003644:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28800/0xb50e825867612ef2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6f1 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.003685:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721337088:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126611.003717:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.003731:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13319 00000100:00100000:3.0:1746126611.003736:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945721368192:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126611.003743:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.003753:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6ff expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.003763:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.003765:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.003772:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.003786:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.003795:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29c00, rc 0) 00000100:00100000:3.0:1746126611.003811:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1966:x1830945721368192:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.003816:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13319 00000100:00100000:3.0:1746126611.003854:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13320 00000100:00100000:3.0:1746126611.003859:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945721368064:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126611.003866:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.003872:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867612f00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d6f8 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.003889:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867612f00 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6f8 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.003902:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867612f00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6f8 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.003910:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28400, rc 0) 00000100:00100000:3.0:1746126611.003924:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945721368064:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 65us (476us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.003928:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13320 00000100:00100000:0.0:1746126611.008702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.008759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.008771:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368448 00000100:00100000:2.0:1746126611.008784:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368448 00000100:00100000:2.0:1746126611.008847:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3744 00000100:00100000:2.0:1746126611.008855:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+229:31159:x1830945721368448:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126611.012057:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+230:31159:x1830945721368448:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 3192us (3355us total) trans 8589943050 rc 0/0 00000100:00100000:2.0:1746126611.012070:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3744 00000100:00100000:0.0:1746126611.012473:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721336832:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126611.012507:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eac3800/0xb50e825867612ee4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6e3 expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.012520:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eac3800/0xb50e825867612ee4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6e3 expref: 14 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.012531:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3800, rc 0) 00000100:00100000:0.0:1746126611.012702:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1966:x1830945721367680:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 11932us (12108us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126611.012708:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13316 00000100:00100000:1.0:1746126611.014351:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368704 00000100:00100000:1.0:1746126611.014360:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368704 00000100:00100000:1.0:1746126611.014411:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8888 00000100:00100000:1.0:1746126611.014416:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31165:x1830945721368704:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126611.014436:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.014451:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d706 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.014542:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014555:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014564:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014576:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014581:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014585:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014693:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014703:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014709:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126611.014717:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126611.014799:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014806:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014811:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014820:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b239e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126611.014823:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014848:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014858:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126611.014861:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126611.014864:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014869:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239e00/0xb50e825867612f0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014889:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014894:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014899:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014903:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b239a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126611.014905:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014909:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014915:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8800) 00010000:00010000:1.0:1746126611.014916:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126611.014918:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014921:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239a00/0xb50e825867612f15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.014948:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b239600/0xb50e825867612f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 20 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.014954:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 19 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.014958:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.014959:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126611.014961:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b238a00, rc 0) 00000100:00100000:1.0:1746126611.014993:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31165:x1830945721368704:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 578us (6234us total) trans 8589943051 rc 0/0 00000100:00100000:1.0:1746126611.014997:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8888 00002000:00010000:2.0:1746126611.015619:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126609 -> 1746126610 00002000:00010000:2.0:1746126611.015623:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126609 -> 1746126610 00002000:00010000:2.0:1746126611.015625:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126609 -> 1746126610 00000100:00100000:2.0:1746126611.015642:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721336960:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.015668:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612eeb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ea expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.015678:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997d3400/0xb50e825867612eeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ea expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.015686:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3400, rc 0) 00000100:00100000:2.0:1746126611.015724:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1966:x1830945721367808:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 14951us (15078us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.015730:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13317 00000100:00100000:0.0:1746126611.015963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.015980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.016014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.016084:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721337088:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.016112:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28800/0xb50e825867612ef2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6f1 expref: 12 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.016121:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28800/0xb50e825867612ef2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6f1 expref: 12 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.016130:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28800, rc 0) 00000100:00100000:3.0:1746126611.016154:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721367936:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 12536us (12779us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.016160:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13318 00000100:00100000:3.0:1746126611.016172:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368832 00000100:00100000:3.0:1746126611.016176:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368832 00000100:00100000:3.0:1746126611.016193:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368960 00000100:00100000:1.0:1746126611.016224:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369088 00000100:00100000:1.0:1746126611.016230:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369088 00000100:00100000:1.0:1746126611.016249:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13321 00000100:00100000:1.0:1746126611.016255:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721368832:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.016264:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.016273:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0800/0xb50e825867612f2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d70d expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.016326:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368960 00000100:00100000:3.0:1746126611.016345:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13322 00000100:00100000:3.0:1746126611.016350:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721369088:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.016358:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.016364:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c29800/0xb50e825867612f31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d71b expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.016376:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c29800/0xb50e825867612f31 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d71b expref: 29 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.016383:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c29800/0xb50e825867612f31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d71b expref: 29 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.016389:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29800, rc 0) 00000100:00100000:3.0:1746126611.016401:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721369088:12345-192.168.203.2@tcp:101:cat.0 Request processed in 52us (387us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.016406:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13322 00000100:00100000:3.0:1746126611.016415:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13323 00000100:00100000:3.0:1746126611.016419:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721368960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.016425:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.016433:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867612f38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d714 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.016452:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721337344:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.016633:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721337216:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126611.017182:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.017492:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa3600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.026075:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721337344:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.026076:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721337216:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.026114:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867612f38 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d714 expref: 18 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.026115:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0800/0xb50e825867612f2a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d70d expref: 27 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.026128:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2a0800/0xb50e825867612f2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d70d expref: 27 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.026130:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867612f38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d714 expref: 18 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.026141:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28e00, rc 0) 00010000:00010000:1.0:1746126611.026142:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a0800, rc 0) 00000100:00100000:1.0:1746126611.026183:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721368832:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9928us (10220us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.026192:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13321 00000100:00100000:3.0:1746126611.026233:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721368960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9811us (10251us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.026238:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13323 00000100:00100000:0.0:1746126611.026663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.026712:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369344 00000100:00100000:3.0:1746126611.026717:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369344 00000100:00100000:3.0:1746126611.026758:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8889 00000100:00100000:3.0:1746126611.026764:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31163:x1830945721369344:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126611.026779:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.026793:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28200/0xb50e825867612f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d722 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.027387:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.027401:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.027408:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 18 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.027413:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.027442:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 18 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.027454:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 18 pid: 14547 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126611.027464:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721337472:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.027539:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.027546:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 11 pid: 14547 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126611.027554:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721337600:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.027936:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.032016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.032077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.032112:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369472 00000100:00100000:2.0:1746126611.032122:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369472 00000100:00100000:2.0:1746126611.032163:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13324 00000100:00100000:2.0:1746126611.032169:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31165:x1830945721369472:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126611.032187:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.032202:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d729 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.032232:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.032238:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.032240:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.032243:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [212992->413695] (req 212992->413695) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.032272:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.032281:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 24 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126611.032287:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369600 00000100:00100000:2.0:1746126611.032291:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721337728:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126611.032292:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369600 00010000:00010000:1.0:1746126611.032318:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 19 pid: 14547 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126611.032337:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6944 00000100:00100000:1.0:1746126611.032343:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721369600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746126611.032353:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c50b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746126611.032354:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.032359:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 19 pid: 14547 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.032373:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 19 pid: 14547 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.032394:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.032399:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.032409:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.032414:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.032437:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721369600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.032443:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6944 00010000:00010000:3.0:1746126611.032635:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b238a00/0xb50e825867612f1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d706 expref: 18 pid: 14547 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126611.032651:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721337472:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.032661:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721337600:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.032679:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126611.032891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.033121:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369728 00000100:00100000:1.0:1746126611.033125:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369728 00010000:00010000:1.0:1746126611.033138:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 12 pid: 14547 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126611.033158:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6945 00000100:00100000:1.0:1746126611.033164:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721369728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.033170:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.033174:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 12 pid: 14547 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.033182:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 12 pid: 14547 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.033194:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093222000/0xb50e825867612edd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6dc expref: 12 pid: 14547 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.033207:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.033211:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.033221:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.033227:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.033250:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.033269:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721369728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.033275:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6945 00010000:00010000:3.0:1746126611.033321:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.033328:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126611.033347:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126611.033483:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28200/0xb50e825867612f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d722 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.033494:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d722 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.033500:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.033502:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126611.033504:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28c00, rc 0) 00000100:00100000:3.0:1746126611.033534:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31163:x1830945721369344:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 6770us (6872us total) trans 8589943052 rc 0/0 00000100:00100000:3.0:1746126611.033540:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8889 00000100:00100000:0.0:1746126611.033926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.033979:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369984 00000100:00100000:1.0:1746126611.033983:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369984 00002000:00100000:1.0:1746126611.034014:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a4f55500 x1830945721369984/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.034023:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55500 with x1830945721369984 ext(4194304->4976639) 00002000:00010000:1.0:1746126611.034027:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f55500 00000100:00100000:1.0:1746126611.034040:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7600 00000100:00100000:1.0:1746126611.034046:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721369984:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126611.036222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.036311:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721337728:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.036337:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [212992->413695] (req 212992->413695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 28 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.036352:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3600, rc 0) 00000100:00100000:3.0:1746126611.037281:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:31165:x1830945721369472:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5106us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.037291:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13324 00000100:00100000:3.0:1746126611.037326:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370240 00000100:00100000:3.0:1746126611.037331:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370240 00000100:00100000:3.0:1746126611.037734:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8890 00000100:00100000:3.0:1746126611.037740:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31163:x1830945721370240:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126611.037762:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.037765:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746126611.037789:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867612f46 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d722 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.037802:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.037806:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126611.037815:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29e00/0xb50e825867612f5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d730 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.037912:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037924:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037933:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037942:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037949:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037954:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037960:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c28000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126611.037963:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037973:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037979:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.037982:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126611.037984:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.037989:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867612f62 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.038008:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29e00/0xb50e825867612f5b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d730 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.038015:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29e00/0xb50e825867612f5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d730 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.038022:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29e00, rc 0) 00000100:00100000:3.0:1746126611.038052:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31163:x1830945721370240:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 312us (1836us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.038057:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8890 00000100:00100000:0.0:1746126611.038560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.038582:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370624 00000100:00100000:0.0:1746126611.038586:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370624 00000100:00100000:0.0:1746126611.038609:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8891 00000100:00100000:0.0:1746126611.038614:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:31170:x1830945721370624:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.038629:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.038637:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e825867612f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d737 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.038706:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038714:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038722:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038733:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038739:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038745:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038846:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038853:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038858:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746126611.038865:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126611.038946:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038956:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038961:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038965:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eac3200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126611.038968:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038978:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038985:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126611.038988:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126611.038990:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.038995:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3200/0xb50e825867612f70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039013:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039018:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039022:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039026:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eac2400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126611.039028:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039036:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039042:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136a9f600) 00010000:00010000:0.0:1746126611.039044:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126611.039047:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039051:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2400/0xb50e825867612f77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.039083:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac2c00/0xb50e825867612f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 233 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.039094:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 232 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.039111:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126611.039113:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126611.039115:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3600, rc 0) 00000100:00100000:0.0:1746126611.039132:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:31170:x1830945721370624:12345-192.168.203.2@tcp:101:cat.0 Request processed in 517us (574us total) trans 8589943053 rc 0/0 00000100:00100000:0.0:1746126611.039137:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8891 00000100:00100000:2.0:1746126611.040821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.040906:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370368 00000100:00100000:3.0:1746126611.040915:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370368 00002000:00100000:3.0:1746126611.040957:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (651264->1048575) req@ffff88009204df80 x1830945721370368/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.040967:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204df80 with x1830945721370368 ext(651264->1048575) 00010000:00010000:3.0:1746126611.040977:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126611.040996:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 25 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:3.0:1746126611.041003:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204df80 00000100:00100000:3.0:1746126611.041031:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1727 00000100:00100000:3.0:1746126611.041038:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721370368:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126611.047924:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721369984:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13865us (13985us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126611.047936:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7600 00002000:00100000:1.0:1746126611.047948:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a4f55500 x1830945721369984/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.047957:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55500 with x1830945721369984 ext(4194304->4976639) 00002000:00010000:1.0:1746126611.047963:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f55500 00000100:00100000:3.0:1746126611.050386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.050727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.050963:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370880 00000100:00100000:2.0:1746126611.050974:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370880 00000100:00100000:2.0:1746126611.051013:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371136 00000100:00100000:2.0:1746126611.051016:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371136 00000100:00100000:2.0:1746126611.051040:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3745 00000100:00100000:2.0:1746126611.051049:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+232:31170:x1830945721370880:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126611.051300:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+233:31170:x1830945721370880:12345-192.168.203.2@tcp:35:cat.0 Request processed in 251us (922us total) trans 8589943054 rc 0/0 00000100:00100000:2.0:1746126611.051307:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3745 00000100:00100000:2.0:1746126611.051322:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3746 00000100:00100000:2.0:1746126611.051326:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb1f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31163:x1830945721371136:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:2.0:1746126611.051390:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb1f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31163:x1830945721371136:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 63us (664us total) trans 8589943055 rc 0/0 00000100:00100000:2.0:1746126611.051395:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3746 00000100:00100000:1.0:1746126611.052446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.052774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.052797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.053480:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371264 00000100:00100000:2.0:1746126611.053484:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721370368:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 12445us (12670us total) trans 21474840311 rc 0/0 00000100:00100000:3.0:1746126611.053488:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371264 00000100:00100000:2.0:1746126611.053494:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1727 00002000:00100000:2.0:1746126611.053505:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (651264->1048575) req@ffff88009204df80 x1830945721370368/t21474840311(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.053514:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204df80 with x1830945721370368 ext(651264->1048575) 00000100:00100000:3.0:1746126611.053518:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371392 00000100:00100000:3.0:1746126611.053520:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371392 00010000:00010000:2.0:1746126611.053523:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 27 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:3.0:1746126611.053533:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371520 00000100:00100000:3.0:1746126611.053535:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371520 00010000:00010000:2.0:1746126611.053537:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 27 pid: 4640 timeout: 832 lvb_type: 0 00002000:00010000:2.0:1746126611.053544:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204df80 00000100:00100000:3.0:1746126611.053548:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13325 00000100:00100000:3.0:1746126611.053553:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721371264:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.053563:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126611.053568:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13326 00000100:00100000:0.0:1746126611.053575:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721371392:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.053582:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28000/0xb50e825867612f8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d73e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.053583:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.053594:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612f93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d745 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.053627:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721337856:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126611.053627:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721337984:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126611.053820:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.053963:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.054119:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13327 00000100:00100000:2.0:1746126611.054129:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721371520:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.054137:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.054146:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612f9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d74c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.054164:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612f9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d74c expref: 30 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.054173:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3c00/0xb50e825867612f9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d74c expref: 30 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.054181:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d3c00, rc 0) 00000100:00100000:2.0:1746126611.054200:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721371520:12345-192.168.203.2@tcp:101:cat.0 Request processed in 73us (1402us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.054206:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13327 00000100:00100000:3.0:1746126611.057084:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721337856:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.057126:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28000/0xb50e825867612f8c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d73e expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.057144:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28000/0xb50e825867612f8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d73e expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126611.057153:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721337984:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126611.057176:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612f93 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d745 expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.057186:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2e00/0xb50e825867612f93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d745 expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.057195:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac2e00, rc 0) 00010000:00010000:3.0:1746126611.057198:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28000, rc 0) 00000100:00100000:3.0:1746126611.057240:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721371264:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3685us (4795us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.057240:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721371392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3664us (4464us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.057248:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13326 00000100:00100000:3.0:1746126611.057292:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13325 00000100:00100000:0.0:1746126611.058714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.058740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.058767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.058784:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371648 00000100:00100000:0.0:1746126611.058789:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371648 00000100:00100000:0.0:1746126611.058823:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371776 00000100:00100000:0.0:1746126611.058841:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371776 00000100:00100000:0.0:1746126611.058851:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371904 00000100:00100000:0.0:1746126611.058853:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371904 00000100:00100000:0.0:1746126611.058864:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13328 00000100:00100000:0.0:1746126611.058870:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721371648:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.058884:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126611.058888:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13329 00000100:00100000:3.0:1746126611.058899:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721371776:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.058899:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eac3200/0xb50e825867612fa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d753 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.058906:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.058914:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28600/0xb50e825867612fa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d75a expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.058943:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721338112:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126611.058944:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721338240:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126611.058998:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.059000:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.059024:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13330 00000100:00100000:1.0:1746126611.059036:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721371904:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.059043:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.059691:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5284e00/0xb50e825867612faf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d761 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.059709:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5284e00/0xb50e825867612faf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d761 expref: 32 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.059717:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5284e00/0xb50e825867612faf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d761 expref: 32 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.059726:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5284e00, rc 0) 00000100:00100000:1.0:1746126611.059767:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721371904:12345-192.168.203.2@tcp:101:cat.0 Request processed in 737us (998us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.059772:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13330 00010000:00010000:2.0:1746126611.062432:0:4642:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff8800a4f57800 x1830945721338112) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 30 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126611.062470:0:4642:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 30 pid: 4640 timeout: 832 lvb_type: 0 00010000:00010000:2.0:1746126611.062492:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4a200/0xb50e825867612eb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 651264->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6c7 expref: 30 pid: 4640 timeout: 832 lvb_type: 0 00000100:00100000:2.0:1746126611.062518:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721338112:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.062544:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.062547:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.062554:0:4642:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.062562:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.062595:0:4642:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.062606:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721338368:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126611.062676:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c50600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.062753:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721338240:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.062770:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28600/0xb50e825867612fa8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d75a expref: 29 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.062780:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28600/0xb50e825867612fa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d75a expref: 29 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.062791:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28600, rc 0) 00000100:00100000:3.0:1746126611.062814:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721371776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3919us (4072us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.062822:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13329 00000100:00100000:0.0:1746126611.063361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.063388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.063558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.063646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.063694:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372160 00000100:00100000:1.0:1746126611.063701:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372160 00000100:00100000:1.0:1746126611.063881:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372288 00000100:00100000:1.0:1746126611.063884:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372288 00000100:00100000:0.0:1746126611.063935:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372032 00000100:00100000:0.0:1746126611.063937:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372032 00000100:00100000:3.0:1746126611.063986:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372416 00000100:00100000:3.0:1746126611.063989:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372416 00000100:00100000:0.0:1746126611.064134:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 681 00000100:00100000:0.0:1746126611.064142:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721372032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.064155:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.064157:0:11130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b50e825867612eb3) 00010000:00010000:0.0:1746126611.064158:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.064181:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721372032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 40us (535us total) trans 0 rc 116/116 00000100:00100000:0.0:1746126611.064186:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 681 00000100:00100000:3.0:1746126611.064277:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13331 00000100:00100000:3.0:1746126611.064283:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721372160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.064296:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.064306:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28200/0xb50e825867612fb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d768 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.064339:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721338496:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126611.064372:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.064422:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13332 00000100:00100000:1.0:1746126611.064429:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721372288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.064437:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.064447:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5285800/0xb50e825867612fbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d76f expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.064485:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721338624:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.064505:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.064519:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13333 00000100:00100000:1.0:1746126611.064525:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721372416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.064531:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.064537:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5285200/0xb50e825867612fc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d776 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.064551:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285200/0xb50e825867612fc4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d776 expref: 30 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.064558:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285200/0xb50e825867612fc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d776 expref: 30 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.064570:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285200, rc 0) 00000100:00100000:1.0:1746126611.064582:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721372416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 59us (1025us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.064586:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13333 00000100:00100000:2.0:1746126611.065759:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721338368:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.065789:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eac3200/0xb50e825867612fa1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d753 expref: 27 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.065800:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eac3200/0xb50e825867612fa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d753 expref: 27 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.065810:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3200, rc 0) 00000100:00100000:2.0:1746126611.065952:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721371648:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7080us (7239us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.065958:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13328 00000100:00100000:3.0:1746126611.066717:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721338496:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.066739:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28200/0xb50e825867612fb6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d768 expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.066749:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28200/0xb50e825867612fb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d768 expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.066756:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28200, rc 0) 00000100:00100000:3.0:1746126611.067309:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721372160:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3024us (3947us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.067316:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13331 00000100:00100000:0.0:1746126611.067962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.068244:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721338624:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126611.068270:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5285800/0xb50e825867612fbd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d76f expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.068283:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5285800/0xb50e825867612fbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d76f expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.068292:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285800, rc 0) 00000100:00100000:1.0:1746126611.068316:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721372288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3889us (4928us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.068322:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13332 00000100:00100000:3.0:1746126611.068517:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372672 00000100:00100000:3.0:1746126611.068524:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372672 00002000:00100000:3.0:1746126611.068560:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (212992->217087) req@ffff8800a4f54a80 x1830945721372672/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.068575:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f54a80 with x1830945721372672 ext(212992->217087) 00002000:00010000:3.0:1746126611.068580:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f54a80 00000100:00100000:3.0:1746126611.068595:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7601 00000100:00100000:3.0:1746126611.068600:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721372672:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126611.068745:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721372672:12345-192.168.203.2@tcp:3:cat.0 Request processed in 145us (784us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126611.068751:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7601 00002000:00100000:3.0:1746126611.068756:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (212992->217087) req@ffff8800a4f54a80 x1830945721372672/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/4536 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.068763:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f54a80 with x1830945721372672 ext(212992->217087) 00002000:00010000:3.0:1746126611.068765:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f54a80 00000100:00100000:0.0:1746126611.069724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.069822:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372800 00000100:00100000:1.0:1746126611.069849:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372800 00000100:00100000:1.0:1746126611.069888:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13334 00000100:00100000:1.0:1746126611.069894:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:31170:x1830945721372800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.069905:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.069919:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d77d expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.069941:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.069949:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126611.069951:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126611.069955:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 27 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.069983:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.069995:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 26 pid: 10890 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746126611.070006:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721338752:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126611.070063:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aa33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.074971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.075337:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373056 00000100:00100000:1.0:1746126611.075346:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373056 00002000:00100000:1.0:1746126611.075398:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (409600->413695) req@ffff88009204c700 x1830945721373056/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.075408:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204c700 with x1830945721373056 ext(409600->413695) 00010000:00010000:1.0:1746126611.075416:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.075430:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126611.075437:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204c700 00000100:00100000:1.0:1746126611.075473:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1728 00000100:00100000:1.0:1746126611.075482:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721373056:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.075645:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721373056:12345-192.168.203.2@tcp:3:cat.0 Request processed in 165us (685us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126611.075652:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1728 00002000:00100000:1.0:1746126611.075657:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (409600->413695) req@ffff88009204c700 x1830945721373056/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/4536 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.075663:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204c700 with x1830945721373056 ext(409600->413695) 00010000:00010000:1.0:1746126611.075668:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746126611.075677:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746126611.075683:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204c700 00000100:00100000:0.0:1746126611.075935:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721338752:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126611.075959:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 27 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.075973:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285e00, rc 0) 00000100:00100000:0.0:1746126611.075994:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:31170:x1830945721372800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6101us (6273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.076000:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13334 00000100:00100000:0.0:1746126611.081229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.081341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.081432:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373568 00000100:00100000:2.0:1746126611.081442:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373568 00000100:00100000:2.0:1746126611.081487:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3747 00000100:00100000:2.0:1746126611.081496:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31165:x1830945721373568:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126611.081774:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31165:x1830945721373568:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 279us (432us total) trans 8589943056 rc 0/0 00000100:00100000:2.0:1746126611.081781:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3747 00000100:00100000:3.0:1746126611.082108:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373312 00000100:00100000:3.0:1746126611.082112:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373312 00002000:00100000:3.0:1746126611.082138:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (212992->413695) req@ffff8800a4f57b80 x1830945721373312/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.082147:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f57b80 with x1830945721373312 ext(212992->413695) 00010000:00010000:3.0:1746126611.082155:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126611.082168:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 27 pid: 10890 timeout: 832 lvb_type: 0 00002000:00010000:3.0:1746126611.082175:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4f57b80 00000100:00100000:3.0:1746126611.082188:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1729 00000100:00100000:3.0:1746126611.082194:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721373312:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126611.091544:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721373312:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9337us (10314us total) trans 21474840312 rc 0/0 00000100:00100000:3.0:1746126611.091556:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1729 00002000:00100000:3.0:1746126611.091567:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (212992->413695) req@ffff8800a4f57b80 x1830945721373312/t21474840312(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.091577:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f57b80 with x1830945721373312 ext(212992->413695) 00010000:00010000:3.0:1746126611.091587:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 29 pid: 10890 timeout: 832 lvb_type: 0 00010000:00010000:3.0:1746126611.091602:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 29 pid: 10890 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.091609:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4f57b80 00000100:00100000:0.0:1746126611.097619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.097805:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373696 00000100:00100000:2.0:1746126611.097814:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373696 00010000:00010000:2.0:1746126611.097881:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 29 pid: 10890 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.097909:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6946 00000100:00100000:2.0:1746126611.097916:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721373696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.097931:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.097953:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 29 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.097965:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 29 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.097992:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d3600/0xb50e825867612f4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 212992->413695) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d729 expref: 29 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.098659:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.098662:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.098671:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.098680:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.098716:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.098729:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721338880:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126611.099943:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.101485:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721338880:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.101508:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.101959:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721373696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4041us (4346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.101969:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6946 00000100:00100000:0.0:1746126611.111078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.111251:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373952 00000100:00100000:3.0:1746126611.111260:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373952 00002000:00100000:3.0:1746126611.111309:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddac700 x1830945721373952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.111319:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac700 with x1830945721373952 ext(0->1048575) 00002000:00010000:3.0:1746126611.111325:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac700 00000100:00100000:3.0:1746126611.111345:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7602 00000100:00100000:3.0:1746126611.111352:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721373952:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126611.113768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.115879:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374208 00000100:00100000:0.0:1746126611.115890:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374208 00002000:00100000:0.0:1746126611.115938:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1232896->2097151) req@ffff88009204d880 x1830945721374208/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126611.115948:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d880 with x1830945721374208 ext(1232896->2097151) 00002000:00010000:0.0:1746126611.115955:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204d880 00000100:00100000:0.0:1746126611.115979:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7603 00000100:00100000:0.0:1746126611.115987:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721374208:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126611.123868:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721373952:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12503us (12788us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126611.123880:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7602 00002000:00100000:3.0:1746126611.123895:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddac700 x1830945721373952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.123903:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac700 with x1830945721373952 ext(0->1048575) 00002000:00010000:3.0:1746126611.123910:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac700 00000100:00100000:0.0:1746126611.125695:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721374208:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9699us (11982us total) trans 0 rc 864256/864256 00000100:00100000:0.0:1746126611.125706:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7603 00002000:00100000:0.0:1746126611.125715:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1232896->2097151) req@ffff88009204d880 x1830945721374208/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126611.125724:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d880 with x1830945721374208 ext(1232896->2097151) 00002000:00010000:0.0:1746126611.125729:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204d880 00000100:00100000:0.0:1746126611.141182:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.141791:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374336 00000100:00100000:2.0:1746126611.141802:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374336 00000100:00100000:2.0:1746126611.142132:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13335 00000100:00100000:2.0:1746126611.142141:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:31170:x1830945721374336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.142161:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.142178:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d784 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.142206:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.142213:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.142216:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.142219:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.142251:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.142263:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 27 pid: 10890 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.142274:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721339008:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.142368:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.147891:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721339008:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.147925:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.147942:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997d2e00, rc 0) 00000100:00100000:2.0:1746126611.147986:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:31170:x1830945721374336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5845us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.147995:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13335 00000100:00100000:0.0:1746126611.151045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.151709:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374464 00000100:00100000:2.0:1746126611.151720:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374464 00002000:00100000:2.0:1746126611.151767:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1814528->2097151) req@ffff88012ddad180 x1830945721374464/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.151777:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad180 with x1830945721374464 ext(1814528->2097151) 00010000:00010000:2.0:1746126611.151786:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 28 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.151803:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 28 pid: 10890 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.151811:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ddad180 00000100:00100000:2.0:1746126611.153329:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1730 00000100:00100000:2.0:1746126611.153341:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721374464:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126611.165767:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721374464:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12417us (14719us total) trans 21474840313 rc 0/0 00000100:00100000:2.0:1746126611.165780:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1730 00002000:00100000:2.0:1746126611.165792:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1814528->2097151) req@ffff88012ddad180 x1830945721374464/t21474840313(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.165801:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad180 with x1830945721374464 ext(1814528->2097151) 00010000:00010000:2.0:1746126611.165812:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 30 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.165848:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 30 pid: 10890 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.165855:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ddad180 00000100:00100000:0.0:1746126611.169249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.171863:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374592 00000100:00100000:1.0:1746126611.171877:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374592 00010000:00010000:1.0:1746126611.171923:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 30 pid: 10890 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.171963:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6947 00000100:00100000:1.0:1746126611.171971:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721374592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.171984:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.172009:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 30 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.172026:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 30 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.172049:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285400/0xb50e825867612e12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d65e expref: 30 pid: 10890 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.173153:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.173157:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.173168:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 27 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.173178:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 27 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.173219:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 27 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.173231:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721339136:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126611.173331:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a0ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.175062:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721339136:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126611.175085:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.175130:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721374592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3158us (5890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.175139:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6947 00000100:00100000:0.0:1746126611.177755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.177823:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374848 00000100:00100000:2.0:1746126611.177862:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374848 00002000:00100000:2.0:1746126611.178049:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008dad0e00 x1830945721374848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.178130:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0e00 with x1830945721374848 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.178137:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad0e00 00000100:00100000:2.0:1746126611.178526:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7604 00000100:00100000:2.0:1746126611.178536:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721374848:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126611.191439:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721374848:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12893us (13682us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.191451:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7604 00002000:00100000:2.0:1746126611.191464:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008dad0e00 x1830945721374848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.191473:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0e00 with x1830945721374848 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.191479:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad0e00 00000100:00100000:0.0:1746126611.199873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.199961:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374976 00000100:00100000:2.0:1746126611.199971:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374976 00000100:00100000:2.0:1746126611.200699:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13336 00000100:00100000:2.0:1746126611.200710:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:31170:x1830945721374976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.200729:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.200747:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d78b expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.200776:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.200783:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.200785:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.200788:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.200820:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.200856:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 28 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.200868:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721339264:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.201408:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.206177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.206211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.206226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.206238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.206280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.206377:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721375104 00000100:00100000:1.0:1746126611.206386:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721375104 00000100:00100000:1.0:1746126611.206430:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721375360 00000100:00100000:1.0:1746126611.206432:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721375360 00000100:00100000:1.0:1746126611.206451:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721375488 00000100:00100000:1.0:1746126611.206454:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721375488 00000100:00100000:1.0:1746126611.206467:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721375616 00000100:00100000:1.0:1746126611.206468:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721375616 00000100:00100000:1.0:1746126611.206482:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13337 00000100:00100000:1.0:1746126611.206489:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721375104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.206508:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.206527:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d792 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.206549:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.206552:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.206560:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 32 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.206574:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 32 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.206585:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4878400, rc 0) 00000100:00100000:1.0:1746126611.206627:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721375104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 138us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.206633:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13337 00000100:00100000:1.0:1746126611.206651:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13338 00000100:00100000:1.0:1746126611.206656:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721375360:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.206663:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.206673:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612fe7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d799 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.206715:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721339392:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.206771:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a0ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.206791:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13339 00000100:00100000:1.0:1746126611.206797:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721375488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.206802:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.206811:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7a0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.206821:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.206822:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.206849:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.206858:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.206866:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f09de00, rc 0) 00000100:00100000:1.0:1746126611.206881:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721375488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 86us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.206886:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13339 00000100:00100000:1.0:1746126611.206896:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13340 00000100:00100000:1.0:1746126611.206901:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1964:x1830945721375616:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.206906:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.206912:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fa1000/0xb50e825867612ff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7a7 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.206928:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093fa1000/0xb50e825867612ff5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a7 expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.206940:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fa1000/0xb50e825867612ff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a7 expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.206952:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa1000, rc 0) 00000100:00100000:1.0:1746126611.206963:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1964:x1830945721375616:12345-192.168.203.2@tcp:101:cat.0 Request processed in 63us (725us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.206968:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13340 00000100:00100000:2.0:1746126611.207019:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721339264:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.207042:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.207051:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35c00, rc 0) 00000100:00100000:2.0:1746126611.207070:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+29:31170:x1830945721374976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6364us (7207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.207076:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13336 00000100:00100000:2.0:1746126611.207108:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721375232 00000100:00100000:2.0:1746126611.207112:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721375232 00002000:00100000:2.0:1746126611.207138:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2637823) req@ffff88008dad1c00 x1830945721375232/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.207146:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1c00 with x1830945721375232 ext(2097152->2637823) 00010000:00010000:2.0:1746126611.207156:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 31 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.207172:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 31 pid: 4640 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.207178:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad1c00 00000100:00100000:2.0:1746126611.207194:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1731 00000100:00100000:2.0:1746126611.207199:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1966:x1830945721375232:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126611.208565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.208637:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721375872 00000100:00100000:3.0:1746126611.208642:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721375872 00000100:00100000:3.0:1746126611.208675:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8892 00000100:00100000:3.0:1746126611.208681:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31178:x1830945721375872:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126611.208698:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.208713:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7ae expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.208802:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.208816:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 232 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.208822:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.208878:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 232 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.208888:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 232 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.208899:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721339520:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.208967:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.210369:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721339392:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.210404:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612fe7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d799 expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.210416:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867612fe7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d799 expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.210431:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa1200, rc 0) 00000100:00100000:2.0:1746126611.210463:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721375360:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3806us (4250us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.210471:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13338 00000100:00100000:0.0:1746126611.216880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.216919:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721376000 00000100:00100000:1.0:1746126611.216932:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721376000 00010000:00010000:1.0:1746126611.216976:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 233 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.216996:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721339520:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126611.217015:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6948 00010000:00010000:3.0:1746126611.217019:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126611.217023:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+233:1963:x1830945721376000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.217036:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.217042:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 233 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.217051:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 233 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.217074:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eac3600/0xb50e825867612f7e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d737 expref: 233 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.217087:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.217092:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.217113:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.217119:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126611.217141:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.217178:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:1963:x1830945721376000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.217184:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6948 00010000:00010000:3.0:1746126611.217313:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.217320:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126611.217338:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126611.217482:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867612ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 22 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.217515:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 21 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.217522:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.217524:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126611.217527:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28400, rc 0) 00000100:00100000:3.0:1746126611.217552:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31178:x1830945721375872:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8870us (8992us total) trans 8589943057 rc 0/0 00000100:00100000:3.0:1746126611.217559:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8892 00000100:00100000:0.0:1746126611.221966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.222047:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721376256 00000100:00100000:2.0:1746126611.222058:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721376256 00002000:00100000:2.0:1746126611.222111:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012b192300 x1830945721376256/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.222121:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192300 with x1830945721376256 ext(0->1048575) 00002000:00010000:2.0:1746126611.222127:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b192300 00000100:00100000:2.0:1746126611.222162:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7605 00000100:00100000:2.0:1746126611.222171:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1965:x1830945721376256:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126611.222703:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721375232:12345-192.168.203.2@tcp:4:cat.0 Request processed in 15501us (16420us total) trans 21474840314 rc 0/0 00000100:00100000:3.0:1746126611.222711:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1731 00002000:00100000:3.0:1746126611.222717:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2637823) req@ffff88008dad1c00 x1830945721375232/t21474840314(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.222724:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1c00 with x1830945721375232 ext(2097152->2637823) 00010000:00010000:3.0:1746126611.222732:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.222747:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.222753:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad1c00 00000100:00100000:0.0:1746126611.230122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.230178:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721376384 00000100:00100000:2.0:1746126611.230188:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721376384 00010000:00010000:2.0:1746126611.230235:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 35 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.230811:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6949 00000100:00100000:2.0:1746126611.230821:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+35:1965:x1830945721376384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.230870:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126611.230891:0:11130:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126609 -> 1746126610 00010000:00010000:2.0:1746126611.230898:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 35 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.230911:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 35 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.230933:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e3bfc00/0xb50e825867612e27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d673 expref: 35 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.230957:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.230960:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.230966:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.230974:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.231011:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.231022:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721339648:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126611.231891:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.236448:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1965:x1830945721376256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14266us (14481us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.236460:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7605 00002000:00100000:2.0:1746126611.236472:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012b192300 x1830945721376256/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.236481:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192300 with x1830945721376256 ext(0->1048575) 00002000:00010000:2.0:1746126611.236486:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b192300 00000100:00100000:2.0:1746126611.238393:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721339648:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.238415:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.241142:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1965:x1830945721376384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10307us (11014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.241157:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6949 00000100:00100000:1.0:1746126611.241845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.242042:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721376640 00000100:00100000:2.0:1746126611.242051:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721376640 00002000:00100000:2.0:1746126611.242283:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f02c380 x1830945721376640/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.242293:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02c380 with x1830945721376640 ext(2097152->3145727) 00002000:00010000:2.0:1746126611.242299:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02c380 00000100:00100000:2.0:1746126611.242390:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7606 00000100:00100000:2.0:1746126611.242398:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721376640:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.247598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.247684:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721376896 00000100:00100000:2.0:1746126611.247694:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721376896 00000100:00100000:2.0:1746126611.247741:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13341 00000100:00100000:2.0:1746126611.247748:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31177:x1830945721376896:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.247767:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.247785:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7b5 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.247816:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.247824:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.247849:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.247853:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 18 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.247887:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.247899:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 33 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.247910:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721339776:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.250418:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.251115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.251468:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721377024 00000100:00100000:2.0:1746126611.251477:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721377024 00002000:00100000:2.0:1746126611.251521:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012b190e00 x1830945721377024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.251530:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b190e00 with x1830945721377024 ext(3145728->4194303) 00002000:00010000:2.0:1746126611.251534:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b190e00 00000100:00100000:2.0:1746126611.251566:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7607 00000100:00100000:2.0:1746126611.251573:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721377024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.252732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.252789:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721377280 00000100:00100000:3.0:1746126611.252795:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721377280 00000100:00100000:3.0:1746126611.252843:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8893 00000100:00100000:3.0:1746126611.252850:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+232:31180:x1830945721377280:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126611.252869:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.252886:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75ae00/0xb50e825867613018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7bc expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.252978:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.252991:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.253002:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126611.253011:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126611.253125:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75ae00/0xb50e825867613018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 235 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.253157:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 234 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.253169:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.253172:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126611.253174:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75b000, rc 0) 00000100:00100000:3.0:1746126611.253216:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+234:31180:x1830945721377280:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 366us (492us total) trans 8589943058 rc 0/0 00000100:00100000:3.0:1746126611.253222:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8893 00000100:00100000:2.0:1746126611.259493:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721376640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17083us (17637us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.259506:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7606 00002000:00100000:2.0:1746126611.259518:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f02c380 x1830945721376640/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.259526:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02c380 with x1830945721376640 ext(2097152->3145727) 00002000:00010000:2.0:1746126611.259531:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02c380 00000100:00100000:0.0:1746126611.259875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.260326:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721377408 00000100:00100000:3.0:1746126611.260334:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721377408 00002000:00100000:3.0:1746126611.260368:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1232895) req@ffff88012b193800 x1830945721377408/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.260376:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b193800 with x1830945721377408 ext(1048576->1232895) 00010000:00010000:3.0:1746126611.260384:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.260396:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.260401:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b193800 00000100:00100000:3.0:1746126611.260431:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1732 00000100:00100000:3.0:1746126611.260438:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721377408:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126611.260537:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721339776:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.260563:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 18 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.260578:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa0000, rc 0) 00000100:00100000:2.0:1746126611.260623:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31177:x1830945721376896:12345-192.168.203.2@tcp:101:cat.0 Request processed in 12875us (13034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.260630:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13341 00000100:00100000:2.0:1746126611.265127:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721377024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13542us (14019us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.265142:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7607 00002000:00100000:2.0:1746126611.265153:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012b190e00 x1830945721377024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.265162:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b190e00 with x1830945721377024 ext(3145728->4194303) 00002000:00010000:2.0:1746126611.265168:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b190e00 00000100:00100000:3.0:1746126611.269308:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721377408:12345-192.168.203.2@tcp:4:cat.0 Request processed in 8861us (9424us total) trans 17179873157 rc 0/0 00000100:00100000:3.0:1746126611.269319:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1732 00002000:00100000:3.0:1746126611.269330:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1232895) req@ffff88012b193800 x1830945721377408/t17179873157(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.269339:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b193800 with x1830945721377408 ext(1048576->1232895) 00010000:00010000:3.0:1746126611.269349:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 36 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.269363:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 36 pid: 4640 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.269369:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b193800 00000100:00100000:0.0:1746126611.277707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.280544:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721377536 00000100:00100000:2.0:1746126611.280558:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721377536 00010000:00010000:2.0:1746126611.280604:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 36 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.281183:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6950 00000100:00100000:2.0:1746126611.281193:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721377536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.281208:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.281232:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 36 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.281244:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 36 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.281269:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4ba00/0xb50e825867612ec1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6d5 expref: 36 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.282428:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.282432:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.282442:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.282456:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.282495:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.282507:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721339904:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126611.282843:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.283181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.283223:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721377664 00000100:00100000:3.0:1746126611.283230:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721377664 00000100:00100000:3.0:1746126611.283263:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13342 00000100:00100000:3.0:1746126611.283270:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721377664:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.283284:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.283297:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7c3 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.283315:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.283316:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.283321:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 37 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.283332:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 37 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.283340:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75b600, rc 0) 00000100:00100000:3.0:1746126611.283364:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721377664:12345-192.168.203.2@tcp:101:cat.0 Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.283372:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13342 00000100:00100000:2.0:1746126611.289802:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721339904:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.289855:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.289901:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721377536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8709us (12204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.289912:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6950 00000100:00100000:0.0:1746126611.308143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.308516:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.308597:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721377920 00000100:00100000:3.0:1746126611.308606:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721377920 00002000:00100000:3.0:1746126611.308649:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012b192a00 x1830945721377920/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.308659:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192a00 with x1830945721377920 ext(1048576->2097151) 00002000:00010000:3.0:1746126611.308664:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b192a00 00000100:00100000:3.0:1746126611.309032:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721378176 00000100:00100000:3.0:1746126611.309036:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721378176 00002000:00100000:3.0:1746126611.309051:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012b190a80 x1830945721378176/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.309058:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b190a80 with x1830945721378176 ext(1048576->2097151) 00002000:00010000:3.0:1746126611.309061:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b190a80 00000100:00100000:2.0:1746126611.309092:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7608 00000100:00100000:2.0:1746126611.309110:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721377920:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.310164:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7609 00000100:00100000:0.0:1746126611.310173:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1966:x1830945721378176:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.328457:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1966:x1830945721378176:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18273us (19927us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126611.328471:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7609 00002000:00100000:0.0:1746126611.328485:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012b190a80 x1830945721378176/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126611.328494:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b190a80 with x1830945721378176 ext(1048576->2097151) 00002000:00010000:0.0:1746126611.328500:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b190a80 00000100:00100000:1.0:1746126611.329224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.331124:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721378304 00000100:00100000:3.0:1746126611.331138:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721378304 00000100:00100000:3.0:1746126611.331211:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13343 00000100:00100000:3.0:1746126611.331221:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:31180:x1830945721378304:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126611.331242:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.331264:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7ca expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.331296:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.331306:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.331317:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.331319:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.331323:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [708608->1048575] (req 708608->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.331358:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.331372:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 31 pid: 17475 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.331384:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721340032:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.331501:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.331511:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.331520:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721340160:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.331548:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.334803:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721377920:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25685us (26660us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.334815:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7608 00002000:00100000:2.0:1746126611.334842:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012b192a00 x1830945721377920/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.334851:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192a00 with x1830945721377920 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.334857:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b192a00 00000100:00100000:0.0:1746126611.341373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.341587:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721340032:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.341603:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721340160:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.341640:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [708608->1048575] (req 708608->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.341667:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75bc00, rc 0) 00000100:00100000:2.0:1746126611.343146:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721378432 00000100:00100000:2.0:1746126611.343158:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721378432 00010000:00010000:2.0:1746126611.343194:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 32 pid: 17475 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126611.343237:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6951 00000100:00100000:2.0:1746126611.343244:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1965:x1830945721378432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.343256:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.343278:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 32 pid: 17475 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.343288:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 32 pid: 17475 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.343311:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4878400/0xb50e825867612fe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d792 expref: 32 pid: 17475 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.343328:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126611.343917:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:31180:x1830945721378304:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12695us (14692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.343926:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13343 00000100:00100000:2.0:1746126611.344134:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721378432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 889us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.344141:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6951 00000100:00100000:2.0:1746126611.348676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.348766:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721378560 00000100:00100000:0.0:1746126611.348786:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721378560 00010000:00010000:0.0:1746126611.348825:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.348876:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6952 00000100:00100000:0.0:1746126611.348883:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721378560:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.348897:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.348923:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.348939:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.348962:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285e00/0xb50e825867612fcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d77d expref: 30 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.348989:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.348992:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.348999:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 29 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.349007:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 29 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.349040:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 29 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.349050:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721340288:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126611.349138:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.364458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.364588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.364705:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721340288:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126611.364727:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.364771:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721378560:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 15887us (16103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.364782:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6952 00000100:00100000:3.0:1746126611.364971:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721378688 00000100:00100000:3.0:1746126611.364979:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721378688 00000100:00100000:3.0:1746126611.365011:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13344 00000100:00100000:3.0:1746126611.365017:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+31:31177:x1830945721378688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.365036:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.365052:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7d1 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.365077:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.365079:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.365087:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.365114:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.365124:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75b200, rc 0) 00000100:00100000:3.0:1746126611.365153:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+32:31177:x1830945721378688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 135us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.365157:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13344 00000100:00100000:2.0:1746126611.365239:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721378944 00000100:00100000:2.0:1746126611.365244:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721378944 00002000:00100000:2.0:1746126611.365275:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (708608->712703) req@ffff88009e3a7b80 x1830945721378944/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.365284:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7b80 with x1830945721378944 ext(708608->712703) 00002000:00010000:2.0:1746126611.365288:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a7b80 00000100:00100000:2.0:1746126611.365304:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7610 00000100:00100000:2.0:1746126611.365309:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721378944:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126611.366235:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721378944:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 920us (1641us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126611.366242:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7610 00002000:00100000:2.0:1746126611.366248:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (708608->712703) req@ffff88009e3a7b80 x1830945721378944/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/4536 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.366255:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7b80 with x1830945721378944 ext(708608->712703) 00002000:00010000:2.0:1746126611.366258:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a7b80 00000100:00100000:0.0:1746126611.371661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.372970:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721379072 00000100:00100000:2.0:1746126611.372982:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721379072 00000100:00100000:2.0:1746126611.373044:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13345 00000100:00100000:2.0:1746126611.373052:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:31178:x1830945721379072:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126611.373073:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.373118:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7d8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.373149:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.373156:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.373158:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.373161:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [397312->1048575] (req 397312->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.373193:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.373206:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 28 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.373217:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721340416:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.374501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.374559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.374661:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.374695:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721379328 00000100:00100000:2.0:1746126611.374701:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721379328 00002000:00100000:2.0:1746126611.374737:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2637823) req@ffff88009e3a4e00 x1830945721379328/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.374746:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4e00 with x1830945721379328 ext(2097152->2637823) 00002000:00010000:2.0:1746126611.374751:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a4e00 00000100:00100000:2.0:1746126611.374768:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7611 00000100:00100000:2.0:1746126611.374773:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1965:x1830945721379328:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126611.376127:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721379456 00000100:00100000:3.0:1746126611.376135:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721379456 00000100:00100000:3.0:1746126611.376170:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13346 00000100:00100000:3.0:1746126611.376177:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:31180:x1830945721379456:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126611.376191:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.376208:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7df expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.376235:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.376242:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 37 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.376248:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.376250:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.376254:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->1253375] (req 1048576->1253375) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 37 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.376282:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 37 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.376292:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 37 pid: 17475 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.376303:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721340544:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.376370:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.376383:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 17 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.376390:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721340672:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.376408:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.384295:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1965:x1830945721379328:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 9507us (9787us total) trans 0 rc 540672/540672 00000100:00100000:2.0:1746126611.384306:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7611 00002000:00100000:2.0:1746126611.384318:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2637823) req@ffff88009e3a4e00 x1830945721379328/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 540672/540672 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.384330:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4e00 with x1830945721379328 ext(2097152->2637823) 00002000:00010000:2.0:1746126611.384336:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a4e00 00000100:00100000:0.0:1746126611.385674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.385696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.385707:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721340416:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126611.385744:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721379584 00000100:00100000:1.0:1746126611.385752:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721379584 00010000:00010000:1.0:1746126611.385947:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 38 pid: 17475 timeout: 833 lvb_type: 1 00000100:00100000:1.0:1746126611.385975:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6953 00000100:00100000:1.0:1746126611.385982:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+38:1964:x1830945721379584:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746126611.385992:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721340544:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126611.385995:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126611.386001:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721340672:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126611.386016:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 38 pid: 17475 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.386026:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [1048576->1253375] (req 1048576->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.386031:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 38 pid: 17475 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.386042:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75ac00, rc 0) 00000100:00100000:3.0:1746126611.386069:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+38:31180:x1830945721379456:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9892us (11509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.386077:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13346 00010000:00010000:2.0:1746126611.386087:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [397312->1048575] (req 397312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.386108:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34200, rc 0) 00000100:00100000:3.0:1746126611.386120:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721379712 00000100:00100000:3.0:1746126611.386123:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721379712 00002000:00100000:3.0:1746126611.386148:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (708608->1048575) req@ffff88009e3a4000 x1830945721379712/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.386156:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4000 with x1830945721379712 ext(708608->1048575) 00010000:00010000:3.0:1746126611.386162:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 29 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.386171:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 29 pid: 17475 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.386177:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3a4000 00000100:00100000:3.0:1746126611.386189:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1733 00000100:00100000:3.0:1746126611.386193:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721379712:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126611.386232:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+33:31178:x1830945721379072:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 13079us (14479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.386239:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13345 00010000:00010000:1.0:1746126611.386378:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f75b600/0xb50e82586761302d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7c3 expref: 37 pid: 17475 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746126611.386394:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.386412:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721379584:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 432us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.386418:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6953 00000100:00100000:0.0:1746126611.386773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.386813:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721379840 00000100:00100000:1.0:1746126611.386817:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721379840 00010000:00010000:1.0:1746126611.386852:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 18 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.386868:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6954 00000100:00100000:1.0:1746126611.386874:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721379840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.386881:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.386888:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 18 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.386896:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 18 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.386909:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fa0000/0xb50e825867613011 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7b5 expref: 18 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.386917:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.386919:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.386925:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.386933:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.386959:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.386970:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721340800:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126611.387026:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a0ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.392314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.392389:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380096 00000100:00100000:2.0:1746126611.392398:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380096 00002000:00100000:2.0:1746126611.392443:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1249280->1253375) req@ffff880092b17100 x1830945721380096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.392454:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17100 with x1830945721380096 ext(1249280->1253375) 00002000:00010000:2.0:1746126611.392459:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b17100 00000100:00100000:2.0:1746126611.392495:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7612 00000100:00100000:2.0:1746126611.392503:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721380096:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126611.392666:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721380096:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 163us (361us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126611.392672:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7612 00002000:00100000:2.0:1746126611.392678:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1249280->1253375) req@ffff880092b17100 x1830945721380096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/4536 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.392685:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17100 with x1830945721380096 ext(1249280->1253375) 00002000:00010000:2.0:1746126611.392688:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b17100 00000100:00100000:1.0:1746126611.393227:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721340800:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126611.393254:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.393280:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721379840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6406us (6506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.393288:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6954 00000100:00100000:0.0:1746126611.397973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.398007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.400187:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380352 00000100:00100000:2.0:1746126611.400200:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380352 00000100:00100000:2.0:1746126611.400243:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380224 00000100:00100000:2.0:1746126611.400245:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380224 00000100:00100000:2.0:1746126611.400267:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13347 00000100:00100000:2.0:1746126611.400275:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721380352:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126611.400290:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13348 00010000:00010000:2.0:1746126611.400292:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126611.400303:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1966:x1830945721380224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.400309:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867613050 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7ed expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.400318:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.400331:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867613057 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7e6 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.400362:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721340928:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126611.400372:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721341056:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126611.400449:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.403160:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721379712:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 16956us (17481us total) trans 21474840315 rc 0/0 00000100:00100000:3.0:1746126611.403172:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1733 00002000:00100000:3.0:1746126611.403184:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (708608->1048575) req@ffff88009e3a4000 x1830945721379712/t21474840315(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.403194:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4000 with x1830945721379712 ext(708608->1048575) 00010000:00010000:3.0:1746126611.403204:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 31 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.403222:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 31 pid: 17475 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.403228:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3a4000 00000100:00100000:1.0:1746126611.403240:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac76c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746126611.404023:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126610 -> 1746126611 00002000:00010000:2.0:1746126611.404028:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126610 -> 1746126611 00002000:00010000:2.0:1746126611.404030:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126610 -> 1746126611 00000100:00100000:2.0:1746126611.404049:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721340928:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.404080:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867613050 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ed expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.404093:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093fa1200/0xb50e825867613050 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ed expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.404126:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fa1200, rc 0) 00000100:00100000:2.0:1746126611.404172:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721380352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3897us (6207us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.404325:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13347 00000100:00100000:0.0:1746126611.408999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:1.0:1746126611.409119:0:9686:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126610 -> 1746126611 00002000:00010000:1.0:1746126611.409123:0:9686:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126610 -> 1746126611 00002000:00010000:1.0:1746126611.409125:0:9686:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126610 -> 1746126611 00000100:00100000:1.0:1746126611.409142:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721341056:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126611.409169:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867613057 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7e6 expref: 34 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.409185:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867613057 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7e6 expref: 34 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.409198:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb600, rc 0) 00000100:00100000:1.0:1746126611.409235:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1966:x1830945721380224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8937us (11228us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.409243:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13348 00000100:00100000:2.0:1746126611.409257:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380480 00000100:00100000:2.0:1746126611.409270:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380480 00010000:00010000:2.0:1746126611.409430:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 31 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.409470:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6955 00000100:00100000:2.0:1746126611.409997:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721380480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.410015:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.410034:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 31 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.410047:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 31 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.410068:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f75bc00/0xb50e825867613034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 708608->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ca expref: 31 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.410087:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.410090:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.410109:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.410117:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.410152:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.410163:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721341184:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126611.410250:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.412503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.412609:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721341184:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.412629:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126611.412655:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380736 00000100:00100000:3.0:1746126611.412661:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380736 00000100:00100000:2.0:1746126611.412674:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721380480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3196us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.412684:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6955 00002000:00100000:3.0:1746126611.412701:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (397312->401407) req@ffff880092b17480 x1830945721380736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.412710:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17480 with x1830945721380736 ext(397312->401407) 00002000:00010000:3.0:1746126611.412714:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b17480 00000100:00100000:3.0:1746126611.412732:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7613 00000100:00100000:3.0:1746126611.412738:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1964:x1830945721380736:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126611.413918:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1964:x1830945721380736:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1177us (1421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126611.413926:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7613 00002000:00100000:3.0:1746126611.413932:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (397312->401407) req@ffff880092b17480 x1830945721380736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/4536 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.413939:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17480 with x1830945721380736 ext(397312->401407) 00002000:00010000:3.0:1746126611.413943:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b17480 00000100:00100000:2.0:1746126611.413953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.414009:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380864 00000100:00100000:1.0:1746126611.414019:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380864 00000100:00100000:1.0:1746126611.414058:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13349 00000100:00100000:1.0:1746126611.414065:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721380864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.414078:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.414091:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008daa9200/0xb50e82586761305e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7f4 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.414141:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721341312:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.414222:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a0ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.416042:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721341312:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126611.416071:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008daa9200/0xb50e82586761305e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7f4 expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.416082:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008daa9200/0xb50e82586761305e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7f4 expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.416111:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008daa9200, rc 0) 00000100:00100000:1.0:1746126611.416147:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721380864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2082us (2194us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.416154:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13349 00000100:00100000:0.0:1746126611.419176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.419495:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380992 00000100:00100000:1.0:1746126611.419505:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380992 00000100:00100000:1.0:1746126611.419753:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13350 00000100:00100000:1.0:1746126611.419764:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721380992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.419778:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.419792:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613065 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d7fb expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.420426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.420490:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721341440:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126611.420557:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a0ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.420603:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381120 00000100:00100000:2.0:1746126611.420607:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381120 00000100:00100000:2.0:1746126611.420626:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13351 00000100:00100000:2.0:1746126611.420631:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31178:x1830945721381120:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126611.420637:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.420643:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d802 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.420660:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.420667:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.420668:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126611.420671:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->1204223] (req 1048576->1204223) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.420686:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.420695:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 35 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.420707:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721341568:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.420725:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.427782:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721341440:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126611.427821:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613065 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7fb expref: 20 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.427858:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613065 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7fb expref: 20 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.427878:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008daa9400, rc 0) 00000100:00100000:1.0:1746126611.427918:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721380992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8156us (8751us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126611.427928:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13350 00000100:00100000:0.0:1746126611.428164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.428230:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721341568:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.428244:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->1204223] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.428253:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb200, rc 0) 00000100:00100000:2.0:1746126611.428271:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31178:x1830945721381120:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7640us (7846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.428275:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13351 00000100:00100000:3.0:1746126611.428305:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381248 00000100:00100000:3.0:1746126611.428316:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381248 00002000:00100000:3.0:1746126611.428360:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1253375) req@ffff880092b16300 x1830945721381248/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.428370:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b16300 with x1830945721381248 ext(1048576->1253375) 00010000:00010000:3.0:1746126611.428379:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 36 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.429603:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 36 pid: 17475 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.429612:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b16300 00000100:00100000:3.0:1746126611.429641:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1734 00000100:00100000:3.0:1746126611.429649:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721381248:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126611.434858:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+38:1963:x1830945721381248:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 5178us (6661us total) trans 17179873158 rc 0/0 00000100:00100000:3.0:1746126611.434875:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1734 00002000:00100000:3.0:1746126611.434886:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1253375) req@ffff880092b16300 x1830945721381248/t17179873158(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.434895:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b16300 with x1830945721381248 ext(1048576->1253375) 00010000:00010000:3.0:1746126611.434906:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.434921:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.434927:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b16300 00000100:00100000:0.0:1746126611.448243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.448334:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381376 00000100:00100000:2.0:1746126611.448345:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381376 00010000:00010000:2.0:1746126611.448382:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.448433:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6956 00000100:00100000:2.0:1746126611.448440:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+38:1964:x1830945721381376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.448452:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.448471:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.448482:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.448506:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f75ac00/0xb50e825867613049 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7df expref: 38 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.448588:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.448591:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.448597:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.448605:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.448636:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.448648:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721341696:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126611.449066:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.453036:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721341696:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.453060:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.453114:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+37:1964:x1830945721381376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4673us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.453126:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6956 00000100:00100000:0.0:1746126611.472862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.473227:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381504 00000100:00100000:2.0:1746126611.473237:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381504 00000100:00100000:2.0:1746126611.473299:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8894 00000100:00100000:2.0:1746126611.473307:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31185:x1830945721381504:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.473336:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.473356:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fba00/0xb50e825867613073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d809 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.473416:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473427:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473437:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473447:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473452:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473457:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473557:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.473566:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 20 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.473572:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.473578:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.475016:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.475030:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 233 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.475042:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721341824:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.475690:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 20 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.475698:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 20 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.475705:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721341952:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.475727:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.479598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.479709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.479858:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721341824:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.479871:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721341952:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.479898:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126611.480022:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381760 00000100:00100000:3.0:1746126611.480029:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381760 00000100:00100000:3.0:1746126611.480061:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382016 00000100:00100000:3.0:1746126611.480062:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382016 00000100:00100000:3.0:1746126611.480075:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3748 00000100:00100000:3.0:1746126611.480081:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+234:26822:x1830945721381760:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126611.480322:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+235:26822:x1830945721381760:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 240us (735us total) trans 8589943059 rc 0/0 00000100:00100000:3.0:1746126611.480328:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3748 00000100:00100000:3.0:1746126611.480340:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3749 00000100:00100000:3.0:1746126611.480344:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:27349:x1830945721382016:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126611.480391:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:27349:x1830945721382016:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 46us (683us total) trans 8589943060 rc 0/0 00000100:00100000:3.0:1746126611.480400:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3749 00000100:00100000:0.0:1746126611.482700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.482796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.484052:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382272 00000100:00100000:2.0:1746126611.484063:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382272 00010000:00010000:2.0:1746126611.484110:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 235 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.484140:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382144 00000100:00100000:2.0:1746126611.484143:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382144 00010000:00010000:2.0:1746126611.484154:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 22 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.484168:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6957 00000100:00100000:2.0:1746126611.484173:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+235:1964:x1830945721382272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.484185:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.484191:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 235 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.484200:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 235 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.484219:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b000/0xb50e82586761301f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7bc expref: 235 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.484240:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.484244:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484252:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484256:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484259:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.484294:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+234:1964:x1830945721382272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 121us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.484299:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6957 00000100:00100000:2.0:1746126611.484337:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6958 00000100:00100000:2.0:1746126611.484340:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721382144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.484345:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.484348:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 22 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.484356:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 22 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.484365:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28400/0xb50e825867613003 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7ae expref: 22 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.484371:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.484374:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484379:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484384:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484400:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.484412:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721382144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.484416:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6958 00010000:00010000:2.0:1746126611.484430:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484436:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126611.484471:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126611.484475:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126611.484489:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484498:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484506:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484511:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484516:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484521:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57fbc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126611.484524:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484529:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484536:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126611.484538:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126611.484540:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484544:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fbc00/0xb50e82586761307a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484554:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484559:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484562:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484566:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57fb600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126611.484568:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484571:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484576:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec44d00) 00010000:00010000:2.0:1746126611.484578:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126611.484579:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484583:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb600/0xb50e825867613081 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.484611:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fba00/0xb50e825867613073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.484621:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.484626:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.484628:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126611.484630:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57fb800, rc 0) 00000100:00100000:2.0:1746126611.484665:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31185:x1830945721381504:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 11359us (11839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.484672:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8894 00000100:00100000:0.0:1746126611.487135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.487169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.487198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.487222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.487545:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382400 00000100:00100000:2.0:1746126611.487553:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382400 00000100:00100000:2.0:1746126611.487588:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382528 00000100:00100000:2.0:1746126611.487591:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382528 00000100:00100000:2.0:1746126611.487601:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382656 00000100:00100000:2.0:1746126611.487603:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382656 00000100:00100000:2.0:1746126611.487611:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382784 00000100:00100000:2.0:1746126611.487613:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382784 00000100:00100000:2.0:1746126611.487636:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13352 00000100:00100000:2.0:1746126611.487642:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721382400:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.487659:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.487674:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dc1b400/0xb50e82586761308f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d810 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.487738:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721342080:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126611.487803:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.487823:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13353 00000100:00100000:2.0:1746126611.487856:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721382528:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.487864:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.487874:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f86400/0xb50e825867613096 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d817 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.487897:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342208:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126611.487923:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.487938:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13354 00000100:00100000:2.0:1746126611.487943:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721382656:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.487949:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.487955:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d81e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.487965:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.487966:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.487974:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.487986:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.487995:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f86a00, rc 0) 00000100:00100000:2.0:1746126611.488015:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721382656:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 72us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.488021:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13354 00000100:00100000:2.0:1746126611.488036:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13355 00000100:00100000:2.0:1746126611.488040:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721382784:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.488045:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.488051:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d825 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.488060:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.488061:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.488065:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.488073:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.488080:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f86c00, rc 0) 00000100:00100000:2.0:1746126611.488104:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721382784:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 53us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.488109:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13355 00000100:00100000:2.0:1746126611.489810:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342208:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.489860:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f86400/0xb50e825867613096 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d817 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.489870:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f86400/0xb50e825867613096 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d817 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.489879:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f86400, rc 0) 00000100:00100000:2.0:1746126611.490384:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721382528:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2527us (3211us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.490392:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13353 00000100:00100000:3.0:1746126611.490488:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721342080:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.490503:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dc1b400/0xb50e82586761308f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d810 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.490511:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dc1b400/0xb50e82586761308f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d810 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.490529:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dc1b400, rc 0) 00000100:00100000:3.0:1746126611.490700:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721382400:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3006us (3520us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.490705:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13352 00000100:00100000:0.0:1746126611.493432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.493687:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383040 00000100:00100000:2.0:1746126611.493696:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383040 00000100:00100000:2.0:1746126611.493752:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8895 00000100:00100000:2.0:1746126611.493759:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b19850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31185:x1830945721383040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.493777:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.493796:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86e00/0xb50e8258676130ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d82c expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.493928:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.493942:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.493948:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.493976:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.493988:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 13 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.493998:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721342336:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.494077:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.496014:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721342336:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.496039:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126611.496326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.496657:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383168 00000100:00100000:1.0:1746126611.496663:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383168 00010000:00010000:1.0:1746126611.496695:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 14 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.496978:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6959 00000100:00100000:1.0:1746126611.496987:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721383168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.496999:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.497005:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 14 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.497014:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 14 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.497034:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57fb800/0xb50e825867613088 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d809 expref: 14 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.497053:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.497058:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.497067:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.497074:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.497091:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.497134:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721383168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 149us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.497140:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6959 00010000:00010000:2.0:1746126611.497336:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.497345:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126611.497362:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126611.497497:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86e00/0xb50e8258676130ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.497509:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.497515:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.497518:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126611.497520:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f87000, rc 0) 00000100:00100000:2.0:1746126611.497543:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b19850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31185:x1830945721383040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3785us (4120us total) trans 8589943061 rc 0/0 00000100:00100000:2.0:1746126611.497550:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8895 00000100:00100000:0.0:1746126611.501199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.501295:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383296 00000100:00100000:2.0:1746126611.501304:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383296 00000100:00100000:2.0:1746126611.502532:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8896 00000100:00100000:2.0:1746126611.502545:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31185:x1830945721383296:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.502572:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.502591:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86800/0xb50e8258676130c0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d833 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.502671:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.502685:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.502691:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.502719:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.502729:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 14 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.502745:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721342464:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.503389:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.507029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.507196:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721342464:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.507209:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383424 00000100:00100000:3.0:1746126611.507216:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383424 00010000:00010000:3.0:1746126611.507249:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 15 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.507285:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6960 00000100:00100000:3.0:1746126611.507292:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721383424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126611.507305:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.507310:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 15 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.507320:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 15 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.507347:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87000/0xb50e8258676130b2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d82c expref: 15 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.507371:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.507375:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.507384:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.507391:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.507406:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126611.507409:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.507421:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.507426:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126611.507452:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721383424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.507459:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6960 00000004:00200000:2.0:1746126611.507551:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126611.507556:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126611.507573:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.507602:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86800/0xb50e8258676130c0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d833 expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.507615:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d833 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.507620:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.507622:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126611.507625:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f87200, rc 0) 00000100:00100000:2.0:1746126611.507651:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31185:x1830945721383296:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5111us (6462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.507660:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8896 00000100:00100000:0.0:1746126611.509387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.509956:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383552 00000100:00100000:3.0:1746126611.509965:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383552 00000100:00100000:3.0:1746126611.510010:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13356 00000100:00100000:3.0:1746126611.510018:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721383552:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126611.510033:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.510052:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee07a00/0xb50e8258676130ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d83a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.510114:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721342592:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126611.510199:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.510259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.510331:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383680 00000100:00100000:2.0:1746126611.510335:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383680 00000100:00100000:2.0:1746126611.510354:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13357 00000100:00100000:2.0:1746126611.510358:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721383680:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.510366:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.510377:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f87400/0xb50e8258676130d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d841 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.510403:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342720:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126611.510427:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.513002:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721342592:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.513041:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ee07a00/0xb50e8258676130ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d83a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.513055:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee07a00/0xb50e8258676130ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d83a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.513064:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee07a00, rc 0) 00000100:00100000:2.0:1746126611.513514:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342720:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.513532:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f87400/0xb50e8258676130d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d841 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.513540:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f87400/0xb50e8258676130d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d841 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.513547:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f87400, rc 0) 00000100:00100000:3.0:1746126611.513735:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721383552:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3716us (4354us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126611.513743:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13356 00000100:00100000:2.0:1746126611.513812:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721383680:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3452us (3553us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.513817:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13357 00000100:00100000:0.0:1746126611.516963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.517026:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383936 00000100:00100000:2.0:1746126611.517036:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383936 00000100:00100000:2.0:1746126611.517092:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8897 00000100:00100000:2.0:1746126611.517107:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31185:x1830945721383936:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.517126:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.517144:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87600/0xb50e8258676130dc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d848 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.517243:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.517258:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.517272:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126611.517284:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126611.517397:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87600/0xb50e8258676130dc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 16 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.517413:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.517420:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.517423:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126611.517426:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f87800, rc 0) 00000100:00100000:2.0:1746126611.517480:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31185:x1830945721383936:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 374us (527us total) trans 8589943062 rc 0/0 00000100:00100000:2.0:1746126611.517487:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8897 00000100:00100000:1.0:1746126611.521348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.521378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.521389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.521399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.521419:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384064 00000100:00100000:1.0:1746126611.521428:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384064 00000100:00100000:1.0:1746126611.521471:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384320 00000100:00100000:1.0:1746126611.521473:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384320 00000100:00100000:1.0:1746126611.521483:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384576 00000100:00100000:1.0:1746126611.521484:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384576 00000100:00100000:1.0:1746126611.521491:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384192 00000100:00100000:1.0:1746126611.521492:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384192 00000100:00100000:1.0:1746126611.521502:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13358 00000100:00100000:1.0:1746126611.521508:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721384064:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126611.521550:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.521567:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.521574:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126611.521576:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126611.521579:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.521639:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13359 00000100:00100000:3.0:1746126611.521645:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721384320:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126611.521667:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.521677:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 17 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.521684:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 36 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.521693:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.521697:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.521699:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.521701:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.521725:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.521736:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 15 pid: 4640 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.521748:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342848:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.521822:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 36 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126611.521923:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13360 00000100:00100000:2.0:1746126611.521930:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721384576:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:2.0:1746126611.521947:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.521957:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.521964:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.521970:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.521975:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.521981:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.521986:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126611.521987:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126611.521989:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 8/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.522002:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.522009:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 32 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.522022:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721343104:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.522054:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.522061:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 29 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.522067:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721343232:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.522087:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.522106:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.522113:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721343360:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.522172:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13361 00000100:00100000:0.0:1746126611.522179:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721384192:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126611.522198:0:20294:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522207:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522212:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126611.522213:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126611.522215:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522228:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522234:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 17 pid: 8436 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.522241:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721343488:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.522259:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.522293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.522307:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384448 00000100:00100000:0.0:1746126611.522309:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384448 00000100:00100000:0.0:1746126611.522328:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13362 00000100:00100000:0.0:1746126611.522332:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721384448:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126611.522349:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522358:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522365:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.522372:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.522377:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.522377:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.522379:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522396:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.522403:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.522415:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721343616:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126611.522433:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.522439:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 15 pid: 8437 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.522445:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721343744:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126611.522461:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.522467:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 29 pid: 9686 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.522473:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721343872:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.522485:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.522554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126611.522661:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 36 pid: 4641 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.522671:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342976:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.522696:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 17 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.522702:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 17 pid: 4642 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.522708:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721344000:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.522719:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.522732:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384704 00000100:00100000:3.0:1746126611.522735:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384704 00000100:00100000:3.0:1746126611.522757:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13363 00000100:00100000:3.0:1746126611.522761:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721384704:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126611.522777:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.522785:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.522792:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.522798:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.522802:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.522803:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.522805:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.522816:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.522822:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.522848:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721344128:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.522875:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.522883:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.522890:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721344256:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.522909:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.522916:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 17 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.522923:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721344384:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.522938:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348acc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746126611.523307:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.523321:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.523329:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721344512:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126611.523353:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136a0ef00 going to sleep for 11 seconds 00010000:00010000:2.0:1746126611.523454:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.523462:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 15 pid: 8437 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126611.523471:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721344640:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.523502:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.523510:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 29 pid: 9686 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.523516:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721344768:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.523529:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.530343:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721343872:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.530382:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721343616:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.530408:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721343744:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126611.530438:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.530680:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721343104:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.530689:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721343232:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126611.530890:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721343488:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126611.530904:0:20294:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.530962:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721343360:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.530981:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342848:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.531239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.531255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.531280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.531303:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385344 00000100:00100000:0.0:1746126611.531308:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385344 00010000:00010000:0.0:1746126611.531337:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 16 pid: 8437 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.531355:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385472 00000100:00100000:0.0:1746126611.531357:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385472 00010000:00010000:0.0:1746126611.531365:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 17 pid: 4640 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.531377:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6961 00000100:00100000:0.0:1746126611.531383:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1965:x1830945721385344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.531401:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.531420:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 16 pid: 8437 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.531430:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 16 pid: 8437 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.531449:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f86a00/0xb50e82586761309d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d81e expref: 16 pid: 8437 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.531465:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.531498:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1965:x1830945721385344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.531504:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6961 00000100:00100000:0.0:1746126611.531518:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6962 00000100:00100000:0.0:1746126611.531523:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1965:x1830945721385472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.531531:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.531543:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 17 pid: 4640 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.531551:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 17 pid: 4640 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.531564:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb000/0xb50e825867612bfe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d554 expref: 17 pid: 4640 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.531579:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.531593:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1965:x1830945721385472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.531598:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6962 00000100:00100000:2.0:1746126611.531702:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721344128:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.531711:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721344256:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.531718:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721344384:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.531732:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.531976:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721344640:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.531990:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721342976:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.531996:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721344000:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.532007:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.532033:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385088 00000100:00100000:3.0:1746126611.532036:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385088 00002000:00100000:3.0:1746126611.532063:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1204223) req@ffff8800a5b69880 x1830945721385088/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.532071:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69880 with x1830945721385088 ext(1048576->1204223) 00010000:00010000:3.0:1746126611.532077:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 18 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.532086:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 18 pid: 8436 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.532102:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b69880 00000100:00100000:3.0:1746126611.532116:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1735 00000100:00100000:3.0:1746126611.532121:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721385088:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126611.532387:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721344512:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126611.532406:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.533911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.535344:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385600 00000100:00100000:2.0:1746126611.535355:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385600 00010000:00010000:2.0:1746126611.535390:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 37 pid: 4641 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126611.535415:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6963 00000100:00100000:2.0:1746126611.535422:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721385600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.535434:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.535453:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 37 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.535464:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 37 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.535485:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800933efa00/0xb50e825867612cf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d59a expref: 37 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.535502:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.536487:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721385600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1059us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.536496:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6963 00000100:00100000:3.0:1746126611.538192:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721385088:12345-192.168.203.2@tcp:4:cat.0 Request processed in 6060us (6943us total) trans 17179873159 rc 0/0 00000100:00100000:3.0:1746126611.538204:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1735 00002000:00100000:3.0:1746126611.538216:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1204223) req@ffff8800a5b69880 x1830945721385088/t17179873159(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.538225:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69880 with x1830945721385088 ext(1048576->1204223) 00010000:00010000:3.0:1746126611.538236:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 20 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.538247:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 20 pid: 8436 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126611.538254:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b69880 00000100:00100000:0.0:1746126611.543055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.543084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.543112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.543129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.543146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.543170:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384832 00000100:00100000:0.0:1746126611.543178:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384832 00000100:00100000:2.0:1746126611.543179:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385216 00000100:00100000:2.0:1746126611.543193:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385216 00010000:00010000:2.0:1746126611.543213:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 30 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.543213:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 33 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.543236:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384960 00000100:00100000:0.0:1746126611.543243:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384960 00010000:00010000:0.0:1746126611.543252:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 31 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.543471:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385856 00000100:00100000:2.0:1746126611.543475:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385856 00000100:00100000:0.0:1746126611.543475:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6964 00000100:00100000:0.0:1746126611.543483:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1963:x1830945721384832:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.543486:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 34 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.543495:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126611.543496:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6965 00000100:00100000:2.0:1746126611.543501:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721385216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.543507:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.543517:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 31 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.543518:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.543526:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 31 pid: 9686 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.543527:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093233100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721344768:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126611.543527:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.543547:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997d2e00/0xb50e825867612fd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d784 expref: 31 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.543547:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4bc00/0xb50e825867612eba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2637824->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ce expref: 34 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.543560:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126611.543561:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126611.543562:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.543586:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6966 00000100:00100000:3.0:1746126611.543593:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721384960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126611.543594:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1963:x1830945721384832:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 111us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.543599:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6964 00010000:00010000:3.0:1746126611.543602:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.543612:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 30 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.543620:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 30 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.543631:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5285a00/0xb50e825867612e35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2637824->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d681 expref: 30 pid: 4640 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.543637:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6967 00000100:00100000:0.0:1746126611.543641:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721385856:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126611.543642:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126611.543646:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.543653:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.543661:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.543670:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f09de00/0xb50e825867612fee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7a0 expref: 32 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.543677:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.543679:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.543683:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.543691:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.543707:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.543816:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721385216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 313us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.543822:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6965 00000100:00100000:2.0:1746126611.543883:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385984 00000100:00100000:2.0:1746126611.543886:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385984 00002000:00100000:2.0:1746126611.543910:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (397312->1048575) req@ffff88009e3f5c00 x1830945721385984/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746126611.543986:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721384960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 394us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.543989:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721385856:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 347us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.543990:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.543992:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6966 00000100:00100000:0.0:1746126611.543995:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6967 00000100:00100000:0.0:1746126611.544005:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385728 00000100:00100000:0.0:1746126611.544008:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385728 00010000:00010000:0.0:1746126611.544018:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.544039:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6968 00000100:00100000:0.0:1746126611.544043:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1966:x1830945721385728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126611.544046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126611.544053:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126611.544059:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386240 00000100:00100000:1.0:1746126611.544061:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386240 00010000:00010000:0.0:1746126611.544065:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.544072:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746126611.544081:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 20 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.544083:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29c00/0xb50e825867612ef9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ff expref: 16 pid: 4642 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.544091:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.544110:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6969 00000100:00100000:1.0:1746126611.544115:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721386240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126611.544115:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1966:x1830945721385728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.544120:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6968 00010000:00010000:1.0:1746126611.544122:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.544129:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 20 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.544135:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.544137:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 20 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.544141:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.544153:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4a600/0xb50e825867612dda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d642 expref: 20 pid: 4640 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.544159:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.544165:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126611.544165:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544172:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544178:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebba200 already unused, calling callback (ffffffffa08a5d70) 00000100:00100000:1.0:1746126611.544181:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721386240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 66us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126611.544182:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.544186:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6969 00010000:00010000:0.0:1746126611.544188:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544196:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544202:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebba200/0xb50e82586761310d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.544224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.544235:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386112 00000100:00100000:1.0:1746126611.544238:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386112 00000100:00100000:0.0:1746126611.544239:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721384448:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 21906us (21949us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.544246:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13362 00010000:00010000:1.0:1746126611.544248:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 19 pid: 4642 timeout: 833 lvb_type: 1 00000100:00100000:1.0:1746126611.544270:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6970 00000100:00100000:1.0:1746126611.544275:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721386112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.544281:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.544290:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 19 pid: 4642 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.544291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126611.544296:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 19 pid: 4642 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.544299:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386368 00000100:00100000:0.0:1746126611.544302:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386368 00010000:00010000:1.0:1746126611.544310:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb400/0xb50e825867612bb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d515 expref: 20 pid: 4642 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.544310:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 20 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.544319:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.544320:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746126611.544321:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6971 00010000:00010000:1.0:1746126611.544322:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.544325:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721386368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.544328:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544330:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.544339:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 19 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.544341:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126611.544345:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 19 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.544354:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57fb200/0xb50e82586761306c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d802 expref: 19 pid: 8436 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.544357:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721386112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.544362:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6970 00010000:00010000:0.0:1746126611.544362:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.544363:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.544365:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544371:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.544390:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.544402:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721386368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 77us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.544408:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6971 00000100:00100000:0.0:1746126611.544457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.544467:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386496 00000100:00100000:0.0:1746126611.544469:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386496 00010000:00010000:0.0:1746126611.544478:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 833 lvb_type: 1 00002000:00100000:2.0:1746126611.544627:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5c00 with x1830945721385984 ext(397312->1048575) 00010000:00010000:2.0:1746126611.544639:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 31 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.544647:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 31 pid: 8436 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.544652:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f5c00 00010000:00010000:1.0:1746126611.546001:0:20294:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.546017:0:20294:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.546041:0:20294:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.546047:0:20294:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.546050:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6972 00010000:00010000:1.0:1746126611.546059:0:20294:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.546062:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721386496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.546066:0:20294:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbac00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126611.546069:0:20294:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546073:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.546075:0:20294:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546084:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746126611.546088:0:20294:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546106:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746126611.546109:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbac00/0xb50e825867613106 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546118:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800933ee600/0xb50e825867612e04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d650 expref: 36 pid: 4640 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.546128:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.546129:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.546132:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546139:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546154:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.546168:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721386496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 112us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.546168:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721384192:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 23989us (24766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.546173:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6972 00000100:00100000:1.0:1746126611.546175:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13361 00010000:00010000:2.0:1746126611.546192:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546198:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.546209:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546282:0:4640:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546292:0:4640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546305:0:4640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546309:0:4640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546315:0:4640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546319:0:4640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ee07800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126611.546321:0:4640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546326:0:4640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546334:0:4640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.546338:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee07800/0xb50e8258676130f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.546361:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721384320:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 24717us (24982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.546367:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13359 00000100:00100000:0.0:1746126611.546589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.546600:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386624 00000100:00100000:0.0:1746126611.546606:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386624 00010000:00010000:0.0:1746126611.546621:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.546634:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6973 00000100:00100000:0.0:1746126611.546638:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721386624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.546643:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.546654:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.546660:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.546671:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a35c00/0xb50e825867612fd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d78b expref: 28 pid: 9686 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.546679:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.546687:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721386624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.546691:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6973 00000100:00100000:0.0:1746126611.546717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.546724:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386752 00000100:00100000:0.0:1746126611.546726:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386752 00010000:00010000:0.0:1746126611.546734:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.546745:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6974 00000100:00100000:0.0:1746126611.546748:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721386752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.546754:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.546758:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.546765:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.546774:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f75b200/0xb50e82586761303b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d1 expref: 32 pid: 17475 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.546781:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.546788:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721386752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.546792:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6974 00000100:00100000:0.0:1746126611.546887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.546897:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721386880 00000100:00100000:0.0:1746126611.546899:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721386880 00010000:00010000:0.0:1746126611.546908:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 14 pid: 8437 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.546918:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6975 00000100:00100000:0.0:1746126611.546922:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721386880:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.546927:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.546932:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 14 pid: 8437 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.546944:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 14 pid: 8437 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.546953:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f86c00/0xb50e8258676130a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d825 expref: 14 pid: 8437 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.546959:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.546960:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.546963:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.546969:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.546980:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.546987:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721386880:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.546991:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6975 00010000:00010000:2.0:1746126611.547113:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.547119:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.547124:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ee06c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.547126:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.547132:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.547139:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.547144:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee06c00/0xb50e825867613114 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.547181:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721384704:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 24418us (24626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.547186:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13363 00000100:00100000:2.0:1746126611.547217:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1736 00000100:00100000:2.0:1746126611.547223:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945721385984:12345-192.168.203.2@tcp:4:cat.0 00010000:00010000:3.0:1746126611.548048:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548057:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548075:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548081:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548087:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548092:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f86800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126611.548102:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548108:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548118:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.548123:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f86800/0xb50e8258676130ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.548162:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721384576:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 26231us (26770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.548167:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13360 00000100:00100000:2.0:1746126611.560005:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721385984:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12770us (16880us total) trans 21474840316 rc 0/0 00000100:00100000:2.0:1746126611.560018:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1736 00002000:00100000:2.0:1746126611.560030:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (397312->1048575) req@ffff88009e3f5c00 x1830945721385984/t21474840316(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/448 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.560039:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5c00 with x1830945721385984 ext(397312->1048575) 00010000:00010000:2.0:1746126611.560049:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.561310:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 32 pid: 8436 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.561322:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f5c00 00000100:00100000:0.0:1746126611.562870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.562915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.563025:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387008 00000100:00100000:2.0:1746126611.563035:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387008 00000100:00100000:2.0:1746126611.563070:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387136 00000100:00100000:2.0:1746126611.563072:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387136 00000100:00100000:2.0:1746126611.563085:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13364 00000100:00100000:2.0:1746126611.563092:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721387008:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126611.563106:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13365 00000100:00100000:3.0:1746126611.563116:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721387136:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.563121:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.563127:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.563138:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f86200/0xb50e82586761311b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d84f expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.563142:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d856 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126611.563164:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c713, atime: 0x6813c713, ctime: 0x6813c713, blocks: 0x821 00010000:00010000:3.0:1746126611.563177:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.563178:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.563186:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 36 pid: 4642 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126611.563188:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093230e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721344896:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126611.563200:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 36 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.563210:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee07400, rc 0) 00000100:00100000:3.0:1746126611.563240:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721387136:12345-192.168.203.2@tcp:101:cat.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.563247:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13365 00000100:00100000:2.0:1746126611.563259:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.564241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.564271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.564483:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387392 00000100:00100000:2.0:1746126611.564489:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387392 00000100:00100000:2.0:1746126611.564526:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387648 00000100:00100000:2.0:1746126611.564529:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387648 00000100:00100000:2.0:1746126611.564552:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13366 00000100:00100000:2.0:1746126611.564558:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721387392:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.564571:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.564584:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d864 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.564593:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13367 00000100:00100000:1.0:1746126611.564605:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721387648:12345-192.168.203.2@tcp:101:cat.0 00002000:00010000:2.0:1746126611.564606:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c712, atime: 0x6813c712, ctime: 0x6813c712, blocks: 0x81d 00010000:00010000:1.0:1746126611.564613:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.564621:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.564622:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.564623:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d872 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.564628:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 30 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.564640:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 30 pid: 4640 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746126611.564642:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c712, atime: 0x6813c712, ctime: 0x6813c712, blocks: 0x1029 00010000:00010000:2.0:1746126611.564648:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f86e00, rc 0) 00010000:00010000:1.0:1746126611.564649:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.564650:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.564653:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 37 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.564662:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 37 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.564667:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008daa9400, rc 0) 00000100:00100000:2.0:1746126611.564679:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721387392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 121us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.564680:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+37:1964:x1830945721387648:12345-192.168.203.2@tcp:101:cat.0 Request processed in 82us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.564684:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13366 00000100:00100000:1.0:1746126611.564860:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13367 00000100:00100000:0.0:1746126611.565435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.565472:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387264 00000100:00100000:0.0:1746126611.565475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.565478:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387264 00000100:00100000:3.0:1746126611.565497:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387520 00000100:00100000:3.0:1746126611.565499:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387520 00000100:00100000:3.0:1746126611.565509:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13368 00000100:00100000:3.0:1746126611.565514:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+37:1964:x1830945721387264:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.565522:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.565535:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d85d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126611.565549:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c711, atime: 0x6813c711, ctime: 0x6813c711, blocks: 0x81f 00010000:00010000:3.0:1746126611.565560:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.565561:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.565566:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 38 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.565577:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 38 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.565584:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee07600, rc 0) 00000100:00100000:3.0:1746126611.565606:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+38:1964:x1830945721387264:12345-192.168.203.2@tcp:101:cat.0 Request processed in 93us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.567198:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13369 00000100:00100000:0.0:1746126611.567225:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721387520:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.567244:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.567261:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d86b expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126611.567282:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c712, atime: 0x6813c712, ctime: 0x6813c712, blocks: 0x163f 00010000:00010000:0.0:1746126611.567299:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.567301:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.567308:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 31 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.567319:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 31 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.567327:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb600, rc 0) 00000100:00100000:0.0:1746126611.567362:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721387520:12345-192.168.203.2@tcp:101:cat.0 Request processed in 144us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.567367:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13369 00000100:00100000:0.0:1746126611.567472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126611.567634:0:23766:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff880093230e00 x1830945721344896) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 31 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.567656:0:23766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 31 pid: 8436 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.567673:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613042 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 397312->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d7d8 expref: 31 pid: 8436 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.567687:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093230e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721344896:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126611.567704:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.567706:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.567709:0:23766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567715:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567737:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f86200/0xb50e82586761311b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d84f expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.567745:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f86200/0xb50e82586761311b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d84f expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.567750:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f86200, rc 0) 00000100:00100000:2.0:1746126611.567782:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721387008:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4690us (4920us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126611.567789:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13364 00010000:00010000:2.0:1746126611.567808:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567815:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567854:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567862:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567869:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567875:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008daa8800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.567879:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567886:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567894:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.567899:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008daa8800/0xb50e8258676130f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.567949:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721384064:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 46440us (46609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.567955:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13358 00000100:00100000:3.0:1746126611.568201:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13368 00000100:00100000:1.0:1746126611.568235:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721387776 00000100:00100000:1.0:1746126611.568242:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721387776 00000100:00100000:1.0:1746126611.568280:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 682 00000100:00100000:1.0:1746126611.568286:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721387776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.568296:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.568298:0:11130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b50e825867613042) 00010000:00010000:1.0:1746126611.568299:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.568324:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721387776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 38us (852us total) trans 0 rc 116/116 00000100:00100000:1.0:1746126611.568330:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 682 00000100:00100000:0.0:1746126611.569710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.569791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.569851:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388032 00000100:00100000:3.0:1746126611.569857:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388032 00000100:00100000:3.0:1746126611.570082:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8898 00000100:00100000:3.0:1746126611.570093:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31185:x1830945721388032:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:3.0:1746126611.570153:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746126611.570179:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87200/0xb50e8258676130c7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d833 expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570216:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf200/0xb50e825867612d16 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5c4 expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570227:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.570230:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126611.570257:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.570269:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 20 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570275:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570282:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 20 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570288:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 233 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570294:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570301:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.570327:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570340:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 20 pid: 15560 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.570352:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345024:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.570424:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 233 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570431:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 233 pid: 15560 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.570437:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345152:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.570459:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 20 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570465:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 20 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.570472:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345280:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.570492:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570504:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 233 pid: 14549 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.570511:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345408:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.570535:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 20 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570542:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 20 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.570549:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345536:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.570562:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126611.570578:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388160 00000100:00100000:3.0:1746126611.570581:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388160 00000100:00100000:3.0:1746126611.570607:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13370 00000100:00100000:3.0:1746126611.570612:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:31189:x1830945721388160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.570620:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.570632:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d879 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126611.570649:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c713, atime: 0x6813c713, ctime: 0x6813c713, blocks: 0x7a1 00010000:00010000:3.0:1746126611.570664:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.570665:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.570671:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 30 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570681:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 30 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.570688:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ee06800, rc 0) 00000100:00100000:3.0:1746126611.570710:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+30:31189:x1830945721388160:12345-192.168.203.2@tcp:101:cat.0 Request processed in 99us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.570716:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13370 00000100:00100000:3.0:1746126611.571602:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345024:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126611.571887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.572752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.572864:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345152:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.572872:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345280:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.572878:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345408:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.572883:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721345536:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.572905:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746126611.573214:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388288 00000100:00100000:2.0:1746126611.573220:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388288 00000100:00100000:0.0:1746126611.573231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126611.573248:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 21 pid: 15560 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746126611.573257:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.573275:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388416 00000100:00100000:2.0:1746126611.573277:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388416 00010000:00010000:2.0:1746126611.573286:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 234 pid: 15560 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.573364:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388672 00000100:00100000:2.0:1746126611.573366:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388672 00010000:00010000:2.0:1746126611.573376:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 235 pid: 14549 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.573384:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388544 00000100:00100000:2.0:1746126611.573386:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388544 00010000:00010000:2.0:1746126611.573393:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 22 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.573402:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6976 00000100:00100000:2.0:1746126611.573408:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721388288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126611.573408:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6977 00000100:00100000:0.0:1746126611.573414:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+235:1966:x1830945721388416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126611.573420:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.573421:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.573425:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 22 pid: 15560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.573425:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 235 pid: 15560 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.573434:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 235 pid: 15560 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.573441:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 22 pid: 15560 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.573460:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6978 00000100:00100000:1.0:1746126611.573471:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+235:1966:x1830945721388672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126611.573478:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.573482:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 235 pid: 14549 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.573546:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6979 00000100:00100000:3.0:1746126611.573550:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721388544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126611.573556:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.573559:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 22 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746126611.573651:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3000/0xb50e825867612df6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d649 expref: 235 pid: 15560 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.573655:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867612e90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d6ab expref: 22 pid: 15560 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.573665:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.573670:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.573678:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126611.573690:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 234 pid: 14549 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.573700:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933ef600/0xb50e825867612d0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5bd expref: 234 pid: 14549 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.573711:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721388288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 304us (1825us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126611.573713:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.573716:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746126611.573717:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6976 00010000:00010000:1.0:1746126611.573720:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126611.573734:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+233:1966:x1830945721388672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 269us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.573739:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6978 00010000:00010000:0.0:1746126611.573770:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126611.573774:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.573779:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.573793:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:1966:x1830945721388416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 379us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.573798:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6977 00000100:00100000:1.0:1746126611.573814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.573842:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388800 00000100:00100000:1.0:1746126611.573845:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388800 00010000:00010000:1.0:1746126611.573857:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 21 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126611.573876:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6980 00000100:00100000:1.0:1746126611.573880:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721388800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126611.573882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126611.573886:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126611.573889:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 21 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.573897:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 21 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.573906:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997d3a00/0xb50e825867612d08 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5b6 expref: 21 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126611.573913:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.573915:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.573920:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126611.574011:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 20 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.574022:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867612d1d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d5cb expref: 20 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.574034:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.574037:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.574044:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721388800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 163us (230us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126611.574047:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.574050:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6980 00010000:00010000:3.0:1746126611.574053:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.574070:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721388928 00000100:00100000:1.0:1746126611.574072:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721388928 00010000:00010000:3.0:1746126611.574080:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126611.574109:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721388544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 543us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.574110:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8899 00000100:00100000:3.0:1746126611.574115:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6979 00000100:00100000:1.0:1746126611.574116:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+232:31189:x1830945721388928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126611.574134:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.574144:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d880 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.574167:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.574172:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.574192:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.574199:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.574491:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.574505:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.574516:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.574518:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126611.574521:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 233 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.574527:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008daa9c00, rc 0) 00000100:00100000:1.0:1746126611.574543:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+233:31189:x1830945721388928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 428us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.574549:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8899 00000040:00080000:2.0:1746126611.574746:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2620, 88 off222416 00000004:00080000:2.0:1746126611.574755:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733488927462ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.574807:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2732, 88 off232368 00000004:00080000:2.0:1746126611.574813:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733488985313ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.574998:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2733, 88 off232456 00000004:00080000:2.0:1746126611.575002:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489174435ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575008:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2621, 88 off222504 00000004:00080000:2.0:1746126611.575010:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489183023ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.575025:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2622, 88 off222592 00000004:00080000:2.0:1746126611.575027:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489200015ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.575033:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2734, 88 off232544 00000004:00080000:2.0:1746126611.575035:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489207377ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575040:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2735, 88 off232632 00000004:00080000:2.0:1746126611.575042:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489214477ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575046:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2623, 88 off222680 00000004:00080000:2.0:1746126611.575048:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489220815ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.575054:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2736, 88 off232720 00000004:00080000:2.0:1746126611.575055:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489228090ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575060:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2624, 88 off222768 00000004:00080000:2.0:1746126611.575062:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489234617ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.575066:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2737, 88 off232808 00000004:00080000:2.0:1746126611.575068:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489240814ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575073:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2625, 88 off222856 00000004:00080000:2.0:1746126611.575074:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489247015ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.575079:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2738, 88 off232896 00000004:00080000:2.0:1746126611.575081:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489253270ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575085:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2626, 88 off222944 00000004:00080000:2.0:1746126611.575087:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489259315ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126611.575091:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2739, 88 off232984 00000004:00080000:2.0:1746126611.575102:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489274414ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575108:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2740, 88 off233072 00000004:00080000:2.0:1746126611.575110:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733489283054ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126611.575115:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2627, 88 off223032 00000004:00080000:2.0:1746126611.575117:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733489289669ns, next at 687927188999ns, rc = 0 00000004:00010000:3.0:1746126611.589985:0:14547:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800937b8000 reply state ffff88012d51d800 transno 8589943063 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126611.589999:0:14547:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746126611.590119:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31185:x1830945721388032:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 20024us (20409us total) trans 8589943063 rc 0/0 00000100:00100000:3.0:1746126611.590130:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8898 00000001:00080000:0.0:1746126611.590202:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943053 is committed 00000001:00080000:0.0:1746126611.590211:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943049 is committed 00000001:00080000:0.0:1746126611.590216:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943035 is committed 00000001:00080000:0.0:1746126611.590223:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943051 is committed 00000001:00080000:0.0:1746126611.590232:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943063 is committed 00000004:00080000:0.0:1746126611.590237:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746126611.590242:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2122 committed 00000004:00080000:0.0:1746126611.590247:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2121 committed 00000004:00080000:0.0:1746126611.590249:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746126611.590252:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2120 committed 00000004:00080000:0.0:1746126611.590255:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746126611.590256:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2119 committed 00000004:00080000:0.0:1746126611.590258:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2009 committed 00000004:00080000:0.0:1746126611.590259:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2118 committed 00000004:00080000:0.0:1746126611.590260:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2008 committed 00000004:00080000:0.0:1746126611.590262:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2117 committed 00000004:00080000:0.0:1746126611.590263:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2116 committed 00000004:00080000:0.0:1746126611.590264:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2007 committed 00000004:00080000:0.0:1746126611.590265:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2006 committed 00000004:00080000:0.0:1746126611.590266:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2115 committed 00000004:00080000:0.0:1746126611.590268:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2114 committed 00000004:00080000:0.0:1746126611.590269:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2005 committed 00000001:00080000:0.0:1746126611.590276:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943056 is committed 00000001:00080000:0.0:1746126611.590283:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943054 is committed 00000001:00080000:0.0:1746126611.590296:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943060 is committed 00000001:00080000:0.0:1746126611.590302:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943059 is committed 00000100:00100000:1.0:1746126611.590342:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721345664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.590385:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.590411:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721346176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.590425:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.590439:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746126611.590443:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721345792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.590457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126611.590470:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.590471:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721346304:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126611.590478:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.590484:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126611.590485:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.590491:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ee07c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126611.590495:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.590498:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721345920:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126611.590502:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746126611.590515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126611.590516:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.590519:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746126611.590523:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721346432:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126611.590524:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.590535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126611.590536:0:3281:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.590543:0:3281:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.590546:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126611.590549:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721346048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.590560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126611.590567:0:3281:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.590568:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721346560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.590576:0:3281:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721346688:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126611.590579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.590597:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345664 00000100:00100000:1.0:1746126611.590604:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345664 00000100:00100000:2.0:1746126611.590608:0:3281:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.590622:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346176 00000100:00100000:2.0:1746126611.590624:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346176 00000100:00100000:1.0:1746126611.590629:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345792 00000100:00100000:1.0:1746126611.590631:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345792 00000100:00100000:2.0:1746126611.590637:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346304 00000100:00100000:2.0:1746126611.590639:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346304 00000100:00100000:1.0:1746126611.590639:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721345920 00000100:00100000:1.0:1746126611.590640:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721345920 00000100:00100000:2.0:1746126611.590644:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346432 00000100:00100000:1.0:1746126611.590645:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346048 00000100:00100000:2.0:1746126611.590646:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346432 00000100:00100000:1.0:1746126611.590647:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346048 00000100:00100000:2.0:1746126611.590651:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346560 00000100:00100000:2.0:1746126611.590652:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346560 00000100:00100000:1.0:1746126611.590654:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13371 00000100:00100000:2.0:1746126611.590659:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13372 00000100:00100000:1.0:1746126611.590659:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721345664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.590663:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721346176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.590676:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13373 00000100:00100000:1.0:1746126611.590680:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721345792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.590712:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13374 00000100:00100000:2.0:1746126611.590716:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3296:x1830945721346304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.590755:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13375 00000100:00100000:2.0:1746126611.590759:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3294:x1830945721345920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.590792:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13376 00000100:00100000:2.0:1746126611.590795:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3294:x1830945721346432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126611.590845:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126611.590848:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126611.590850:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126611.590852:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126609 -> 1746126609 00002000:00010000:1.0:1746126611.590854:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746126611.590866:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721346304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (380us total) trans 17179873161 rc 0/0 00000100:00100000:1.0:1746126611.590868:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721345792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (411us total) trans 17179873160 rc 0/0 00000100:00100000:2.0:1746126611.590871:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13374 00000100:00100000:1.0:1746126611.590876:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13373 00000100:00100000:2.0:1746126611.590882:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13377 00000100:00100000:2.0:1746126611.590886:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3294:x1830945721346048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.590887:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13378 00000100:00100000:1.0:1746126611.590890:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3294:x1830945721346560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126611.590951:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746126611.590954:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126610 -> 1746126610 00002000:00010000:2.0:1746126611.590956:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126610 -> 1746126610 00002000:00010000:2.0:1746126611.590957:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126610 -> 1746126610 00002000:00010000:2.0:1746126611.590959:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746126611.590961:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3294:x1830945721346560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (380us total) trans 17179873162 rc 0/0 00000100:00100000:1.0:1746126611.590966:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13378 00000100:00100000:2.0:1746126611.590972:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3294:x1830945721345920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (457us total) trans 17179873163 rc 0/0 00000100:00100000:2.0:1746126611.590976:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13375 00002000:00010000:2.0:1746126611.591038:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746126611.591040:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:2.0:1746126611.591042:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746126611.591044:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:2.0:1746126611.591046:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:2.0:1746126611.591063:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721346176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 399us (637us total) trans 17179873164 rc 0/0 00000100:00100000:2.0:1746126611.591067:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13372 00000004:00080000:2.0:1746126611.591093:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02f800/2, rc 0, transno 17179873160 00000100:00100000:2.0:1746126611.591111:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721345792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126611.591113:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3294:x1830945721346432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (577us total) trans 17179873166 rc 0/0 00000100:00100000:1.0:1746126611.591118:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13376 00000004:00080000:2.0:1746126611.591119:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02ed80/2, rc 0, transno 17179873161 00000100:00100000:2.0:1746126611.591121:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721346304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126611.591127:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02ca80/2, rc 0, transno 17179873164 00000100:00100000:2.0:1746126611.591130:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721346176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126611.591133:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b191880/2, rc 0, transno 17179873162 00000100:00100000:1.0:1746126611.591136:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721346560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126611.591141:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02df80/2, rc 0, transno 17179873163 00000100:00100000:1.0:1746126611.591144:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721345920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126611.591149:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093df4a80/2, rc 0, transno 17179873166 00000100:00100000:1.0:1746126611.591152:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721346432:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126611.591173:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126611.591175:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:1.0:1746126611.591177:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:1.0:1746126611.591179:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:1.0:1746126611.591180:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126611.591197:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721345664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 537us (811us total) trans 17179873165 rc 0/0 00000100:00100000:2.0:1746126611.591203:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3294:x1830945721346048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (642us total) trans 17179873167 rc 0/0 00000100:00100000:1.0:1746126611.591203:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13371 00000100:00100000:2.0:1746126611.591208:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13377 00000100:00100000:2.0:1746126611.591226:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721346816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.591242:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746126611.591255:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02f480/2, rc 0, transno 17179873165 00000100:00100000:2.0:1746126611.591258:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721345664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.591267:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346816 00000100:00100000:2.0:1746126611.591269:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346816 00000100:00100000:2.0:1746126611.591279:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13379 00000100:00100000:2.0:1746126611.591283:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3296:x1830945721346816:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126611.591344:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02c700/2, rc 0, transno 17179873167 00000100:00100000:1.0:1746126611.591349:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721346048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126611.591352:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3296:x1830945721346816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (110us total) trans 17179873168 rc 0/0 00000100:00100000:2.0:1746126611.591357:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13379 00000004:00080000:2.0:1746126611.591371:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093231500/2, rc 0, transno 17179873168 00000100:00100000:2.0:1746126611.591373:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721346816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.591717:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721346944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.591740:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.591751:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721347456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.591763:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.591774:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746126611.591778:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721347328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.591791:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.591800:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721347840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.591812:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.591848:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721346944 00000100:00100000:3.0:1746126611.591856:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721346944 00000100:00100000:3.0:1746126611.591872:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347456 00000100:00100000:3.0:1746126611.591873:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347456 00000100:00100000:3.0:1746126611.591881:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347328 00000100:00100000:3.0:1746126611.591882:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347328 00000100:00100000:3.0:1746126611.591891:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347840 00000100:00100000:3.0:1746126611.591892:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347840 00000100:00100000:3.0:1746126611.591903:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13380 00000100:00100000:3.0:1746126611.591907:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830945721346944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126611.592004:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746126611.592007:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:3.0:1746126611.592009:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:3.0:1746126611.592011:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:3.0:1746126611.592012:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:0.0:1746126611.592021:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13381 00000100:00100000:0.0:1746126611.592027:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721347456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.592032:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721346944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (292us total) trans 21474840317 rc 0/0 00000100:00100000:3.0:1746126611.592037:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13380 00000100:00100000:3.0:1746126611.592046:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13382 00000100:00100000:3.0:1746126611.592049:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830945721347328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.592125:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830945721347328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (332us total) trans 21474840319 rc 0/0 00000100:00100000:0.0:1746126611.592125:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3297:x1830945721347456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (359us total) trans 21474840318 rc 0/0 00000100:00100000:3.0:1746126611.592129:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13382 00000100:00100000:0.0:1746126611.592131:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13381 00000100:00100000:3.0:1746126611.592138:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13383 00000100:00100000:3.0:1746126611.592141:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830945721347840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.592207:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721347840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (393us total) trans 21474840320 rc 0/0 00000100:00100000:3.0:1746126611.592212:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13383 00000100:00100000:1.0:1746126611.592247:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126611.592269:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.592281:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126611.592295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.592305:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126611.592309:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126611.592323:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.592333:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126611.592345:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126611.592359:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347072 00000100:00100000:1.0:1746126611.592361:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347072 00000100:00100000:1.0:1746126611.592374:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347584 00000100:00100000:1.0:1746126611.592375:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347584 00000100:00100000:1.0:1746126611.592381:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347200 00000100:00100000:1.0:1746126611.592383:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347200 00000100:00100000:1.0:1746126611.592388:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721347712 00000100:00100000:1.0:1746126611.592390:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721347712 00000100:00100000:1.0:1746126611.592397:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13384 00000100:00100000:1.0:1746126611.592401:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3294:x1830945721347072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126611.592470:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126611.592473:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126610 -> 1746126610 00002000:00010000:1.0:1746126611.592474:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126610 -> 1746126610 00002000:00010000:1.0:1746126611.592476:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126610 -> 1746126610 00002000:00010000:1.0:1746126611.592478:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746126611.592488:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13385 00000100:00100000:0.0:1746126611.592494:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721347584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126611.592497:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721347072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (227us total) trans 21474840321 rc 0/0 00000100:00100000:1.0:1746126611.592504:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13384 00000100:00100000:1.0:1746126611.592512:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13386 00000100:00100000:1.0:1746126611.592516:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3294:x1830945721347200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126611.592550:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13387 00000100:00100000:0.0:1746126611.592554:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721347712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126611.592585:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00000100:00100000:0.0:1746126611.592586:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3294:x1830945721347584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (290us total) trans 21474840322 rc 0/0 00002000:00010000:1.0:1746126611.592588:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126610 -> 1746126610 00002000:00010000:1.0:1746126611.592589:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126610 -> 1746126610 00002000:00010000:1.0:1746126611.592591:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126610 -> 1746126610 00000100:00100000:0.0:1746126611.592591:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13385 00002000:00010000:1.0:1746126611.592593:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:1.0:1746126611.592607:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721347200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (283us total) trans 21474840323 rc 0/0 00000100:00100000:1.0:1746126611.592612:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13386 00000004:00080000:1.0:1746126611.592630:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6d80/2, rc 0, transno 21474840323 00000100:00100000:1.0:1746126611.592634:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126611.592640:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af5180/2, rc 0, transno 21474840321 00000100:00100000:1.0:1746126611.592643:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126611.592648:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af5500/2, rc 0, transno 21474840322 00000100:00100000:1.0:1746126611.592650:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126611.592671:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721347712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (325us total) trans 21474840324 rc 0/0 00000100:00100000:0.0:1746126611.592676:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13387 00000004:00080000:1.0:1746126611.592680:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098d99f80/2, rc 0, transno 21474840324 00000100:00100000:1.0:1746126611.592682:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721347712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126611.593442:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6300/2, rc 0, transno 21474840319 00000100:00100000:3.0:1746126611.593446:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721347328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126611.593452:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098d9aa00/2, rc 0, transno 21474840320 00000100:00100000:3.0:1746126611.593454:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721347840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126611.593459:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af7b80/2, rc 0, transno 21474840317 00000100:00100000:3.0:1746126611.593461:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721346944:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126611.593465:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6680/2, rc 0, transno 21474840318 00000100:00100000:3.0:1746126611.593467:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721347456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126611.593855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.593926:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389056 00000100:00100000:3.0:1746126611.593931:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389056 00000100:00100000:3.0:1746126611.593962:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8900 00000100:00100000:3.0:1746126611.593968:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31185:x1830945721389056:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126611.593984:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.594001:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d887 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.594052:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.594063:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.594077:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.594079:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126611.594082:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a35c00, rc 0) 00000100:00100000:3.0:1746126611.594127:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31185:x1830945721389056:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 159us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.594133:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8900 00000100:00100000:2.0:1746126611.594194:0:3281:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721346688:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.594214:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.594220:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ee07c00/0xb50e825867613145 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126611.594629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.594718:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389184 00000100:00100000:2.0:1746126611.594722:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389184 00000100:00100000:2.0:1746126611.594745:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3750 00000100:00100000:2.0:1746126611.594750:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:31189:x1830945721389184:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:2.0:1746126611.594822:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:31189:x1830945721389184:12345-192.168.203.2@tcp:49:cat.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.594846:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3750 00000100:00100000:0.0:1746126611.596891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.597063:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389312 00000100:00100000:3.0:1746126611.597071:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389312 00000100:00100000:3.0:1746126611.597118:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8901 00000100:00100000:3.0:1746126611.597125:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31185:x1830945721389312:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126611.597142:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.597161:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35a00/0xb50e825867613161 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d88e expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.597236:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867613168 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.597252:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867613168 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.597262:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867613168 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126611.597286:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126611.597290:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126611.597304:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867613168 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.597326:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35a00/0xb50e825867613161 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d88e expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.597339:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867613168 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d88e expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.597346:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.597350:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126611.597354:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093222200, rc 0) 00000100:00100000:3.0:1746126611.597393:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31185:x1830945721389312:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 268us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.597398:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8901 00000100:00100000:0.0:1746126611.599817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.599863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.599886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.599900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.599912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.599921:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389440 00000100:00100000:2.0:1746126611.599930:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389440 00000100:00100000:0.0:1746126611.599936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.599951:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389696 00000100:00100000:0.0:1746126611.599953:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389696 00000100:00100000:2.0:1746126611.599961:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389952 00000100:00100000:2.0:1746126611.599963:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389952 00000100:00100000:0.0:1746126611.599967:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389568 00000100:00100000:0.0:1746126611.599968:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389568 00000100:00100000:2.0:1746126611.599973:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721389824 00000100:00100000:2.0:1746126611.599974:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721389824 00000100:00100000:0.0:1746126611.599977:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721390080 00000100:00100000:0.0:1746126611.599978:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721390080 00000100:00100000:2.0:1746126611.599987:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13388 00000100:00100000:0.0:1746126611.600092:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13389 00000100:00100000:0.0:1746126611.600106:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721389696:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:3.0:1746126611.600107:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13390 00000100:00100000:3.0:1746126611.600114:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721389952:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126611.600122:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.600122:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.600138:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8b1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.600138:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8a3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.600157:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.600157:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.600159:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.600159:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.600167:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.600167:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.600181:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.600181:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126611.600191:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a34200, rc 0) 00010000:00010000:0.0:1746126611.600191:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebba400, rc 0) 00000100:00100000:2.0:1746126611.600223:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721389440:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126611.600229:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.600236:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d895 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.600246:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.600247:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.600252:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.600261:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.600267:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d935800, rc 0) 00000100:00100000:1.0:1746126611.600291:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13391 00000100:00100000:1.0:1746126611.600297:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721389568:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126611.600303:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.600310:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d89c expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.600319:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.600321:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.600324:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 16 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.600332:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 16 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.600338:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b238800, rc 0) 00000100:00100000:0.0:1746126611.600358:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13392 00000100:00100000:1.0:1746126611.600361:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721389568:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 64us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.600362:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721389824:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:1.0:1746126611.600366:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13391 00010000:00010000:0.0:1746126611.600367:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.600374:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8aa expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.600380:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13393 00010000:00010000:0.0:1746126611.600382:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.600383:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126611.600384:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721390080:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126611.600387:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.600388:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126611.600393:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8b8 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.600395:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.600401:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.600402:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.600402:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb800, rc 0) 00010000:00010000:1.0:1746126611.600405:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 16 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126611.600413:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 16 pid: 9686 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126611.600414:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721389824:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 52us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.600418:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13392 00010000:00010000:1.0:1746126611.600424:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b239800, rc 0) 00000100:00100000:1.0:1746126611.600434:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721390080:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 50us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.600435:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1964:x1830945721389696:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 331us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.600438:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13393 00000100:00100000:0.0:1746126611.600441:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13389 00000100:00100000:2.0:1746126611.600503:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721389440:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 510us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.600508:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13388 00000100:00100000:3.0:1746126611.600704:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721389952:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 590us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.600709:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13390 00000100:00100000:0.0:1746126611.605587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.605626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.605655:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721390592 00000100:00100000:2.0:1746126611.605665:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721390592 00000100:00100000:0.0:1746126611.605670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:2.0:1746126611.605718:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3f6300 x1830945721390592/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.605729:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6300 with x1830945721390592 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.605734:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6300 00000100:00100000:2.0:1746126611.605750:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721390336 00000100:00100000:2.0:1746126611.605752:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721390336 00002000:00100000:2.0:1746126611.605762:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e3f4700 x1830945721390336/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.605768:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4700 with x1830945721390336 ext(0->1048575) 00002000:00010000:2.0:1746126611.605771:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4700 00000100:00100000:2.0:1746126611.605777:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721390848 00000100:00100000:2.0:1746126611.605779:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721390848 00002000:00100000:2.0:1746126611.605787:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e3f7b80 x1830945721390848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.605792:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7b80 with x1830945721390848 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.605795:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f7b80 00000100:00100000:2.0:1746126611.605820:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7614 00000100:00100000:2.0:1746126611.605848:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+39:1964:x1830945721390592:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126611.607190:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7615 00000100:00100000:2.0:1746126611.607200:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721390336:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126611.608697:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7616 00000100:00100000:3.0:1746126611.608710:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+40:1964:x1830945721390848:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.612187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.612349:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721391104 00000100:00100000:1.0:1746126611.612362:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721391104 00002000:00100000:1.0:1746126611.612405:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008dad3800 x1830945721391104/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.612415:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3800 with x1830945721391104 ext(1048576->2097151) 00002000:00010000:1.0:1746126611.612420:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad3800 00000100:00100000:1.0:1746126611.612432:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721391488 00000100:00100000:1.0:1746126611.612434:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721391488 00000100:00100000:1.0:1746126611.612444:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721391744 00000100:00100000:1.0:1746126611.612445:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721391744 00000100:00100000:1.0:1746126611.612452:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721392256 00000100:00100000:1.0:1746126611.612454:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721392256 00000100:00100000:1.0:1746126611.612462:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721391872 00000100:00100000:1.0:1746126611.612465:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721391872 00000100:00100000:1.0:1746126611.612471:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721392128 00000100:00100000:1.0:1746126611.612473:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721392128 00000100:00100000:1.0:1746126611.612479:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721392384 00000100:00100000:1.0:1746126611.612480:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721392384 00000100:00100000:1.0:1746126611.612488:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721391616 00000100:00100000:1.0:1746126611.612490:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721391616 00000100:00100000:1.0:1746126611.612497:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721392512 00000100:00100000:1.0:1746126611.612498:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721392512 00000100:00100000:1.0:1746126611.612507:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7617 00000100:00100000:1.0:1746126611.612513:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721391104:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.614739:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7618 00000100:00100000:0.0:1746126611.614753:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945721391488:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126611.614792:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.614806:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.614808:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.614814:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.614838:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.616238:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7619 00000100:00100000:1.0:1746126611.616250:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1964:x1830945721391744:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126611.616281:0:21461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.616291:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.616293:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.616296:0:21461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.616308:0:21461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.617335:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7620 00000100:00100000:3.0:1746126611.617345:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1964:x1830945721392256:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126611.617370:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.617377:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.617379:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.617381:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.617390:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.617681:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7621 00000100:00100000:1.0:1746126611.617688:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1964:x1830945721391872:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126611.617703:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.617714:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.617715:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126611.617718:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.617724:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.618161:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7622 00000100:00100000:2.0:1746126611.618169:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1964:x1830945721392128:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126611.618188:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.618194:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.618196:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.618198:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.618206:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.619451:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7623 00000100:00100000:2.0:1746126611.619461:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:1964:x1830945721392384:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126611.619486:0:21460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.619495:0:21460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.619496:0:21460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.619498:0:21460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.619509:0:21460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.626193:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+40:1964:x1830945721390592:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20355us (20605us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.626204:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7614 00002000:00100000:2.0:1746126611.626215:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3f6300 x1830945721390592/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.626224:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6300 with x1830945721390592 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.626230:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6300 00000100:00100000:2.0:1746126611.626256:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7624 00000100:00100000:2.0:1746126611.626265:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:1963:x1830945721391616:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126611.626295:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.626308:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.626310:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.626315:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.626326:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.633646:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721390336:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26436us (28007us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126611.633659:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7615 00002000:00100000:3.0:1746126611.633669:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e3f4700 x1830945721390336/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.633679:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4700 with x1830945721390336 ext(0->1048575) 00002000:00010000:3.0:1746126611.633685:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4700 00000100:00100000:3.0:1746126611.633713:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7625 00000100:00100000:3.0:1746126611.633723:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+21:1964:x1830945721392512:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126611.633756:0:21464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.633771:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.633773:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126611.633778:0:21464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.633796:0:21464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.643842:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+38:1964:x1830945721390848:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35108us (38142us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126611.643855:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7616 00002000:00100000:3.0:1746126611.643867:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e3f7b80 x1830945721390848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.643876:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7b80 with x1830945721390848 ext(1048576->2097151) 00002000:00010000:3.0:1746126611.643882:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f7b80 00010000:00010000:1.0:1746126611.645156:0:21462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.645167:0:21462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.645175:0:21462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.645180:0:21462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbae00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126611.645183:0:21462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.645190:0:21462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.645204:0:21462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.645209:0:21462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613199 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.645805:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+20:1964:x1830945721391488:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 31055us (33586us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.645814:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7618 00000100:00100000:1.0:1746126611.655514:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721391104:12345-192.168.203.2@tcp:3:cat.0 Request processed in 42988us (43326us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.655525:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7617 00002000:00100000:1.0:1746126611.655536:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008dad3800 x1830945721391104/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.655545:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3800 with x1830945721391104 ext(1048576->2097151) 00002000:00010000:1.0:1746126611.655550:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad3800 00010000:00010000:1.0:1746126611.657039:0:21461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.657056:0:21461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.657064:0:21461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.657070:0:21461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f87e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126611.657074:0:21461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.657082:0:21461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.657116:0:21461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126611.657122:0:21461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f87e00/0xb50e8258676131a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.657525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.659632:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721392896 00000100:00100000:3.0:1746126611.659646:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721392896 00000100:00100000:3.0:1746126611.659699:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8902 00000100:00100000:3.0:1746126611.659707:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31191:x1830945721392896:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126611.659729:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.659748:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135775000/0xb50e8258676131d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8bf expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.659877:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.659890:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.659900:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.659913:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.659918:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.659924:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.660028:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.660039:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.660046:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.660076:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.660088:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 8 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.660112:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721347968:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.660194:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126611.660363:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1964:x1830945721391744:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 44116us (48130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.660377:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7619 00010000:00010000:2.0:1746126611.668968:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.668991:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.668999:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.669006:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d935e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.669010:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.669017:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.669036:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.669042:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d935e00/0xb50e8258676131b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669870:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669879:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669885:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669891:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135774800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126611.669893:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669903:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669913:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.669919:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135774800/0xb50e8258676131a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.670011:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+21:1964:x1830945721392256:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 52661us (57761us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126611.670022:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7620 00000100:00100000:2.0:1746126611.670263:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1964:x1830945721392128:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 52094us (57992us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.670270:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7622 00000100:00100000:3.0:1746126611.678071:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721347968:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.678108:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126611.680409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.680665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.681001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.681316:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721393024 00000100:00100000:3.0:1746126611.681326:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721393024 00010000:00010000:3.0:1746126611.681365:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 9 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.681395:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6981 00000100:00100000:3.0:1746126611.681402:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721393024:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126611.681415:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.681421:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 9 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.681433:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 9 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.681456:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676130e3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d848 expref: 9 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.681528:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721394304 00000100:00100000:2.0:1746126611.681532:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721394304 00000100:00100000:2.0:1746126611.681567:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8903 00000100:00100000:2.0:1746126611.681572:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31195:x1830945721394304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.681595:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.681608:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934a00/0xb50e8258676131ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8c6 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126611.681741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.681767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.681784:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721393280 00000100:00100000:1.0:1746126611.681787:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721393280 00002000:00100000:1.0:1746126611.681814:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dad2a00 x1830945721393280/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.681823:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad2a00 with x1830945721393280 ext(2097152->3145727) 00002000:00010000:1.0:1746126611.681847:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad2a00 00000100:00100000:1.0:1746126611.681858:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721393536 00000100:00100000:1.0:1746126611.681861:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721393536 00002000:00100000:1.0:1746126611.681869:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008dabb800 x1830945721393536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.681875:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb800 with x1830945721393536 ext(3145728->4194303) 00002000:00010000:1.0:1746126611.681877:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabb800 00000100:00100000:1.0:1746126611.681886:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721393792 00000100:00100000:1.0:1746126611.681888:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721393792 00002000:00100000:1.0:1746126611.681897:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dabb100 x1830945721393792/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.681904:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb100 with x1830945721393792 ext(2097152->3145727) 00002000:00010000:1.0:1746126611.681906:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dabb100 00000100:00100000:1.0:1746126611.681919:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7626 00000100:00100000:1.0:1746126611.681925:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721393280:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.683336:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7627 00000100:00100000:1.0:1746126611.683345:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721393536:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.684373:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7628 00000100:00100000:0.0:1746126611.684384:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+38:1966:x1830945721393792:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:3.0:1746126611.684522:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.684528:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684540:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684546:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684570:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126611.684604:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721393024:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3202us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.684611:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6981 00010000:00010000:3.0:1746126611.684643:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684650:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126611.684665:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126611.684798:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684804:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684810:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684815:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135775600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126611.684818:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684838:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684847:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.684849:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126611.684852:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684856:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135775600/0xb50e8258676131e6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684874:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684879:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684882:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684886:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135775200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126611.684887:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684891:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684896:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126611.684898:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126611.684899:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684903:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135775200/0xb50e8258676131d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684909:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684913:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684917:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684920:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135775400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126611.684922:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684925:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684930:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005900) 00010000:00010000:3.0:1746126611.684931:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126611.684932:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684936:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135775400/0xb50e8258676131df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.684975:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135775000/0xb50e8258676131d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8bf expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.684982:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135775000/0xb50e8258676131d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8bf expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.684987:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135775000, rc 0) 00000100:00100000:3.0:1746126611.685003:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31191:x1830945721392896:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 25299us (27483us total) trans 8589943064 rc 301/301 00000100:00100000:3.0:1746126611.685008:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8902 00000100:00100000:3.0:1746126611.685063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.686114:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721394048 00000100:00100000:3.0:1746126611.686124:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721394048 00002000:00100000:3.0:1746126611.686155:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880091da3b80 x1830945721394048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.686164:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3b80 with x1830945721394048 ext(3145728->4194303) 00002000:00010000:3.0:1746126611.686170:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da3b80 00000100:00100000:3.0:1746126611.686194:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7629 00000100:00100000:3.0:1746126611.686200:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+40:1966:x1830945721394048:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:2.0:1746126611.688519:0:21460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.688535:0:21460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.688543:0:21460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.688549:0:21460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d934e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.688553:0:21460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.688560:0:21460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.688578:0:21460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.688584:0:21460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e8258676131bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.688666:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945721392384:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 69203us (76377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.688679:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7623 00010000:00010000:2.0:1746126611.688715:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688728:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688742:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688754:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688760:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688765:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688924:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688932:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.688937:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126611.688945:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126611.689023:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689028:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689035:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689038:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d934600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126611.689041:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689044:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689050:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.689053:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126611.689055:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689059:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934600/0xb50e825867613209 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689067:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689071:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689076:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689079:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d934000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126611.689081:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689085:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689102:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126611.689104:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126611.689106:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689110:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934000/0xb50e8258676131fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689115:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689119:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689122:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689125:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d934400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126611.689127:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689130:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689135:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093949000) 00010000:00010000:2.0:1746126611.689136:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126611.689138:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689141:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934400/0xb50e825867613202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.689185:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934a00/0xb50e8258676131ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8c6 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.689192:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d934a00/0xb50e8258676131ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8c6 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.689199:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d934a00, rc 0) 00000100:00100000:2.0:1746126611.689218:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31195:x1830945721394304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7646us (8817us total) trans 8589943065 rc 301/301 00000100:00100000:2.0:1746126611.689223:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8903 00010000:00010000:2.0:1746126611.694086:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.694111:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.694119:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.694126:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f86600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.694130:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.694138:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.694153:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.694159:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f86600/0xb50e8258676131ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.694218:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1964:x1830945721391872:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 76524us (81957us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.694228:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7621 00010000:00010000:2.0:1746126611.698117:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.698136:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.698144:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.698151:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d934c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.698155:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.698164:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.698183:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.698190:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d934c00/0xb50e8258676131c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.699002:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721391616:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 72733us (86696us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.699013:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7624 00010000:00010000:2.0:1746126611.702462:0:21464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.702477:0:21464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.702485:0:21464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.702491:0:21464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135774a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126611.702495:0:21464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.702501:0:21464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.702517:0:21464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.702523:0:21464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135774a00/0xb50e8258676131ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.702599:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721392512:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 68873us (90264us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.702609:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7625 00000100:00100000:1.0:1746126611.707471:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721393280:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25537us (26460us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.707483:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7626 00002000:00100000:1.0:1746126611.707495:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dad2a00 x1830945721393280/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.707503:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad2a00 with x1830945721393280 ext(2097152->3145727) 00002000:00010000:1.0:1746126611.707509:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad2a00 00000100:00100000:2.0:1746126611.712015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.712152:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721394560 00000100:00100000:3.0:1746126611.712163:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721394560 00000100:00100000:3.0:1746126611.712210:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8904 00000100:00100000:3.0:1746126611.712218:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31185:x1830945721394560:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:3.0:1746126611.712273:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.712302:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093222200/0xb50e825867613168 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d88e expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.712322:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.712327:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126611.712366:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.712378:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.712386:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00010000:3.0:1746126611.712552:0:14547:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093230e00 reply state ffff88008eba6000 transno 8589943066 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126611.712559:0:14547:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746126611.712629:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31185:x1830945721394560:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 410us (623us total) trans 8589943066 rc 0/0 00000100:00100000:3.0:1746126611.712634:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8904 00000100:00100000:1.0:1746126611.713971:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+40:1966:x1830945721393792:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29585us (32197us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.713981:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7628 00002000:00100000:1.0:1746126611.713989:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dabb100 x1830945721393792/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.713998:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb100 with x1830945721393792 ext(2097152->3145727) 00002000:00010000:1.0:1746126611.714003:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dabb100 00000100:00100000:1.0:1746126611.722543:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721393536:12345-192.168.203.2@tcp:3:cat.0 Request processed in 39185us (40787us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.722557:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7627 00002000:00100000:1.0:1746126611.722571:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008dabb800 x1830945721393536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.722579:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb800 with x1830945721393536 ext(3145728->4194303) 00002000:00010000:1.0:1746126611.722585:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabb800 00000100:00100000:0.0:1746126611.723046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.723108:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721394816 00000100:00100000:2.0:1746126611.723116:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721394816 00000100:00100000:2.0:1746126611.723164:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3751 00000100:00100000:2.0:1746126611.723170:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31195:x1830945721394816:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126611.723371:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31195:x1830945721394816:12345-192.168.203.2@tcp:35:cat.0 Request processed in 200us (325us total) trans 8589943067 rc 0/0 00000100:00100000:2.0:1746126611.723377:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3751 00000100:00100000:0.0:1746126611.723405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126611.723477:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.723485:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.723492:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.723498:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e3bfc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126611.723502:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.723508:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.723523:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126611.723526:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126611.723530:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126611.723535:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfc00/0xb50e825867613217 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746126611.723622:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721394944 00000100:00100000:2.0:1746126611.723626:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721394944 00000100:00100000:2.0:1746126611.723646:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13394 00000100:00100000:2.0:1746126611.723651:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721394944:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126611.723778:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746126611.723781:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.723783:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.723785:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.723787:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:2.0:1746126611.723803:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721394944:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 152us (398us total) trans 21474840325 rc 0/0 00000100:00100000:2.0:1746126611.724029:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13394 00000100:00100000:3.0:1746126611.724817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.724858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.724870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.724881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.724918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.724969:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395072 00000100:00100000:2.0:1746126611.724973:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395072 00000100:00100000:2.0:1746126611.724990:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395200 00000100:00100000:2.0:1746126611.724991:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395200 00000100:00100000:2.0:1746126611.724999:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395328 00000100:00100000:2.0:1746126611.725000:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395328 00000100:00100000:2.0:1746126611.725009:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395456 00000100:00100000:2.0:1746126611.725010:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395456 00000100:00100000:2.0:1746126611.725017:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395584 00000100:00100000:2.0:1746126611.725020:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395584 00000100:00100000:2.0:1746126611.725031:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13395 00000100:00100000:2.0:1746126611.725035:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721395072:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126611.725144:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126611.725147:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.725149:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.725151:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.725153:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126611.725154:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+38:1966:x1830945721394048:12345-192.168.203.2@tcp:3:cat.0 Request processed in 38954us (40090us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126611.725161:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7629 00000100:00100000:2.0:1746126611.725164:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945721395072:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 129us (350us total) trans 17179873169 rc 0/0 00002000:00100000:0.0:1746126611.725168:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880091da3b80 x1830945721394048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126611.725169:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13395 00002000:00100000:0.0:1746126611.725176:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3b80 with x1830945721394048 ext(3145728->4194303) 00000100:00100000:2.0:1746126611.725178:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13396 00002000:00010000:0.0:1746126611.725180:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da3b80 00000100:00100000:2.0:1746126611.725182:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721395200:12345-192.168.203.2@tcp:2:lfs.0 00000100:00100000:0.0:1746126611.725201:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13397 00000100:00100000:0.0:1746126611.725207:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1963:x1830945721395328:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126611.725240:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126611.725242:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126609 -> 1746126611 00002000:00010000:2.0:1746126611.725244:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126609 -> 1746126611 00002000:00010000:2.0:1746126611.725245:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126609 -> 1746126611 00002000:00010000:2.0:1746126611.725247:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746126611.725260:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945721395200:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 78us (402us total) trans 17179873170 rc 0/0 00000100:00100000:2.0:1746126611.725265:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13396 00000100:00100000:2.0:1746126611.725273:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13398 00000100:00100000:2.0:1746126611.725277:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721395456:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126611.725284:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126611.725286:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126610 -> 1746126611 00002000:00010000:0.0:1746126611.725289:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126610 -> 1746126611 00002000:00010000:0.0:1746126611.725290:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126610 -> 1746126611 00002000:00010000:0.0:1746126611.725292:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746126611.725305:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721395328:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 99us (434us total) trans 21474840326 rc 0/0 00000100:00100000:0.0:1746126611.725310:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13397 00000100:00100000:0.0:1746126611.725319:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13399 00000100:00100000:0.0:1746126611.725323:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721395584:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:2.0:1746126611.725327:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:2.0:1746126611.725329:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126610 -> 1746126611 00002000:00010000:2.0:1746126611.725331:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126610 -> 1746126611 00002000:00010000:2.0:1746126611.725333:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126610 -> 1746126611 00002000:00010000:2.0:1746126611.725335:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:2.0:1746126611.725348:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1963:x1830945721395456:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 70us (465us total) trans 21474840327 rc 0/0 00000100:00100000:2.0:1746126611.725352:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13398 00002000:00010000:0.0:1746126611.725377:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126611.725379:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126610 -> 1746126611 00002000:00010000:0.0:1746126611.725381:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126610 -> 1746126611 00002000:00010000:0.0:1746126611.725383:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126610 -> 1746126611 00002000:00010000:0.0:1746126611.725384:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126611.725398:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945721395584:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 74us (479us total) trans 17179873171 rc 0/0 00000100:00100000:0.0:1746126611.725403:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13399 00000100:00100000:0.0:1746126611.728015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.728103:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395712 00000100:00100000:3.0:1746126611.728112:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395712 00000100:00100000:3.0:1746126611.728154:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8905 00000100:00100000:3.0:1746126611.728161:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31195:x1830945721395712:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.728185:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.728204:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bec00/0xb50e82586761321e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8cd expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.728284:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.728297:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.728308:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126611.728334:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126611.728338:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126611.728352:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126611.728376:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bec00/0xb50e82586761321e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.728396:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.728403:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.728406:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126611.728409:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bfa00, rc 0) 00000100:00100000:3.0:1746126611.728450:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31195:x1830945721395712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 289us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.728456:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8905 00000100:00100000:1.0:1746126611.729139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.729193:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721395968 00000100:00100000:0.0:1746126611.729197:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721395968 00000100:00100000:0.0:1746126611.729224:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8906 00000100:00100000:0.0:1746126611.729230:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31196:x1830945721395968:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126611.729239:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.729249:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093050600/0xb50e82586761322c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8d4 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.729558:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729567:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729576:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729586:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729590:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729595:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729701:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729710:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729716:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746126611.729725:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126611.729875:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729882:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729889:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729893:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093050c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126611.729897:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729903:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729912:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126611.729914:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126611.729917:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729921:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093050c00/0xb50e825867613241 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729949:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729954:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729959:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729963:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093050800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126611.729965:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729970:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729980:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126611.729981:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126611.729983:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729987:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093050800/0xb50e825867613233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.729997:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730001:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730005:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730008:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093050a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126611.730010:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730015:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730021:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec44b00) 00010000:00010000:0.0:1746126611.730022:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126611.730024:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730028:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093050a00/0xb50e82586761323a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.730066:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093050600/0xb50e82586761322c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8d4 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.730074:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093050600/0xb50e82586761322c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8d4 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.730082:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093050600, rc 0) 00000100:00100000:0.0:1746126611.730151:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31196:x1830945721395968:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 920us (1011us total) trans 8589943068 rc 301/301 00000100:00100000:0.0:1746126611.730157:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8906 00000100:00100000:3.0:1746126611.733108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.733252:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396224 00000100:00100000:0.0:1746126611.733264:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396224 00000100:00100000:0.0:1746126611.733309:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3752 00000100:00100000:0.0:1746126611.733317:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb1e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31185:x1830945721396224:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1746126611.736376:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb1e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31185:x1830945721396224:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 3050us (3274us total) trans 8589943069 rc 0/0 00000100:00100000:0.0:1746126611.736387:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3752 00000100:00100000:2.0:1746126611.737203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.740268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.740302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.740316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.740605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.740670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.740683:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396352 00000100:00100000:0.0:1746126611.740692:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396352 00000100:00100000:0.0:1746126611.740731:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396480 00000100:00100000:0.0:1746126611.740733:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396480 00000100:00100000:0.0:1746126611.740754:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396608 00000100:00100000:0.0:1746126611.740756:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396608 00000100:00100000:0.0:1746126611.740770:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396736 00000100:00100000:0.0:1746126611.740772:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396736 00000100:00100000:0.0:1746126611.740780:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396864 00000100:00100000:0.0:1746126611.740782:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396864 00000100:00100000:0.0:1746126611.740794:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13400 00000100:00100000:0.0:1746126611.740801:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1966:x1830945721396352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.740820:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.740850:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8db expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.740874:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.740876:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.740884:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 34 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.740897:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 34 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.740907:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093051400, rc 0) 00000100:00100000:0.0:1746126611.740944:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721396352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 144us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.740949:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13400 00000100:00100000:0.0:1746126611.740963:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13401 00000100:00100000:0.0:1746126611.740967:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721396480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.740972:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.740980:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8e2 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.740989:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.740990:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.740993:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741001:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741007:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093050c00, rc 0) 00000100:00100000:0.0:1746126611.741018:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721396480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.741022:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13401 00000100:00100000:0.0:1746126611.741027:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13402 00000100:00100000:0.0:1746126611.741031:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721396608:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.741035:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.741038:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8e9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.741045:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.741047:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.741050:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741056:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741061:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093050400, rc 0) 00000100:00100000:0.0:1746126611.741069:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721396608:12345-192.168.203.2@tcp:101:cat.0 Request processed in 38us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.741072:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13402 00000100:00100000:0.0:1746126611.741077:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13403 00000100:00100000:0.0:1746126611.741080:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1966:x1830945721396736:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.741086:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.741090:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8f0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.741108:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.741109:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.741112:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 34 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741119:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 34 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741124:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093050e00, rc 0) 00000100:00100000:0.0:1746126611.741134:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721396736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 53us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.741137:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13403 00000100:00100000:0.0:1746126611.741144:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13404 00000100:00100000:0.0:1746126611.741147:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1966:x1830945721396864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126611.741151:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126611.741156:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8f7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.741162:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.741163:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.741166:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 34 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741173:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 34 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126611.741179:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093051000, rc 0) 00000100:00100000:0.0:1746126611.741187:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721396864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.741191:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13404 00000100:00100000:2.0:1746126611.741561:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721396992 00000100:00100000:2.0:1746126611.741565:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721396992 00000100:00100000:2.0:1746126611.741583:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13405 00000100:00100000:2.0:1746126611.741588:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721396992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126611.741594:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.741601:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d8fe expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.741611:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.741612:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.741617:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.741625:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.741637:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d934e00, rc 0) 00000100:00100000:2.0:1746126611.741657:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721396992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 69us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.741661:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13405 00000100:00100000:2.0:1746126611.741713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.741791:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721397248 00000100:00100000:0.0:1746126611.741794:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721397248 00002000:00100000:0.0:1746126611.741821:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009ed4bb80 x1830945721397248/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126611.741846:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4bb80 with x1830945721397248 ext(4194304->4976639) 00002000:00010000:0.0:1746126611.741850:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4bb80 00000100:00100000:0.0:1746126611.741863:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7630 00000100:00100000:0.0:1746126611.741869:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721397248:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.747773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.748560:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721397504 00000100:00100000:0.0:1746126611.748569:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721397504 00000100:00100000:0.0:1746126611.748626:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3753 00000100:00100000:0.0:1746126611.748634:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31185:x1830945721397504:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1746126611.748865:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31185:x1830945721397504:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 230us (1098us total) trans 8589943070 rc 0/0 00000100:00100000:0.0:1746126611.748871:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3753 00000100:00100000:2.0:1746126611.771395:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721397248:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29514us (29670us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126611.771408:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7630 00002000:00100000:2.0:1746126611.771421:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009ed4bb80 x1830945721397248/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.771430:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4bb80 with x1830945721397248 ext(4194304->4976639) 00002000:00010000:2.0:1746126611.771435:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4bb80 00000100:00100000:0.0:1746126611.778704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.778764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.778816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.778886:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721397888 00000100:00100000:0.0:1746126611.778892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.778897:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721397888 00002000:00100000:1.0:1746126611.778950:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800937b9180 x1830945721397888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.778960:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9180 with x1830945721397888 ext(0->1048575) 00002000:00010000:1.0:1746126611.778969:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9180 00000100:00100000:1.0:1746126611.778985:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721398144 00000100:00100000:1.0:1746126611.778987:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721398144 00002000:00100000:1.0:1746126611.778999:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012ddadc00 x1830945721398144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746126611.779003:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721398272 00002000:00100000:1.0:1746126611.779005:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddadc00 with x1830945721398144 ext(1048576->2097151) 00000100:00100000:3.0:1746126611.779006:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721398272 00002000:00010000:1.0:1746126611.779008:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddadc00 00000100:00100000:1.0:1746126611.779016:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721398528 00000100:00100000:1.0:1746126611.779017:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721398528 00002000:00100000:3.0:1746126611.779020:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880136a81180 x1830945721398272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.779025:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e3f5180 x1830945721398528/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.779026:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81180 with x1830945721398272 ext(1048576->2097151) 00002000:00010000:3.0:1746126611.779029:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a81180 00002000:00100000:1.0:1746126611.779030:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5180 with x1830945721398528 ext(1048576->2097151) 00002000:00010000:1.0:1746126611.779033:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5180 00000100:00100000:3.0:1746126611.779042:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7631 00000100:00100000:1.0:1746126611.779052:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7632 00000100:00100000:1.0:1746126611.779058:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721398144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.779073:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7633 00000100:00100000:0.0:1746126611.779080:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721398272:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126611.780325:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+35:1966:x1830945721397888:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.780327:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7634 00000100:00100000:1.0:1746126611.780333:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+35:1966:x1830945721398528:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.802584:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721398144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23514us (23809us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.802597:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7632 00002000:00100000:1.0:1746126611.802608:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012ddadc00 x1830945721398144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.802617:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddadc00 with x1830945721398144 ext(1048576->2097151) 00002000:00010000:1.0:1746126611.802623:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddadc00 00000100:00100000:2.0:1746126611.810808:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721398272:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31715us (31980us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.810820:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7633 00002000:00100000:2.0:1746126611.810843:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880136a81180 x1830945721398272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.810853:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81180 with x1830945721398272 ext(1048576->2097151) 00002000:00010000:2.0:1746126611.810859:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a81180 00000100:00100000:0.0:1746126611.811325:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+36:1966:x1830945721398528:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30989us (32429us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126611.811332:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7634 00002000:00100000:0.0:1746126611.811338:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e3f5180 x1830945721398528/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126611.811418:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5180 with x1830945721398528 ext(1048576->2097151) 00002000:00010000:0.0:1746126611.811422:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5180 00010000:00010000:0.0:1746126611.815002:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746126611.815646:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721397888:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36587us (36945us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126611.815656:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7631 00002000:00100000:3.0:1746126611.815669:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800937b9180 x1830945721397888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.815677:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9180 with x1830945721397888 ext(0->1048575) 00002000:00010000:3.0:1746126611.815683:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9180 00000100:00100000:0.0:1746126611.829402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.829509:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721398784 00000100:00100000:2.0:1746126611.829521:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721398784 00000100:00100000:2.0:1746126611.829581:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8907 00000100:00100000:2.0:1746126611.829589:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31191:x1830945721398784:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126611.829617:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.829621:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126611.829649:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008daa9c00/0xb50e825867613153 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d880 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.829686:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.829691:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126611.829702:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b600/0xb50e825867613279 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d905 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.829754:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.829772:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.829778:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.829784:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.829814:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.829854:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 10 pid: 14548 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.829866:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721348096:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.829972:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.831327:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 9 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.831345:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721348224:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.831419:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.836266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.836304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.836330:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721399040 00000100:00100000:3.0:1746126611.836340:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721399040 00010000:00010000:3.0:1746126611.836377:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 10 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.836396:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721348096:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.836407:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721348224:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.836414:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721398912 00000100:00100000:3.0:1746126611.836417:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721398912 00010000:00010000:3.0:1746126611.836425:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 11 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.836434:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126611.836438:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6982 00000100:00100000:3.0:1746126611.836443:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721399040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126611.836456:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.836462:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 10 pid: 14547 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126611.836464:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6983 00000100:00100000:2.0:1746126611.836468:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721398912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126611.836471:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 10 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.836475:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126611.836478:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 11 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.836585:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35c00/0xb50e82586761315a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d887 expref: 10 pid: 14547 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.836586:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 11 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.836597:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa00/0xb50e825867613225 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8cd expref: 11 pid: 14548 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126611.836611:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.836616:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.836625:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.836630:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126611.836780:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.836783:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126611.836797:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126611.836812:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126611.836817:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126611.837155:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721399040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 709us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.837161:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6982 00000100:00100000:2.0:1746126611.837286:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721398912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 817us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.837292:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6983 00000040:00080000:3.0:1746126611.837762:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2628, 88 off223120 00000004:00080000:3.0:1746126611.837767:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733751939161ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.837817:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2741, 88 off233160 00000004:00080000:3.0:1746126611.837820:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733751992729ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.837855:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2742, 88 off233248 00000004:00080000:3.0:1746126611.837859:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752031532ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.837949:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2629, 88 off223208 00000004:00080000:3.0:1746126611.837953:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752125680ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.837962:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2630, 88 off223296 00000004:00080000:3.0:1746126611.837966:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752138185ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.837973:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2743, 88 off233336 00000004:00080000:3.0:1746126611.837976:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752148725ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.837992:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2744, 88 off233424 00000004:00080000:3.0:1746126611.837995:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752167564ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.838001:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2631, 88 off223384 00000004:00080000:3.0:1746126611.838004:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752176966ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.838012:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2745, 88 off233512 00000004:00080000:3.0:1746126611.838015:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752187255ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.838021:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2632, 88 off223472 00000004:00080000:3.0:1746126611.838024:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752196221ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.838029:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2746, 88 off233600 00000004:00080000:3.0:1746126611.838031:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752204124ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.838038:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2633, 88 off223560 00000004:00080000:3.0:1746126611.838041:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752213194ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.838046:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2747, 88 off233688 00000004:00080000:3.0:1746126611.838048:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752221040ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.838055:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2634, 88 off223648 00000004:00080000:3.0:1746126611.838057:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752229695ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126611.838063:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2748, 88 off233776 00000004:00080000:3.0:1746126611.838065:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752237614ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.838071:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2749, 88 off233864 00000004:00080000:3.0:1746126611.838074:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733752246420ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126611.838080:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2635, 88 off223736 00000004:00080000:3.0:1746126611.838083:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733752255422ns, next at 687927188999ns, rc = 0 00000100:00100000:0.0:1746126611.848584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.848627:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721399296 00000100:00100000:0.0:1746126611.848638:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721399296 00002000:00100000:0.0:1746126611.848694:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e8cad80 x1830945721399296/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126611.848705:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cad80 with x1830945721399296 ext(2097152->3145727) 00002000:00010000:0.0:1746126611.848710:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8cad80 00000100:00100000:0.0:1746126611.848745:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7635 00000100:00100000:0.0:1746126611.848754:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721399296:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.854049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.854082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.854613:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721399552 00000100:00100000:1.0:1746126611.854623:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721399552 00002000:00100000:1.0:1746126611.854666:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012b163800 x1830945721399552/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.854676:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163800 with x1830945721399552 ext(3145728->4194303) 00002000:00010000:1.0:1746126611.854681:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b163800 00000100:00100000:1.0:1746126611.854704:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721399808 00000100:00100000:1.0:1746126611.854706:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721399808 00002000:00100000:1.0:1746126611.854721:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012b162680 x1830945721399808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.854728:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b162680 with x1830945721399808 ext(2097152->3145727) 00002000:00010000:1.0:1746126611.854730:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b162680 00000100:00100000:1.0:1746126611.854744:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7636 00000100:00100000:1.0:1746126611.854751:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+36:1964:x1830945721399552:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126611.854946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.855072:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721400064 00000100:00100000:2.0:1746126611.855076:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721400064 00002000:00100000:2.0:1746126611.855101:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012b163b80 x1830945721400064/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.855107:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163b80 with x1830945721400064 ext(3145728->4194303) 00002000:00010000:2.0:1746126611.855109:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b163b80 00000100:00100000:2.0:1746126611.855120:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7637 00000100:00100000:2.0:1746126611.855125:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721399808:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126611.856432:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7638 00000100:00100000:2.0:1746126611.856443:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721400064:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126611.882962:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+36:1964:x1830945721399552:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28201us (28909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.882974:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7636 00002000:00100000:1.0:1746126611.882987:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012b163800 x1830945721399552/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.882996:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163800 with x1830945721399552 ext(3145728->4194303) 00002000:00010000:1.0:1746126611.883002:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b163800 00000100:00100000:1.0:1746126611.883392:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721399296:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34640us (34819us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126611.883398:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7635 00002000:00100000:1.0:1746126611.883403:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e8cad80 x1830945721399296/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126611.883410:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cad80 with x1830945721399296 ext(2097152->3145727) 00002000:00010000:1.0:1746126611.883413:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8cad80 00000100:00100000:2.0:1746126611.891600:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721399808:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36465us (37508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.891611:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7637 00002000:00100000:2.0:1746126611.891623:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012b162680 x1830945721399808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.891630:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b162680 with x1830945721399808 ext(2097152->3145727) 00002000:00010000:2.0:1746126611.891636:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b162680 00000100:00100000:1.0:1746126611.892112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.892171:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721400192 00000100:00100000:3.0:1746126611.892179:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721400192 00000100:00100000:3.0:1746126611.892227:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8908 00000100:00100000:3.0:1746126611.892233:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31195:x1830945721400192:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.892253:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.892271:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d90c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.892325:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.892333:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.892348:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126611.892365:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.892377:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126611.892380:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126611.892383:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.892389:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb200, rc 0) 00000100:00100000:3.0:1746126611.892411:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31195:x1830945721400192:12345-192.168.203.2@tcp:101:cat.0 Request processed in 178us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.892417:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8908 00000100:00100000:2.0:1746126611.901233:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721400064:12345-192.168.203.2@tcp:3:cat.0 Request processed in 44778us (46271us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.901247:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7638 00002000:00100000:2.0:1746126611.901263:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012b163b80 x1830945721400064/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.901274:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163b80 with x1830945721400064 ext(3145728->4194303) 00002000:00010000:2.0:1746126611.901280:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b163b80 00010000:00010000:2.0:1746126611.902949:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.902962:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126611.902965:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746126611.902970:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.902977:0:14547:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.902984:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.903017:0:14547:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126611.903028:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721348352:192.168.203.2@tcp:105: 00000001:00080000:0.0:1746126611.903374:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943070 is committed 00000001:00080000:0.0:1746126611.903386:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943068 is committed 00000001:00080000:0.0:1746126611.903398:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943071 is committed 00000004:00080000:0.0:1746126611.903402:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2020 committed 00000004:00080000:0.0:1746126611.903409:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2131 committed 00000004:00080000:0.0:1746126611.903414:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2130 committed 00000004:00080000:0.0:1746126611.903416:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2019 committed 00000004:00080000:0.0:1746126611.903417:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2129 committed 00000004:00080000:0.0:1746126611.903419:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746126611.903420:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2128 committed 00000004:00080000:0.0:1746126611.903422:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2017 committed 00000004:00080000:0.0:1746126611.903423:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2127 committed 00000004:00080000:0.0:1746126611.903424:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2016 committed 00000004:00080000:0.0:1746126611.903426:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2126 committed 00000004:00080000:0.0:1746126611.903427:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2125 committed 00000004:00080000:0.0:1746126611.903429:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2015 committed 00000004:00080000:0.0:1746126611.903430:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746126611.903432:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2124 committed 00000004:00080000:0.0:1746126611.903433:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2123 committed 00000004:00080000:0.0:1746126611.903435:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2013 committed 00000100:00100000:0.0:1746126611.903564:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721348608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126611.903601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126611.903626:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348608 00000100:00100000:0.0:1746126611.903632:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348608 00000100:00100000:0.0:1746126611.903662:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13406 00000100:00100000:0.0:1746126611.903667:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3294:x1830945721348608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126611.903871:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126611.903875:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.903877:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.903879:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.903880:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746126611.903921:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3294:x1830945721348608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (317us total) trans 21474840328 rc 0/0 00000100:00100000:0.0:1746126611.903928:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13406 00000100:00100000:2.0:1746126611.904550:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.904564:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721348864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904584:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126611.904643:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5955180/2, rc 0, transno 21474840328 00000100:00100000:0.0:1746126611.904650:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721348608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126611.904657:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721349120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904747:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721349376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904772:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126611.904792:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746126611.904799:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721348480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904821:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126611.904867:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721348992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904891:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126611.904921:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721348736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904945:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126611.904964:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721349248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.904988:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126611.905023:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348864 00000100:00100000:2.0:1746126611.905028:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348864 00000100:00100000:2.0:1746126611.905053:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349376 00000100:00100000:2.0:1746126611.905057:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349376 00000100:00100000:2.0:1746126611.905072:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348480 00000100:00100000:2.0:1746126611.905075:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348480 00000100:00100000:2.0:1746126611.905091:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348992 00000100:00100000:2.0:1746126611.905107:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348992 00000100:00100000:2.0:1746126611.905124:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721348736 00000100:00100000:2.0:1746126611.905127:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721348736 00000100:00100000:2.0:1746126611.905144:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349248 00000100:00100000:2.0:1746126611.905147:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349248 00000100:00100000:2.0:1746126611.905159:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13407 00000100:00100000:2.0:1746126611.905165:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721348864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.905322:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721348864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (734us total) trans 21474840329 rc 0/0 00000100:00100000:2.0:1746126611.905328:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13407 00000100:00100000:2.0:1746126611.905347:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13408 00000100:00100000:2.0:1746126611.905353:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721349376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.905469:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721349376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (694us total) trans 21474840330 rc 0/0 00000100:00100000:2.0:1746126611.905476:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13408 00000100:00100000:2.0:1746126611.905490:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13409 00000100:00100000:2.0:1746126611.905495:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721348480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126611.905593:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746126611.905597:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.905598:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.905600:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.905602:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:2.0:1746126611.905628:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721348480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (806us total) trans 21474840331 rc 0/0 00000100:00100000:2.0:1746126611.905635:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13409 00000100:00100000:2.0:1746126611.905648:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13410 00000100:00100000:2.0:1746126611.905653:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3296:x1830945721348992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.905763:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3296:x1830945721348992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (870us total) trans 21474840332 rc 0/0 00000100:00100000:2.0:1746126611.905769:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13410 00000100:00100000:2.0:1746126611.905782:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13411 00000100:00100000:2.0:1746126611.905788:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3295:x1830945721348736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126611.905917:0:20294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:2.0:1746126611.905921:0:20294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.905923:0:20294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.905925:0:20294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:2.0:1746126611.905926:0:20294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:2.0:1746126611.905961:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3295:x1830945721348736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (1014us total) trans 21474840333 rc 0/0 00000100:00100000:2.0:1746126611.905968:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13411 00000100:00100000:2.0:1746126611.905980:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13412 00000100:00100000:2.0:1746126611.905987:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3295:x1830945721349248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126611.906122:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3295:x1830945721349248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (1131us total) trans 21474840334 rc 0/0 00000100:00100000:2.0:1746126611.906128:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13412 00000004:00080000:2.0:1746126611.906187:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5956300/2, rc 0, transno 21474840333 00000100:00100000:2.0:1746126611.906193:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721348736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126611.906203:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5957b80/2, rc 0, transno 21474840334 00000100:00100000:2.0:1746126611.906207:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721349248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126611.906223:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b162d80/2, rc 0, transno 21474840331 00000100:00100000:2.0:1746126611.906225:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721348480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126611.906231:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5955f80/2, rc 0, transno 21474840332 00000100:00100000:2.0:1746126611.906233:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721348992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126611.906241:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5954e00/2, rc 0, transno 21474840329 00000100:00100000:2.0:1746126611.906244:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721348864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126611.906251:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f57800/2, rc 0, transno 21474840330 00000100:00100000:2.0:1746126611.906254:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721349376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.906511:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721349504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.906546:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.906573:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721350016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.906595:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.906614:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746126611.906620:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721349888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.906642:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.906661:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721350400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.906682:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.906712:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349504 00000100:00100000:3.0:1746126611.906717:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349504 00000100:00100000:3.0:1746126611.906748:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350016 00000100:00100000:3.0:1746126611.906752:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350016 00000100:00100000:3.0:1746126611.906769:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349888 00000100:00100000:3.0:1746126611.906773:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349888 00000100:00100000:3.0:1746126611.906785:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350400 00000100:00100000:3.0:1746126611.906787:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350400 00000100:00100000:3.0:1746126611.906797:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13413 00000100:00100000:3.0:1746126611.906803:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3297:x1830945721349504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126611.906973:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126611.906977:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:3.0:1746126611.906979:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:3.0:1746126611.906981:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:3.0:1746126611.906982:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746126611.907017:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830945721349504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (470us total) trans 17179873172 rc 0/0 00000100:00100000:3.0:1746126611.907023:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13413 00000100:00100000:3.0:1746126611.907038:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13414 00000100:00100000:3.0:1746126611.907046:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3297:x1830945721350016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126611.907161:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746126611.907165:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126611.907167:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746126611.907168:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126611.907170:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746126611.907198:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830945721350016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (601us total) trans 17179873173 rc 0/0 00000100:00100000:3.0:1746126611.907204:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13414 00000100:00100000:3.0:1746126611.907216:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13415 00000100:00100000:3.0:1746126611.907221:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3297:x1830945721349888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.907336:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830945721349888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (691us total) trans 17179873174 rc 0/0 00000100:00100000:3.0:1746126611.907342:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13415 00000100:00100000:3.0:1746126611.907355:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13416 00000100:00100000:3.0:1746126611.907362:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3297:x1830945721350400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.907470:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830945721350400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (785us total) trans 17179873175 rc 0/0 00000100:00100000:3.0:1746126611.907476:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13416 00000004:00080000:3.0:1746126611.907516:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e2300/2, rc 0, transno 17179873174 00000100:00100000:3.0:1746126611.907527:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721349888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126611.907539:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131d54700/2, rc 0, transno 17179873175 00000100:00100000:3.0:1746126611.907542:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721350400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126611.907549:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e1f80/2, rc 0, transno 17179873172 00000100:00100000:3.0:1746126611.907552:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721349504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126611.907558:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135ed0000/2, rc 0, transno 17179873173 00000100:00100000:3.0:1746126611.907561:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721350016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.907604:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721350528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.907630:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126611.907660:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350528 00000100:00100000:3.0:1746126611.907665:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350528 00000100:00100000:3.0:1746126611.907688:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13417 00000100:00100000:3.0:1746126611.907694:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+72:3297:x1830945721350528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126611.907815:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3297:x1830945721350528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (183us total) trans 17179873176 rc 0/0 00000100:00100000:3.0:1746126611.907820:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13417 00000004:00080000:3.0:1746126611.907883:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d4000/2, rc 0, transno 17179873176 00000100:00100000:3.0:1746126611.907888:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721350528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.908015:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126611.908049:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721349632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.908075:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126611.908105:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721350144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.908128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126611.908147:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126611.908154:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721349760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.908177:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126611.908194:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721350272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.908215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126611.908232:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349120 00000100:00100000:0.0:1746126611.908235:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349120 00000100:00100000:0.0:1746126611.908255:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349632 00000100:00100000:0.0:1746126611.908258:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349632 00000100:00100000:0.0:1746126611.908274:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13418 00000100:00100000:0.0:1746126611.908280:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3294:x1830945721349120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126611.908428:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3294:x1830945721349120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (413us total) trans 21474840335 rc 0/0 00000100:00100000:0.0:1746126611.908434:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13418 00000100:00100000:0.0:1746126611.908575:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350144 00000100:00100000:0.0:1746126611.908579:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350144 00000100:00100000:0.0:1746126611.908597:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721349760 00000100:00100000:0.0:1746126611.908600:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721349760 00000100:00100000:0.0:1746126611.908612:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721350272 00000100:00100000:0.0:1746126611.908615:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721350272 00000100:00100000:0.0:1746126611.908629:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13419 00000100:00100000:0.0:1746126611.908634:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3294:x1830945721349632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126611.908739:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126611.908743:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.908744:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.908746:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.908748:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126611.908776:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3294:x1830945721349632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (700us total) trans 17179873177 rc 0/0 00000100:00100000:0.0:1746126611.908782:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13419 00000100:00100000:0.0:1746126611.908795:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13420 00000100:00100000:0.0:1746126611.908801:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3294:x1830945721350144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.908945:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3294:x1830945721350144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (815us total) trans 17179873178 rc 0/0 00000100:00100000:0.0:1746126611.908952:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13420 00000100:00100000:0.0:1746126611.908965:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13421 00000100:00100000:0.0:1746126611.908972:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3294:x1830945721349760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126611.909066:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126611.909070:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.909072:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.909073:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126611 -> 1746126611 00002000:00010000:0.0:1746126611.909075:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126611.909114:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3294:x1830945721349760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (936us total) trans 17179873179 rc 0/0 00000100:00100000:0.0:1746126611.909120:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13421 00000100:00100000:0.0:1746126611.909133:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13422 00000100:00100000:0.0:1746126611.909139:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3294:x1830945721350272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126611.909235:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3294:x1830945721350272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1018us total) trans 17179873180 rc 0/0 00000100:00100000:0.0:1746126611.909240:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13422 00000004:00080000:0.0:1746126611.909279:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e2a00/2, rc 0, transno 17179873179 00000100:00100000:0.0:1746126611.909284:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721349760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126611.909294:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131d57800/2, rc 0, transno 17179873180 00000100:00100000:0.0:1746126611.909297:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721350272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126611.909304:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e3800/2, rc 0, transno 17179873177 00000100:00100000:0.0:1746126611.909307:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721349632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126611.909314:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135ed2a00/2, rc 0, transno 17179873178 00000100:00100000:0.0:1746126611.909317:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721350144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126611.909327:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5954700/2, rc 0, transno 21474840335 00000100:00100000:0.0:1746126611.909330:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721349120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126611.911577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126611.911702:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721400320 00000100:00100000:1.0:1746126611.911712:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721400320 00000100:00100000:1.0:1746126611.911759:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3754 00000100:00100000:1.0:1746126611.911768:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31195:x1830945721400320:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:1.0:1746126611.911972:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31195:x1830945721400320:12345-192.168.203.2@tcp:49:cat.0 Request processed in 203us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126611.911979:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3754 00000100:00100000:0.0:1746126611.912697:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721348352:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126611.912745:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75b600/0xb50e825867613279 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 223 pid: 14547 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746126611.912794:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 222 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.912821:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75bc00, rc 0) 00000100:00100000:0.0:1746126611.912881:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+222:31191:x1830945721398784:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 83291us (83488us total) trans 8589943071 rc 0/0 00000100:00100000:0.0:1746126611.912888:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8907 00000100:00100000:0.0:1746126611.941641:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.941754:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721400448 00000100:00100000:2.0:1746126611.941763:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721400448 00000100:00100000:2.0:1746126611.941807:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13423 00000100:00100000:2.0:1746126611.941815:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+38:31191:x1830945721400448:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126611.941866:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126611.941885:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d913 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.941911:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 39 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.941920:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.941927:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.941932:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.941934:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126611.941937:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2785280->3145727] (req 2785280->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 39 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126611.941966:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.941977:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 17 pid: 9686 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126611.941989:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721350656:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.942778:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.942788:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 19 pid: 4641 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126611.942798:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721350784:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126611.943575:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 39 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126611.943584:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 39 pid: 20294 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126611.943593:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721350912:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.943621:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126611.944935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.945799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.945887:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721400576 00000100:00100000:3.0:1746126611.945895:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721400576 00000100:00100000:2.0:1746126611.945908:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721350656:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.945917:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721350784:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126611.945923:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721350912:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.945929:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 18 pid: 9686 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.945950:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2785280->3145727] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 39 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126611.945961:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721400704 00000100:00100000:3.0:1746126611.945963:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721400704 00010000:00010000:2.0:1746126611.945965:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75aa00, rc 0) 00010000:00010000:3.0:1746126611.945973:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 40 pid: 20294 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.945994:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6984 00000100:00100000:2.0:1746126611.945997:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+40:31191:x1830945721400448:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4184us (4368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.946000:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1965:x1830945721400576:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746126611.946004:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13423 00010000:00010000:3.0:1746126611.946011:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126611.946031:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 18 pid: 9686 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.946040:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 18 pid: 9686 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.946060:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b239800/0xb50e825867613192 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b8 expref: 18 pid: 9686 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.946070:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6985 00010000:00010000:3.0:1746126611.946072:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.946076:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+39:1966:x1830945721400704:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.946082:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126611.946088:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1965:x1830945721400576:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 89us (1158us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126611.946090:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 39 pid: 20294 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.946104:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6984 00010000:00010000:0.0:1746126611.946108:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 39 pid: 20294 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.946119:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008daa9400/0xb50e825867613130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d872 expref: 39 pid: 20294 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.946138:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126611.946151:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+38:1966:x1830945721400704:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126611.946156:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6985 00000100:00100000:0.0:1746126611.957634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.957670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126611.958028:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721401088 00000100:00100000:2.0:1746126611.958039:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721401088 00002000:00100000:2.0:1746126611.958088:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a4f55880 x1830945721401088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.958112:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55880 with x1830945721401088 ext(3145728->4194303) 00002000:00010000:2.0:1746126611.958117:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f55880 00000100:00100000:2.0:1746126611.958144:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721401344 00000100:00100000:2.0:1746126611.958146:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721401344 00002000:00100000:2.0:1746126611.958159:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a4f55f80 x1830945721401344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.958165:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55f80 with x1830945721401344 ext(3145728->4194303) 00010000:00010000:2.0:1746126611.958173:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 20 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126611.958186:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 20 pid: 4641 timeout: 833 lvb_type: 1 00002000:00010000:2.0:1746126611.958192:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f55f80 00000100:00100000:2.0:1746126611.958207:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1737 00000100:00100000:2.0:1746126611.958213:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721401344:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126611.959549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.960527:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721401216 00000100:00100000:3.0:1746126611.960535:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721401216 00002000:00100000:3.0:1746126611.960576:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a4f55c00 x1830945721401216/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.960586:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55c00 with x1830945721401216 ext(2097152->3145727) 00010000:00010000:3.0:1746126611.960594:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 22 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.960605:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 22 pid: 4641 timeout: 833 lvb_type: 1 00002000:00010000:3.0:1746126611.960610:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f55c00 00000100:00100000:3.0:1746126611.960634:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1738 00000100:00100000:3.0:1746126611.960641:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721401216:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126611.961004:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7639 00000100:00100000:2.0:1746126611.961053:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1964:x1830945721401088:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126611.970239:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721401344:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 11844us (12385us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126611.970253:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1737 00002000:00100000:3.0:1746126611.970265:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a4f55f80 x1830945721401344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.970275:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55f80 with x1830945721401344 ext(3145728->4194303) 00010000:00010000:3.0:1746126611.970286:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 22 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.970306:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 22 pid: 4641 timeout: 833 lvb_type: 1 00002000:00010000:3.0:1746126611.970312:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f55f80 00000100:00100000:3.0:1746126611.977554:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721401216:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16902us (17997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126611.977567:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1738 00002000:00100000:3.0:1746126611.977579:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a4f55c00 x1830945721401216/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126611.977589:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55c00 with x1830945721401216 ext(2097152->3145727) 00010000:00010000:3.0:1746126611.977599:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 20 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126611.977613:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 20 pid: 4641 timeout: 833 lvb_type: 1 00002000:00010000:3.0:1746126611.977620:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f55c00 00000100:00100000:2.0:1746126611.981327:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1964:x1830945721401088:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 20304us (23689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126611.981340:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7639 00002000:00100000:2.0:1746126611.981353:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a4f55880 x1830945721401088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:372/0 lens 488/440 e 0 to 0 dl 1746126622 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.981370:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55880 with x1830945721401088 ext(3145728->4194303) 00002000:00010000:2.0:1746126611.981376:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f55880 00000100:00100000:1.0:1746126611.982896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.982972:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721401600 00000100:00100000:1.0:1746126611.982972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.982981:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721401600 00000100:00100000:0.0:1746126611.983009:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721401728 00000100:00100000:0.0:1746126611.983012:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721401728 00010000:00010000:0.0:1746126611.983044:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 21 pid: 4641 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746126611.983070:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6986 00000100:00100000:0.0:1746126611.983078:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721401728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126611.983101:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126611.983125:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 21 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.983137:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 21 pid: 4641 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126611.983190:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13424 00000100:00100000:3.0:1746126611.983196:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31196:x1830945721401600:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126611.983226:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d934e00/0xb50e825867613272 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8fe expref: 21 pid: 4641 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746126611.983256:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.983259:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126611.983265:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 37 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.983272:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 37 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126611.983304:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 37 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.983317:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721351040:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126611.983333:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.983347:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d91a expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.983366:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 37 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126611.984610:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00010000:00010000:3.0:1746126611.984727:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126611.984728:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126611.984734:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3657728->4194303] (req 3657728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.984757:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 37 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.984768:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 37 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126611.984779:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721351168:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126611.984804:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126611.987540:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721351040:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126611.987563:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126611.987611:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721401728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4532us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126611.987621:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6986 00000100:00100000:3.0:1746126611.987669:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721351168:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126611.987694:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3657728->4194303] (req 3657728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.987709:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bfc00, rc 0) 00000100:00100000:3.0:1746126611.987743:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31196:x1830945721401600:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4547us (4853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.987750:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13424 00000100:00100000:0.0:1746126611.989851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126611.989943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126611.990024:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721402112 00000100:00100000:3.0:1746126611.990033:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721402112 00000100:00100000:2.0:1746126611.990267:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721401984 00000100:00100000:2.0:1746126611.990271:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721401984 00002000:00100000:2.0:1746126611.990303:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2785280->2789375) req@ffff8800a4f57480 x1830945721401984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/0 e 0 to 0 dl 1746126622 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.990312:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f57480 with x1830945721401984 ext(2785280->2789375) 00010000:00010000:2.0:1746126611.990321:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 38 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.990333:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 38 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.990340:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f57480 00000100:00100000:2.0:1746126611.990355:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1739 00000100:00100000:2.0:1746126611.990361:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+38:1963:x1830945721401984:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126611.990521:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+38:1963:x1830945721401984:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 160us (698us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126611.990528:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1739 00002000:00100000:2.0:1746126611.990533:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2785280->2789375) req@ffff8800a4f57480 x1830945721401984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:372/0 lens 488/4536 e 0 to 0 dl 1746126622 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126611.990539:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f57480 with x1830945721401984 ext(2785280->2789375) 00010000:00010000:2.0:1746126611.990542:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 38 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126611.990550:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 38 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126611.990555:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f57480 00000100:00100000:3.0:1746126611.990942:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13425 00000100:00100000:3.0:1746126611.990951:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31195:x1830945721402112:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126611.990960:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126611.991129:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d921 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.991152:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126611.991157:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3657728->4194303] (req 3657728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.991162:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126611.991165:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.991201:0:4641:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3657728->4194303] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.991215:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126611.991224:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800904bfe00, rc 0) 00000100:00100000:3.0:1746126611.992490:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31195:x1830945721402112:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1535us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126611.992498:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13425 00000100:00100000:0.0:1746126612.003817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.003908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.003967:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721402368 00000100:00100000:3.0:1746126612.003976:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721402368 00002000:00100000:3.0:1746126612.004037:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2785280->3145727) req@ffff88009e9fd880 x1830945721402368/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.004047:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fd880 with x1830945721402368 ext(2785280->3145727) 00010000:00010000:3.0:1746126612.004057:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 38 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.004070:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 38 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.004077:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9fd880 00000100:00100000:3.0:1746126612.004106:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1740 00000100:00100000:3.0:1746126612.004120:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+38:1963:x1830945721402368:12345-192.168.203.2@tcp:4:multiop.0 00000100:00080000:0.0:1746126612.004606:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746126612.005439:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721402496 00000100:00100000:2.0:1746126612.005445:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721402496 00000100:00100000:2.0:1746126612.006587:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13426 00000100:00100000:2.0:1746126612.006596:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+30:31191:x1830945721402496:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126612.006611:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746126612.007053:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746126612.007082:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d928 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.007119:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 31 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.007128:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 33 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.007135:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.007146:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126612.007148:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126612.007151:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->3346431] (req 3145728->3346431) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 31 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.007181:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.007192:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 16 pid: 8436 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126612.007202:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721351424:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.007297:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 33 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.007304:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 33 pid: 8438 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126612.007311:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721351552:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.007332:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 31 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.007338:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 31 pid: 10890 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126612.007350:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721351680:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.007360:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.015621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.015646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.015652:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721351424:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.015670:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721402752 00000100:00100000:2.0:1746126612.015675:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721402752 00000100:00100000:0.0:1746126612.015678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.015699:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721402624 00000100:00100000:3.0:1746126612.015703:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721402624 00010000:00010000:2.0:1746126612.015708:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 32 pid: 10890 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126612.015719:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 17 pid: 8436 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126612.015741:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721402880 00000100:00100000:3.0:1746126612.015743:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721402880 00010000:00010000:3.0:1746126612.015758:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 34 pid: 8438 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126612.015771:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6987 00000100:00100000:3.0:1746126612.015776:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1966:x1830945721402624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.015788:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.015807:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 17 pid: 8436 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126612.015821:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 17 pid: 8436 timeout: 833 lvb_type: 1 00000100:00080000:0.0:1746126612.015823:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746126612.015862:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a34200/0xb50e825867613176 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8b1 expref: 17 pid: 8436 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126612.015886:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126612.015904:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6988 00000100:00100000:2.0:1746126612.015909:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721402880:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126612.015916:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126612.015923:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1966:x1830945721402624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 146us (275us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126612.015923:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 34 pid: 8438 timeout: 833 lvb_type: 1 00000100:00100000:3.0:1746126612.015929:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6987 00010000:00010000:2.0:1746126612.015931:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 34 pid: 8438 timeout: 833 lvb_type: 1 00010000:00010000:2.0:1746126612.015941:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.015942:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6989 00000100:00100000:3.0:1746126612.015947:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721402752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.015954:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126612.015955:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721402880:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.015959:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6988 00010000:00010000:3.0:1746126612.015960:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 32 pid: 10890 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126612.015967:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 32 pid: 10890 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126612.015977:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.015979:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.015985:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.015992:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.015994:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093051000/0xb50e82586761326b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f7 expref: 33 pid: 8438 timeout: 833 lvb_type: 1 00000100:00100000:2.0:1746126612.016009:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721351552:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.016017:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e82586761313e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d86b expref: 32 pid: 10890 timeout: 833 lvb_type: 1 00010000:00010000:3.0:1746126612.016021:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126612.016023:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721351680:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126612.016032:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721351808:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126612.016048:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 31 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.016055:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75ba00, rc 0) 00000100:00100000:2.0:1746126612.016070:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+31:31191:x1830945721402496:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9477us (12162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.016076:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13426 00000100:00100000:3.0:1746126612.016077:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.017492:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721351808:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126612.017511:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126612.017682:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721402752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1733us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.017692:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6989 00000100:00100000:0.0:1746126612.019856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.021400:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+40:1963:x1830945721402368:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 17279us (17586us total) trans 17179873181 rc 0/0 00000100:00100000:3.0:1746126612.021412:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1740 00002000:00100000:3.0:1746126612.021425:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2785280->3145727) req@ffff88009e9fd880 x1830945721402368/t17179873181(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.021434:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9fd880 with x1830945721402368 ext(2785280->3145727) 00010000:00010000:3.0:1746126612.021444:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 40 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.021457:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 40 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.021464:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9fd880 00000100:00100000:3.0:1746126612.021486:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721403136 00000100:00100000:3.0:1746126612.021493:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721403136 00002000:00100000:3.0:1746126612.021523:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3342336->3346431) req@ffff880134c3f100 x1830945721403136/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.021529:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3f100 with x1830945721403136 ext(3342336->3346431) 00002000:00010000:3.0:1746126612.021532:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3f100 00000100:00100000:3.0:1746126612.021558:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7640 00000100:00100000:3.0:1746126612.021566:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721403136:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126612.021702:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721403136:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 137us (1854us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.021708:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7640 00002000:00100000:3.0:1746126612.021712:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3342336->3346431) req@ffff880134c3f100 x1830945721403136/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.021718:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3f100 with x1830945721403136 ext(3342336->3346431) 00002000:00010000:3.0:1746126612.021720:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3f100 00000100:00100000:0.0:1746126612.024613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.025600:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721403264 00000100:00100000:2.0:1746126612.025610:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721403264 00010000:00010000:2.0:1746126612.025651:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 40 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126612.025691:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6990 00000100:00100000:2.0:1746126612.025699:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+40:1964:x1830945721403264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126612.025714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126612.025716:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126612.025735:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721403520 00010000:00010000:2.0:1746126612.025739:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 40 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126612.025740:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721403520 00010000:00010000:2.0:1746126612.025751:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 40 pid: 4641 timeout: 833 lvb_type: 0 00000100:00080000:0.0:1746126612.025763:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126612.025771:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3755 00010000:00010000:2.0:1746126612.025772:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f75aa00/0xb50e82586761328e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d913 expref: 40 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126612.025777:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:31191:x1830945721403520:12345-192.168.203.2@tcp:35:multiop.0 00010000:00010000:2.0:1746126612.025787:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126612.025790:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126612.025796:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.025804:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.025852:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 20 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.025863:0:7074:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 20 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126612.025874:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721351936:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126612.025949:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.026655:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+223:31191:x1830945721403520:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 875us (938us total) trans 8589943072 rc 0/0 00000100:00100000:1.0:1746126612.026662:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3755 00000100:00100000:2.0:1746126612.029333:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721351936:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126612.029358:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126612.029392:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+39:1964:x1830945721403264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3694us (4789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.029401:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6990 00000100:00100000:0.0:1746126612.034782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.035015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.035101:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721404032 00000100:00100000:1.0:1746126612.035111:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721404032 00000100:00100000:1.0:1746126612.035168:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8909 00000100:00100000:1.0:1746126612.035176:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31203:x1830945721404032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.035204:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.035223:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676132aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d92f expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.035336:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035348:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035359:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035373:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035378:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035383:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035483:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035494:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035499:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126612.035506:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126612.035581:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035586:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035591:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035596:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f87e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.035599:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035605:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035614:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126612.035616:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.035620:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035624:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87e00/0xb50e8258676132b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035639:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035646:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035650:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035653:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f86c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.035655:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035658:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035662:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8f00) 00010000:00010000:1.0:1746126612.035664:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.035665:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035668:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86c00/0xb50e8258676132b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.035697:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87800/0xb50e8258676132aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 226 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.035706:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.035710:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.035712:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126612.035714:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f87400, rc 0) 00000100:00100000:1.0:1746126612.035762:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+225:31203:x1830945721404032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 587us (747us total) trans 8589943073 rc 0/0 00000100:00100000:1.0:1746126612.035769:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8909 00000100:00100000:3.0:1746126612.036016:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721403776 00000100:00100000:3.0:1746126612.036022:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721403776 00002000:00100000:3.0:1746126612.036068:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3657728->3661823) req@ffff880093df4000 x1830945721403776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.036078:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4000 with x1830945721403776 ext(3657728->3661823) 00010000:00010000:3.0:1746126612.036085:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.036109:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.036115:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093df4000 00000100:00100000:3.0:1746126612.036130:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1741 00000100:00100000:3.0:1746126612.036137:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721403776:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126612.036257:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721403776:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 121us (1486us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.036264:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1741 00002000:00100000:3.0:1746126612.036269:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3657728->3661823) req@ffff880093df4000 x1830945721403776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.036276:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4000 with x1830945721403776 ext(3657728->3661823) 00010000:00010000:3.0:1746126612.036281:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.036289:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.036294:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093df4000 00000100:00080000:1.0:1746126612.036978:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126612.048195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.048238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.048286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.048300:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721404544 00000100:00100000:2.0:1746126612.048311:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721404544 00000100:00100000:2.0:1746126612.048363:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13427 00000100:00100000:2.0:1746126612.048371:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+33:31196:x1830945721404544:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126612.048391:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.048408:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d936 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.048430:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721404288 00000100:00100000:1.0:1746126612.048434:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721404288 00000100:00100000:1.0:1746126612.048459:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3756 00000100:00100000:1.0:1746126612.048463:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+225:31203:x1830945721404288:12345-192.168.203.2@tcp:35:cat.0 00010000:00010000:2.0:1746126612.048891:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 29 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.048899:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.048901:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.048904:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->4702207] (req 4194304->4702207) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 34 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.048922:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721404672 00000100:00100000:3.0:1746126612.048927:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721404672 00002000:00100000:3.0:1746126612.048957:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3657728->4194303) req@ffff880136a80000 x1830945721404672/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.048966:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80000 with x1830945721404672 ext(3657728->4194303) 00010000:00010000:3.0:1746126612.048972:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.048989:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 21 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.048995:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a80000 00000100:00100000:3.0:1746126612.049018:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1742 00000100:00100000:3.0:1746126612.049024:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721404672:12345-192.168.203.2@tcp:4:multiop.0 00010000:00010000:2.0:1746126612.049411:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 29 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.049423:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 29 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:2.0:1746126612.049434:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721352064:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.049896:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.049991:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31203:x1830945721404288:12345-192.168.203.2@tcp:35:cat.0 Request processed in 1482us (1761us total) trans 8589943074 rc 0/0 00000100:00100000:1.0:1746126612.050000:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3756 00000100:00100000:0.0:1746126612.055295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.055723:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721404800 00000100:00100000:1.0:1746126612.055733:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721404800 00000100:00100000:1.0:1746126612.055789:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13428 00000100:00100000:1.0:1746126612.055797:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+39:1963:x1830945721404800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.055816:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.056019:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f87800/0xb50e8258676132d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d93d expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.056074:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721352192:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126612.056166:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126612.058132:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721352064:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126612.058163:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->4702207] (req 4194304->4702207) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 34 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.058178:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75ae00, rc 0) 00000100:00100000:3.0:1746126612.058216:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+34:31196:x1830945721404544:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9844us (9975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.058224:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13427 00000100:00100000:1.0:1746126612.058340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.058385:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721404928 00000100:00100000:3.0:1746126612.058390:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721404928 00002000:00100000:3.0:1746126612.058428:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3346431) req@ffff880092b14a80 x1830945721404928/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.058437:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14a80 with x1830945721404928 ext(3145728->3346431) 00010000:00010000:3.0:1746126612.058443:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 30 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.058453:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 30 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.058459:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b14a80 00000100:00100000:3.0:1746126612.058484:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1743 00000100:00100000:3.0:1746126612.058492:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721404928:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126612.059768:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721352192:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126612.059794:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f87800/0xb50e8258676132d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d93d expref: 40 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.059806:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f87800/0xb50e8258676132d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d93d expref: 40 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.059849:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f87800, rc 0) 00000100:00100000:1.0:1746126612.059884:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+39:1963:x1830945721404800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4087us (4598us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126612.059892:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13428 00000100:00100000:3.0:1746126612.062518:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721404928:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 4017us (4168us total) trans 21474840336 rc 0/0 00000100:00100000:3.0:1746126612.062534:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1743 00002000:00100000:3.0:1746126612.062544:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3346431) req@ffff880092b14a80 x1830945721404928/t21474840336(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.062553:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14a80 with x1830945721404928 ext(3145728->3346431) 00010000:00010000:3.0:1746126612.062564:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.062577:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:3.0:1746126612.062584:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b14a80 00000100:00100000:2.0:1746126612.064375:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721404672:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 15343us (16080us total) trans 17179873182 rc 0/0 00000100:00100000:2.0:1746126612.064385:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1742 00002000:00100000:2.0:1746126612.064395:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3657728->4194303) req@ffff880136a80000 x1830945721404672/t17179873182(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.064403:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80000 with x1830945721404672 ext(3657728->4194303) 00010000:00010000:2.0:1746126612.064411:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 23 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:2.0:1746126612.064422:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 23 pid: 4641 timeout: 833 lvb_type: 0 00002000:00010000:2.0:1746126612.064428:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a80000 00000100:00100000:0.0:1746126612.065111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.065712:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721405056 00000100:00100000:3.0:1746126612.065722:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721405056 00010000:00010000:3.0:1746126612.065760:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:3.0:1746126612.065798:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6991 00000100:00100000:3.0:1746126612.065806:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721405056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.065820:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.065864:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.065875:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.065902:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676132a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d928 expref: 32 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:3.0:1746126612.065921:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.065923:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.065929:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 33 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.065937:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 33 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.065981:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 33 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.065992:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721352320:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.066058:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.067995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.068132:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721405184 00000100:00100000:1.0:1746126612.068141:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721405184 00010000:00010000:1.0:1746126612.068170:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 23 pid: 4641 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746126612.068196:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6992 00000100:00100000:1.0:1746126612.068203:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721405184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126612.068217:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126612.068237:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 23 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126612.068248:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 23 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126612.068268:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfc00/0xb50e825867613295 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3657728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d91a expref: 23 pid: 4641 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746126612.068284:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.068286:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.068292:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.068304:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.068333:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.068345:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721352448:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126612.068426:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.081846:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.081863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.081874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.081900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.081920:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721405568 00000100:00100000:1.0:1746126612.081929:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721405568 00002000:00100000:1.0:1746126612.081974:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092b14000 x1830945721405568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.081984:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14000 with x1830945721405568 ext(0->1048575) 00002000:00010000:1.0:1746126612.081989:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b14000 00000100:00100000:1.0:1746126612.082003:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721405824 00000100:00100000:1.0:1746126612.082005:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721405824 00002000:00100000:1.0:1746126612.082015:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092b14700 x1830945721405824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.082023:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14700 with x1830945721405824 ext(1048576->2097151) 00002000:00010000:1.0:1746126612.082026:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b14700 00000100:00100000:1.0:1746126612.082033:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721406080 00000100:00100000:1.0:1746126612.082036:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721406080 00002000:00100000:1.0:1746126612.082043:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880092b15c00 x1830945721406080/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.082049:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15c00 with x1830945721406080 ext(1048576->2097151) 00002000:00010000:1.0:1746126612.082052:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b15c00 00000100:00100000:1.0:1746126612.082059:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721406336 00000100:00100000:1.0:1746126612.082061:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721406336 00002000:00100000:1.0:1746126612.082069:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880092b15180 x1830945721406336/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.082075:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15180 with x1830945721406336 ext(1048576->2097151) 00002000:00010000:1.0:1746126612.082078:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b15180 00000100:00100000:1.0:1746126612.082100:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7641 00000100:00100000:1.0:1746126612.082107:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721405568:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126612.083479:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7642 00000100:00100000:1.0:1746126612.083489:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+40:1965:x1830945721405824:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.085211:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721352320:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126612.085244:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.085288:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721405056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 19481us (20177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.085298:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6991 00000100:00100000:3.0:1746126612.085374:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7643 00000100:00100000:3.0:1746126612.085384:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+40:1965:x1830945721406080:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.086087:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7644 00000100:00100000:2.0:1746126612.086107:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721406336:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.091042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.091206:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721406592 00000100:00100000:0.0:1746126612.091216:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721406592 00002000:00100000:0.0:1746126612.091263:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4698112->4702207) req@ffff88009bb2f480 x1830945721406592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.091274:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f480 with x1830945721406592 ext(4698112->4702207) 00002000:00010000:0.0:1746126612.091280:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f480 00000100:00100000:0.0:1746126612.091310:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7645 00000100:00100000:0.0:1746126612.091318:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1963:x1830945721406592:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126612.091471:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1963:x1830945721406592:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 153us (438us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126612.091477:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7645 00002000:00100000:0.0:1746126612.091483:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4698112->4702207) req@ffff88009bb2f480 x1830945721406592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.091490:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f480 with x1830945721406592 ext(4698112->4702207) 00002000:00010000:0.0:1746126612.091493:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f480 00000100:00100000:0.0:1746126612.093797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.093814:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721406848 00000100:00100000:0.0:1746126612.093821:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721406848 00002000:00100000:0.0:1746126612.093870:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880136a82a00 x1830945721406848/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.093879:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82a00 with x1830945721406848 ext(3145728->4194303) 00002000:00010000:0.0:1746126612.093884:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a82a00 00000100:00100000:1.0:1746126612.098259:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721352448:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126612.098280:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126612.098325:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721405184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 30122us (30338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.098336:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6992 00000100:00100000:1.0:1746126612.103020:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7646 00000100:00100000:1.0:1746126612.103038:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721406848:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126612.108239:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721405568:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26124us (26405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126612.108251:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7641 00002000:00100000:0.0:1746126612.108263:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092b14000 x1830945721405568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.108271:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14000 with x1830945721405568 ext(0->1048575) 00002000:00010000:0.0:1746126612.108277:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b14000 00000100:00100000:0.0:1746126612.122057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.122232:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721407104 00000100:00100000:1.0:1746126612.122242:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721407104 00000100:00100000:1.0:1746126612.122295:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3757 00000100:00100000:1.0:1746126612.122303:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31196:x1830945721407104:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126612.122358:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+41:1965:x1830945721406080:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36976us (40481us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.122367:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7643 00002000:00100000:2.0:1746126612.122377:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880092b15c00 x1830945721406080/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.122385:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15c00 with x1830945721406080 ext(1048576->2097151) 00002000:00010000:2.0:1746126612.122391:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b15c00 00000100:00100000:1.0:1746126612.122468:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31196:x1830945721407104:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 166us (420us total) trans 8589943075 rc 0/0 00000100:00100000:1.0:1746126612.122474:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3757 00000100:00100000:3.0:1746126612.122537:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721406336:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36430us (40633us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126612.122545:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7644 00002000:00100000:3.0:1746126612.122550:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880092b15180 x1830945721406336/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.122557:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15180 with x1830945721406336 ext(1048576->2097151) 00002000:00010000:3.0:1746126612.122561:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b15180 00000100:00080000:0.0:1746126612.122628:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126612.134898:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+39:1965:x1830945721405824:12345-192.168.203.2@tcp:3:cat.0 Request processed in 51402us (53024us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.134911:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7642 00002000:00100000:2.0:1746126612.134923:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092b14700 x1830945721405824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.134932:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14700 with x1830945721405824 ext(1048576->2097151) 00002000:00010000:2.0:1746126612.134937:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b14700 00000100:00100000:1.0:1746126612.136047:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721406848:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 33011us (42253us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126612.136055:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7646 00002000:00100000:1.0:1746126612.136061:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880136a82a00 x1830945721406848/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.136068:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82a00 with x1830945721406848 ext(3145728->4194303) 00002000:00010000:1.0:1746126612.136072:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a82a00 00000100:00100000:1.0:1746126612.146805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.146857:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721407360 00000100:00100000:1.0:1746126612.146865:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721407360 00002000:00100000:1.0:1746126612.146914:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4702208->4976639) req@ffff880092b15500 x1830945721407360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.146922:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15500 with x1830945721407360 ext(4702208->4976639) 00002000:00010000:1.0:1746126612.146927:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b15500 00000100:00100000:1.0:1746126612.146946:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7647 00000100:00100000:1.0:1746126612.146952:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721407360:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126612.150373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.150686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.150712:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721407488 00000100:00100000:1.0:1746126612.150720:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721407488 00000100:00100000:1.0:1746126612.150756:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721407616 00000100:00100000:1.0:1746126612.150758:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721407616 00000100:00100000:1.0:1746126612.150773:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13429 00000100:00100000:1.0:1746126612.150779:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721407488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.150794:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.150810:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eac2e00/0xb50e8258676132db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d944 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.150880:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721352576:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126612.150948:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.150962:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13430 00000100:00100000:1.0:1746126612.150967:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+39:1964:x1830945721407616:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.150975:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.150985:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d94b expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.150997:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.150999:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.151007:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 40 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.151022:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 40 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.151032:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adb0800, rc 0) 00000100:00100000:1.0:1746126612.151052:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+40:1964:x1830945721407616:12345-192.168.203.2@tcp:101:cat.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.151061:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13430 00000100:00100000:1.0:1746126612.152587:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1966:x1830945721407360:12345-192.168.203.2@tcp:3:cat.0 Request processed in 5629us (5784us total) trans 0 rc 274432/274432 00000100:00100000:1.0:1746126612.152596:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7647 00002000:00100000:1.0:1746126612.152606:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4702208->4976639) req@ffff880092b15500 x1830945721407360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 274432/274432 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.152620:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15500 with x1830945721407360 ext(4702208->4976639) 00002000:00010000:1.0:1746126612.152624:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b15500 00000100:00100000:1.0:1746126612.152866:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721352576:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126612.152892:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eac2e00/0xb50e8258676132db lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d944 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.152904:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eac2e00/0xb50e8258676132db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d944 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.152913:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac2e00, rc 0) 00000100:00100000:1.0:1746126612.152935:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721407488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2156us (2570us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126612.152941:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13429 00000100:00100000:1.0:1746126612.156706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.156769:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721407744 00000100:00100000:2.0:1746126612.156779:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721407744 00000100:00100000:2.0:1746126612.156848:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13431 00000100:00100000:2.0:1746126612.156857:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:31203:x1830945721407744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.156875:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.156892:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d952 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.157050:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 33 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.157058:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.157059:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.157062:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.157247:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 33 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.157264:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 33 pid: 4641 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126612.157277:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721352704:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.157347:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126612.162310:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721352704:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126612.162348:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.162366:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093416600, rc 0) 00000100:00100000:3.0:1746126612.162425:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:31203:x1830945721407744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5568us (5724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.162434:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13431 00000100:00100000:0.0:1746126612.163303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.163508:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721407872 00000100:00100000:1.0:1746126612.163516:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721407872 00002000:00100000:1.0:1746126612.163556:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4702207) req@ffff880136a82300 x1830945721407872/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.163571:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82300 with x1830945721407872 ext(4194304->4702207) 00010000:00010000:1.0:1746126612.163579:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 34 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.163592:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 34 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746126612.163598:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a82300 00000100:00100000:1.0:1746126612.163617:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1744 00000100:00100000:1.0:1746126612.163622:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+34:1963:x1830945721407872:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126612.190482:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+36:1963:x1830945721407872:12345-192.168.203.2@tcp:4:cat.0 Request processed in 26846us (27167us total) trans 21474840337 rc 0/0 00000100:00100000:1.0:1746126612.190494:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1744 00002000:00100000:1.0:1746126612.190508:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4702207) req@ffff880136a82300 x1830945721407872/t21474840337(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.190516:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82300 with x1830945721407872 ext(4194304->4702207) 00010000:00010000:1.0:1746126612.190527:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 36 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.190543:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 36 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746126612.190549:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a82300 00000100:00100000:2.0:1746126612.196723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.196773:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721408000 00000100:00100000:0.0:1746126612.196784:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721408000 00010000:00010000:0.0:1746126612.196819:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 36 pid: 4641 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746126612.196881:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6993 00000100:00100000:0.0:1746126612.196889:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+36:1966:x1830945721408000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.196904:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.196949:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 36 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.196962:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 36 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.196987:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ae00/0xb50e8258676132cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d936 expref: 36 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.197005:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.197008:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.197015:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.197023:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.197204:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126612.197217:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721352832:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126612.197453:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b70c900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.200800:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721352832:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126612.200821:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126612.200898:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+35:1966:x1830945721408000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4010us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.200908:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6993 00000100:00100000:0.0:1746126612.217812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.217856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.217870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.217947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.218967:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721408256 00000100:00100000:2.0:1746126612.218978:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721408256 00002000:00100000:2.0:1746126612.219040:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880136a80380 x1830945721408256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.219051:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80380 with x1830945721408256 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.219056:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a80380 00000100:00100000:2.0:1746126612.219076:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721408512 00000100:00100000:2.0:1746126612.219079:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721408512 00000100:00100000:0.0:1746126612.219080:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721408768 00000100:00100000:0.0:1746126612.219082:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721408768 00002000:00100000:2.0:1746126612.219088:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880136a83100 x1830945721408512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.219104:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83100 with x1830945721408512 ext(3145728->4194303) 00002000:00010000:2.0:1746126612.219106:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83100 00000100:00100000:2.0:1746126612.219117:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409024 00000100:00100000:2.0:1746126612.219119:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409024 00002000:00100000:2.0:1746126612.219128:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800937bb100 x1830945721409024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.219133:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bb100 with x1830945721409024 ext(3145728->4194303) 00002000:00010000:2.0:1746126612.219136:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937bb100 00000100:00100000:2.0:1746126612.219149:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7648 00000100:00100000:2.0:1746126612.219155:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721408256:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:0.0:1746126612.220035:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800937b9500 x1830945721408768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.220046:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9500 with x1830945721408768 ext(2097152->3145727) 00002000:00010000:0.0:1746126612.220050:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937b9500 00000100:00100000:0.0:1746126612.220067:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7649 00000100:00100000:0.0:1746126612.220074:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721408512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.220498:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7650 00000100:00100000:2.0:1746126612.220505:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+41:1964:x1830945721409024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126612.222878:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7651 00000100:00100000:0.0:1746126612.222892:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+41:1964:x1830945721408768:12345-192.168.203.2@tcp:3:cat.0 00000001:00080000:3.0:1746126612.245798:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873180 is committed 00000001:00080000:3.0:1746126612.246750:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873171 is committed 00000001:00080000:3.0:1746126612.246780:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873095 is committed 00000001:00080000:3.0:1746126612.246790:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873094 is committed 00000001:00080000:3.0:1746126612.246815:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873156 is committed 00000001:00080000:3.0:1746126612.246912:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873182 is committed 00000001:00080000:3.0:1746126612.247019:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873181 is committed 00000100:00100000:2.0:1746126612.255798:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721408256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36634us (37988us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.255809:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7648 00002000:00100000:2.0:1746126612.255820:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880136a80380 x1830945721408256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.255844:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80380 with x1830945721408256 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.255850:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a80380 00000100:00100000:0.0:1746126612.256790:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721408512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36712us (38928us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126612.256798:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7649 00002000:00100000:0.0:1746126612.256805:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880136a83100 x1830945721408512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.256812:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83100 with x1830945721408512 ext(3145728->4194303) 00002000:00010000:0.0:1746126612.256815:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83100 00000100:00100000:1.0:1746126612.261902:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721408768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 39005us (44020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126612.261913:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7651 00002000:00100000:1.0:1746126612.261925:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800937b9500 x1830945721408768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.261934:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9500 with x1830945721408768 ext(2097152->3145727) 00002000:00010000:1.0:1746126612.261940:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937b9500 00000100:00100000:3.0:1746126612.268747:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721409024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 48230us (50787us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126612.269624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.269694:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409280 00000100:00100000:1.0:1746126612.269702:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409280 00000100:00100000:1.0:1746126612.269745:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8910 00000100:00100000:1.0:1746126612.269752:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31207:x1830945721409280:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.269772:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.269789:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e600/0xb50e8258676132f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d959 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.269921:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7650 00002000:00100000:3.0:1746126612.269937:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800937bb100 x1830945721409024/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.270763:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bb100 with x1830945721409024 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.270773:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937bb100 00010000:00010000:1.0:1746126612.271047:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.271062:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 227 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.271068:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.271109:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 227 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.271121:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 227 pid: 14547 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126612.271134:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721352960:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.271203:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.276791:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721352960:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.276815:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126612.278996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.279069:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409408 00000100:00100000:1.0:1746126612.279078:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409408 00010000:00010000:1.0:1746126612.279120:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 228 pid: 14547 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126612.279153:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6994 00000100:00100000:1.0:1746126612.279159:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+228:1963:x1830945721409408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126612.279173:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126612.279178:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 228 pid: 14547 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.279188:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 228 pid: 14547 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.279212:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f87400/0xb50e8258676132bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d92f expref: 228 pid: 14547 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.279226:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.279230:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.279238:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.279243:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.279263:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126612.279734:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:1963:x1830945721409408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 571us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.279741:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6994 00010000:00010000:1.0:1746126612.279767:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.279773:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126612.279791:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126612.280294:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e600/0xb50e8258676132f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 228 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.280309:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 227 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.280316:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.280318:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126612.280321:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:1.0:1746126612.280346:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:31207:x1830945721409280:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10594us (10724us total) trans 8589943076 rc 0/0 00000100:00100000:1.0:1746126612.280352:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8910 00000100:00100000:1.0:1746126612.288380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.288489:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409664 00000100:00100000:0.0:1746126612.288500:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409664 00002000:00100000:0.0:1746126612.288544:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092b15f80 x1830945721409664/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.288554:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15f80 with x1830945721409664 ext(4194304->4976639) 00002000:00010000:0.0:1746126612.288559:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b15f80 00000100:00100000:0.0:1746126612.288622:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7652 00000100:00100000:0.0:1746126612.288629:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721409664:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.307901:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721409664:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19263us (19521us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126612.307914:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7652 00002000:00100000:2.0:1746126612.307932:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092b15f80 x1830945721409664/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.307941:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b15f80 with x1830945721409664 ext(4194304->4976639) 00002000:00010000:2.0:1746126612.307946:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b15f80 00000100:00100000:3.0:1746126612.315464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.315498:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409792 00000100:00100000:3.0:1746126612.315507:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409792 00000100:00100000:3.0:1746126612.315550:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13432 00000100:00100000:3.0:1746126612.315557:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:31207:x1830945721409792:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126612.315575:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126612.315592:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d960 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.315620:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.315627:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.315628:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.315631:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.315660:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.315670:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:3.0:1746126612.315681:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721353088:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126612.315760:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.320694:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721353088:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.320727:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 33 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.320769:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099210200, rc 0) 00000100:00100000:2.0:1746126612.321037:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:31207:x1830945721409792:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5478us (5579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.321046:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13432 00000100:00100000:1.0:1746126612.328861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.328895:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409920 00000100:00100000:1.0:1746126612.328904:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409920 00010000:00010000:1.0:1746126612.328940:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126612.328968:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6995 00000100:00100000:1.0:1746126612.328976:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721409920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126612.328989:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126612.329010:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.329022:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.329044:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093416600/0xb50e8258676132e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d952 expref: 33 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.329057:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.329059:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.329066:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.329079:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.329125:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.329137:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721353216:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126612.329208:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.331247:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721353216:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126612.331265:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126612.331299:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721409920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2323us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.331307:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6995 00000100:00100000:2.0:1746126612.332351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.333554:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721410176 00000100:00100000:3.0:1746126612.333564:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721410176 00002000:00100000:3.0:1746126612.333613:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2957312->2961407) req@ffff88009bb2dc00 x1830945721410176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.333623:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830945721410176 ext(2957312->2961407) 00002000:00010000:3.0:1746126612.333630:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:3.0:1746126612.333649:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7653 00000100:00100000:3.0:1746126612.333655:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721410176:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.334081:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721410176:12345-192.168.203.2@tcp:3:cat.0 Request processed in 424us (1731us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.334088:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7653 00002000:00100000:3.0:1746126612.334102:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2957312->2961407) req@ffff88009bb2dc00 x1830945721410176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.334110:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830945721410176 ext(2957312->2961407) 00002000:00010000:3.0:1746126612.334113:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:0.0:1746126612.342018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.342159:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721410304 00000100:00100000:2.0:1746126612.342169:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721410304 00000100:00100000:2.0:1746126612.342216:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13433 00000100:00100000:2.0:1746126612.342223:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:31207:x1830945721410304:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126612.342240:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.342257:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d967 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.342287:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 7 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.342296:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.342302:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126612.342304:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126612.342307:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2183167] (req 2097152->2183167) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.342338:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.342351:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 834 lvb_type: 1 00000100:00100000:2.0:1746126612.342367:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721353344:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.342464:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 7 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.342472:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 7 pid: 4641 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126612.342480:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721353472:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.342498:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c20c0 going to sleep for 11 seconds 00000001:00080000:0.0:1746126612.343022:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840335 is committed 00000001:00080000:0.0:1746126612.343036:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840326 is committed 00000001:00080000:0.0:1746126612.343059:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840337 is committed 00000001:00080000:0.0:1746126612.343078:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840310 is committed 00000001:00080000:0.0:1746126612.343164:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840327 is committed 00000001:00080000:0.0:1746126612.343180:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840311 is committed 00000001:00080000:0.0:1746126612.343232:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840336 is committed 00000100:00100000:2.0:1746126612.347532:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721353344:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.347545:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721353472:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.347573:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2183167] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.347591:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093962400, rc 0) 00000100:00100000:2.0:1746126612.347646:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:31207:x1830945721410304:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5422us (5636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.347655:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13433 00000100:00100000:0.0:1746126612.350633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.353045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.353119:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721410560 00000100:00100000:2.0:1746126612.353130:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721410560 00000100:00100000:1.0:1746126612.353156:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721410432 00000100:00100000:1.0:1746126612.353165:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721410432 00010000:00010000:2.0:1746126612.353168:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746126612.353181:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 8 pid: 4641 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126612.353211:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6996 00000100:00100000:2.0:1746126612.353219:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721410560:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126612.353238:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126612.353262:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.353273:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.353293:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0800/0xb50e8258676132e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d94b expref: 21 pid: 20294 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.353299:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6997 00000100:00100000:1.0:1746126612.353305:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721410432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126612.353310:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126612.353313:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126612.353322:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 8 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.353337:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 8 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.353350:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800904bfe00/0xb50e82586761329c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d921 expref: 8 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.353359:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.353361:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746126612.353366:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721410560:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 147us (2742us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126612.353367:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126612.353372:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6996 00010000:00010000:1.0:1746126612.353374:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.353403:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.353419:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721353600:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126612.353490:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.361988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.362152:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721410816 00000100:00100000:1.0:1746126612.362161:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721410816 00000100:00100000:1.0:1746126612.362207:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8911 00000100:00100000:1.0:1746126612.362214:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31211:x1830945721410816:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.362239:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.362258:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e600/0xb50e825867613313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d96e expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.362370:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362383:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362392:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362403:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362409:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362414:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362510:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362518:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362523:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126612.362532:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126612.362617:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362623:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362632:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362637:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570f600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.362641:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362647:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362658:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126612.362660:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.362664:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362668:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570f600/0xb50e82586761331a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362679:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362683:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362688:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362692:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.362694:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362699:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362708:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5200) 00010000:00010000:1.0:1746126612.362710:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.362711:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362715:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e000/0xb50e825867613321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126612.362746:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e600/0xb50e825867613313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.362756:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.362762:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.362763:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126612.362765:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fa00, rc 0) 00000100:00100000:1.0:1746126612.362824:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31211:x1830945721410816:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 609us (845us total) trans 8589943077 rc 0/0 00000100:00100000:1.0:1746126612.362850:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8911 00000100:00100000:1.0:1746126612.364232:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721353600:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126612.364253:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126612.364281:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1966:x1830945721410432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10976us (11245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.364290:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6997 00000100:00100000:0.0:1746126612.367509:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.368007:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721411072 00000100:00100000:3.0:1746126612.368018:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721411072 00002000:00100000:3.0:1746126612.368068:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2179072->2183167) req@ffff880091da1f80 x1830945721411072/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.368077:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1f80 with x1830945721411072 ext(2179072->2183167) 00002000:00010000:3.0:1746126612.368083:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da1f80 00000100:00100000:3.0:1746126612.368122:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7654 00000100:00100000:3.0:1746126612.368130:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721411072:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.368325:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721411072:12345-192.168.203.2@tcp:3:cat.0 Request processed in 195us (825us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.368332:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7654 00002000:00100000:3.0:1746126612.368337:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2179072->2183167) req@ffff880091da1f80 x1830945721411072/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.368343:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1f80 with x1830945721411072 ext(2179072->2183167) 00002000:00010000:3.0:1746126612.368345:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da1f80 00000100:00100000:0.0:1746126612.388822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.389086:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721411328 00000100:00100000:2.0:1746126612.389104:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721411328 00000100:00100000:2.0:1746126612.389162:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8912 00000100:00100000:2.0:1746126612.389170:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31215:x1830945721411328:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.389194:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.389212:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962a00/0xb50e825867613336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d975 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.389319:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389330:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389344:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389355:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389361:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389366:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389463:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e82586761334b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389471:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e82586761334b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389476:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e82586761334b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126612.389483:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126612.389561:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389566:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389572:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389577:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126612.389580:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389586:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389596:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126612.389598:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126612.389601:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389605:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761333d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389629:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389633:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389638:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389641:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126612.389643:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389646:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389651:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215100) 00010000:00010000:2.0:1746126612.389652:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126612.389654:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389657:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962000/0xb50e825867613344 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.389689:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962a00/0xb50e825867613336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d975 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.389698:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e82586761334b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d975 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.389704:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126612.389705:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126612.389707:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093962e00, rc 0) 00000100:00100000:2.0:1746126612.389747:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31215:x1830945721411328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 579us (937us total) trans 8589943078 rc 0/0 00000100:00100000:2.0:1746126612.389752:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8912 00000100:00100000:2.0:1746126612.395820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.396280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.396380:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721411712 00000100:00100000:1.0:1746126612.396390:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721411712 00000100:00100000:1.0:1746126612.396455:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 683 00000100:00100000:1.0:1746126612.396464:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721411712:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126612.396477:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126612.396500:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e82586761334b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d975 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.396528:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.396532:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126612.396574:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721411712:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.396581:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 683 00000100:00100000:0.0:1746126612.397342:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721411584 00000100:00100000:0.0:1746126612.397348:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721411584 00000100:00100000:0.0:1746126612.397385:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3758 00000100:00100000:0.0:1746126612.397391:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31215:x1830945721411584:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126612.397597:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31215:x1830945721411584:12345-192.168.203.2@tcp:35:cat.0 Request processed in 206us (1787us total) trans 8589943079 rc 0/0 00000100:00100000:0.0:1746126612.397603:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3758 00000100:00100000:0.0:1746126612.399410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.399451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.399456:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721411840 00000100:00100000:2.0:1746126612.399463:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721411840 00000100:00100000:2.0:1746126612.399497:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721411968 00000100:00100000:2.0:1746126612.399499:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721411968 00000100:00100000:1.0:1746126612.399512:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13434 00000100:00100000:1.0:1746126612.399521:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721411840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.399535:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.399550:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570ee00/0xb50e825867613359 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d97c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.399597:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721353728:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126612.399634:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13435 00000100:00100000:2.0:1746126612.399640:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721411968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.399648:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.399658:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093963000/0xb50e825867613360 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d983 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126612.399659:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.399685:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721353856:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126612.399709:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c20c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746126612.402443:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime: 1746126611 -> 1746126612 00002000:00010000:1.0:1746126612.402452:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126611 -> 1746126612 00002000:00010000:1.0:1746126612.402454:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime: 1746126611 -> 1746126612 00000100:00100000:1.0:1746126612.402477:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721353728:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126612.402507:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570ee00/0xb50e825867613359 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d97c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.402525:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570ee00/0xb50e825867613359 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d97c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.402544:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570ee00, rc 0) 00000100:00100000:1.0:1746126612.402580:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721411840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3060us (3173us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126612.402589:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13434 00002000:00010000:2.0:1746126612.409984:0:4640:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126611 -> 1746126612 00002000:00010000:2.0:1746126612.409993:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126611 -> 1746126612 00002000:00010000:2.0:1746126612.409995:0:4640:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126611 -> 1746126612 00000100:00100000:2.0:1746126612.410022:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721353856:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126612.410059:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093963000/0xb50e825867613360 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d983 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.410073:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093963000/0xb50e825867613360 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d983 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.410418:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093963000, rc 0) 00000100:00100000:2.0:1746126612.410489:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721411968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10847us (11035us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126612.410498:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13435 00000100:00100000:0.0:1746126612.427509:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.427548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.427569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.427596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.427617:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721412480 00000100:00100000:0.0:1746126612.427625:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721412480 00002000:00100000:0.0:1746126612.427668:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093233100 x1830945721412480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.427677:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233100 with x1830945721412480 ext(1048576->2097151) 00002000:00010000:0.0:1746126612.427682:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093233100 00000100:00100000:0.0:1746126612.427700:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721412352 00000100:00100000:0.0:1746126612.427702:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721412352 00000100:00100000:2.0:1746126612.427707:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721412736 00002000:00100000:0.0:1746126612.427709:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093df4e00 x1830945721412352/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126612.427712:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721412736 00002000:00100000:0.0:1746126612.427715:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4e00 with x1830945721412352 ext(1048576->2097151) 00002000:00010000:0.0:1746126612.427717:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093df4e00 00000100:00100000:0.0:1746126612.427724:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721412864 00000100:00100000:0.0:1746126612.427725:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721412864 00002000:00100000:0.0:1746126612.427731:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ed4b100 x1830945721412864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.427733:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880136a83b80 x1830945721412736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.427737:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b100 with x1830945721412864 ext(1048576->2097151) 00002000:00010000:0.0:1746126612.427740:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4b100 00002000:00100000:2.0:1746126612.427741:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83b80 with x1830945721412736 ext(0->1048575) 00002000:00010000:2.0:1746126612.427744:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83b80 00000100:00100000:0.0:1746126612.427750:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7655 00000100:00100000:0.0:1746126612.427755:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721412480:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.427759:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7656 00000100:00100000:2.0:1746126612.427765:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721412352:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.428226:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7657 00000100:00100000:2.0:1746126612.428233:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721412864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126612.428241:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7658 00000100:00100000:1.0:1746126612.428249:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721412736:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.449812:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721412864:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21567us (22201us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.449838:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7657 00002000:00100000:2.0:1746126612.449850:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ed4b100 x1830945721412864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.449860:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b100 with x1830945721412864 ext(1048576->2097151) 00002000:00010000:2.0:1746126612.449866:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4b100 00000100:00100000:1.0:1746126612.454763:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1966:x1830945721412736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26504us (27181us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126612.454775:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7658 00002000:00100000:1.0:1746126612.454786:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880136a83b80 x1830945721412736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.454795:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83b80 with x1830945721412736 ext(0->1048575) 00002000:00010000:1.0:1746126612.454801:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83b80 00000100:00100000:2.0:1746126612.463186:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721412480:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35417us (35673us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.463199:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7655 00002000:00100000:2.0:1746126612.463210:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093233100 x1830945721412480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.463220:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233100 with x1830945721412480 ext(1048576->2097151) 00002000:00010000:2.0:1746126612.463225:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093233100 00000100:00100000:0.0:1746126612.464474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.464538:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721413120 00000100:00100000:3.0:1746126612.464547:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721413120 00000100:00100000:3.0:1746126612.464597:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:3.0:1746126612.464605:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1963:x1830945721413120:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1746126612.464644:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1963:x1830945721413120:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 40us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.464648:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:2.0:1746126612.468471:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1966:x1830945721412352:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40691us (40906us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.468484:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7656 00002000:00100000:2.0:1746126612.468500:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093df4e00 x1830945721412352/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.468510:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4e00 with x1830945721412352 ext(1048576->2097151) 00002000:00010000:2.0:1746126612.468516:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093df4e00 00000100:00100000:0.0:1746126612.489011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.489076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.489189:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721413248 00000100:00100000:2.0:1746126612.489199:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721413248 00000100:00100000:3.0:1746126612.490797:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721413376 00000100:00100000:3.0:1746126612.490806:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721413376 00000100:00100000:3.0:1746126612.490863:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13436 00000100:00100000:3.0:1746126612.490872:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1963:x1830945721413248:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126612.490892:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126612.490908:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5284800/0xb50e825867613367 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d98a expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.490962:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721353984:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126612.491043:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126612.491073:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13437 00000100:00100000:3.0:1746126612.491079:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1964:x1830945721413376:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126612.491086:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126612.491103:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5285000/0xb50e82586761336e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d991 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.491125:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721354112:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126612.491142:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.494882:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721354112:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126612.494923:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5285000/0xb50e82586761336e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d991 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126612.495035:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721353984:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126612.495059:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5284800/0xb50e825867613367 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d98a expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126612.495075:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5284800/0xb50e825867613367 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d98a expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126612.495103:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5284800, rc 0) 00000100:00100000:3.0:1746126612.495163:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1963:x1830945721413248:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4290us (6161us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126612.495173:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13436 00010000:00010000:2.0:1746126612.495256:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5285000/0xb50e82586761336e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d991 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.495270:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5285000, rc 0) 00000100:00100000:2.0:1746126612.495299:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1964:x1830945721413376:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4217us (6221us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126612.495305:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13437 00000100:00100000:0.0:1746126612.501955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.502059:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721413504 00000100:00100000:2.0:1746126612.502069:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721413504 00000100:00100000:2.0:1746126612.502130:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13438 00000100:00100000:2.0:1746126612.502138:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31215:x1830945721413504:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.502158:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.502176:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d998 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.502203:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.502210:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.502612:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.502618:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.502657:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.502676:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 13 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126612.502689:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721354240:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126612.502795:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.512773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.514398:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721413760 00000100:00100000:2.0:1746126612.514412:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721413760 00000100:00100000:2.0:1746126612.514506:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8913 00000100:00100000:2.0:1746126612.514519:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:31217:x1830945721413760:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126612.514547:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.514570:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761337c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d99f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.514698:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.514712:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.514724:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.514740:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.514746:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.514752:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515264:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515273:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515279:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126612.515287:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126612.515375:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515381:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515386:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515391:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093963600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126612.515395:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515400:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515411:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126612.515413:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126612.515417:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515421:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515442:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515446:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515450:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515454:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126612.515456:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515460:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515465:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215100) 00010000:00010000:2.0:1746126612.515467:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126612.515469:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515473:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e82586761338a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126612.515510:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761337c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 230 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.515521:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 229 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.515526:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126612.515529:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126612.515531:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093962e00, rc 0) 00000100:00100000:2.0:1746126612.515585:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:31217:x1830945721413760:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1070us (2826us total) trans 8589943080 rc 0/0 00000100:00100000:2.0:1746126612.515592:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8913 00000100:00100000:1.0:1746126612.516227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.516273:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721354240:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.516294:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.516307:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093963a00, rc 0) 00000100:00100000:1.0:1746126612.516326:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31215:x1830945721413504:12345-192.168.203.2@tcp:101:cat.0 Request processed in 14189us (14381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.516333:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13438 00000100:00100000:2.0:1746126612.516651:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721413888 00000100:00100000:2.0:1746126612.516659:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721413888 00002000:00100000:2.0:1746126612.516692:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2957312->3145727) req@ffff880092b17800 x1830945721413888/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.516700:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17800 with x1830945721413888 ext(2957312->3145727) 00010000:00010000:2.0:1746126612.516706:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 14 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.516716:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 14 pid: 4640 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126612.516722:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b17800 00000100:00100000:2.0:1746126612.516803:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1745 00000100:00100000:2.0:1746126612.516810:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721413888:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126612.522704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.522859:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721414144 00000100:00100000:1.0:1746126612.522868:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721414144 00000100:00100000:1.0:1746126612.522921:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3759 00000100:00100000:1.0:1746126612.522929:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+229:31217:x1830945721414144:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126612.523226:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:31217:x1830945721414144:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 297us (529us total) trans 8589943081 rc 0/0 00000100:00100000:1.0:1746126612.523232:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3759 00000100:00100000:3.0:1746126612.527456:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721413888:12345-192.168.203.2@tcp:4:cat.0 Request processed in 10634us (11219us total) trans 21474840338 rc 0/0 00000100:00100000:3.0:1746126612.527470:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1745 00002000:00100000:3.0:1746126612.527481:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2957312->3145727) req@ffff880092b17800 x1830945721413888/t21474840338(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.527491:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17800 with x1830945721413888 ext(2957312->3145727) 00010000:00010000:3.0:1746126612.527502:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 16 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.527521:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 16 pid: 4640 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.527528:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b17800 00000100:00100000:0.0:1746126612.545821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.545960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.546107:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721414400 00000100:00100000:1.0:1746126612.546119:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721414400 00000100:00100000:1.0:1746126612.547971:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13439 00000100:00100000:1.0:1746126612.547990:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31211:x1830945721414400:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.548013:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.548033:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9a6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.548064:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.548071:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126612.548072:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126612.548075:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3280896->4194303] (req 3280896->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.548118:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.548134:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 19 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126612.548146:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721354368:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.548246:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126612.548437:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721414272 00000100:00100000:3.0:1746126612.548444:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721414272 00010000:00010000:3.0:1746126612.548474:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 16 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:3.0:1746126612.549561:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6998 00000100:00100000:3.0:1746126612.549572:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721414272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.549587:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.549617:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 16 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.549629:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 16 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.549649:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099210200/0xb50e825867613305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d960 expref: 16 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.549673:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.549674:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.549681:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.549693:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.549721:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.549732:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721354496:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.549809:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.554064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.554125:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721414656 00000100:00100000:1.0:1746126612.554134:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721414656 00000100:00100000:1.0:1746126612.554172:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8914 00000100:00100000:1.0:1746126612.554178:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:31220:x1830945721414656:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.554200:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.554217:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94a00/0xb50e8258676133a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9ad expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.554462:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721354496:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126612.554482:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.554521:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721414272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4952us (8713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.554529:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6998 00000100:00100000:0.0:1746126612.555005:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721354368:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126612.555024:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3280896->4194303] (req 3280896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.555037:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba95800, rc 0) 00000100:00100000:0.0:1746126612.555071:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31211:x1830945721414400:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7090us (9113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126612.555077:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13439 00000100:00100000:0.0:1746126612.555476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.555506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.555522:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721415040 00000100:00100000:0.0:1746126612.555526:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721415040 00002000:00100000:0.0:1746126612.555557:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009204e300 x1830945721415040/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.555566:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204e300 with x1830945721415040 ext(2097152->3145727) 00002000:00010000:0.0:1746126612.555570:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204e300 00000100:00100000:0.0:1746126612.555585:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721414912 00000100:00100000:0.0:1746126612.555587:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721414912 00002000:00100000:0.0:1746126612.555596:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2183167) req@ffff88009204ed80 x1830945721414912/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.555602:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ed80 with x1830945721414912 ext(2097152->2183167) 00010000:00010000:0.0:1746126612.555607:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 20 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.555618:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 20 pid: 4640 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746126612.555624:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009204ed80 00000100:00100000:0.0:1746126612.555640:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1746 00000100:00100000:0.0:1746126612.555645:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721414912:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126612.555878:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7659 00000100:00100000:1.0:1746126612.555885:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721415040:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:1.0:1746126612.559210:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559230:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559241:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559253:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559260:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559265:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559374:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95e00/0xb50e8258676133bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559383:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95e00/0xb50e8258676133bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559389:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95e00/0xb50e8258676133bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126612.559398:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126612.559486:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559492:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559499:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559504:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba95a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.559508:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559513:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559522:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126612.559526:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.559529:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559534:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e8258676133ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559560:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559565:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559569:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559573:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba95600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.559576:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559581:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559587:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5500) 00010000:00010000:1.0:1746126612.559589:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.559591:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559595:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e8258676133b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.559639:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94a00/0xb50e8258676133a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9ad expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.559656:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95e00/0xb50e8258676133bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9ad expref: 232 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.559662:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.559664:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126612.559666:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba95e00, rc 0) 00000100:00100000:1.0:1746126612.559698:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+232:31220:x1830945721414656:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5518us (5641us total) trans 8589943082 rc 0/0 00000100:00100000:1.0:1746126612.559706:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8914 00000100:00100000:0.0:1746126612.565357:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721414912:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9694us (9833us total) trans 17179873183 rc 0/0 00000100:00100000:0.0:1746126612.565371:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1746 00002000:00100000:0.0:1746126612.565387:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2183167) req@ffff88009204ed80 x1830945721414912/t17179873183(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.565396:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ed80 with x1830945721414912 ext(2097152->2183167) 00010000:00010000:0.0:1746126612.565408:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 22 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.565424:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 22 pid: 4640 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746126612.565431:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009204ed80 00000100:00100000:1.0:1746126612.569725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.569888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.570580:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721415040:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 14690us (15099us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.570593:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7659 00002000:00100000:2.0:1746126612.570609:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009204e300 x1830945721415040/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.570618:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204e300 with x1830945721415040 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.570625:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204e300 00000100:00100000:0.0:1746126612.570945:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721415424 00000100:00100000:0.0:1746126612.570954:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721415424 00000100:00100000:0.0:1746126612.570990:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3760 00000100:00100000:0.0:1746126612.570997:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:31220:x1830945721415424:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126612.571204:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:31220:x1830945721415424:12345-192.168.203.2@tcp:35:cat.0 Request processed in 207us (1318us total) trans 8589943083 rc 0/0 00000100:00100000:0.0:1746126612.571211:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3760 00000100:00100000:3.0:1746126612.571306:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721415168 00000100:00100000:3.0:1746126612.571311:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721415168 00000100:00100000:3.0:1746126612.571339:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 684 00000100:00100000:3.0:1746126612.571344:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+233:1965:x1830945721415168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.571354:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.571378:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95e00/0xb50e8258676133bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9ad expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.571395:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126612.571399:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.571416:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:1965:x1830945721415168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 72us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.571423:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 684 00000100:00100000:1.0:1746126612.571787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.572628:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721415552 00000100:00100000:0.0:1746126612.572635:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721415552 00010000:00010000:0.0:1746126612.572658:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 22 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746126612.572694:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6999 00000100:00100000:0.0:1746126612.572700:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721415552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.572712:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.572736:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 22 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.572747:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 22 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.572765:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e82586761330c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d967 expref: 22 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.572777:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.572779:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.572786:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.572793:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.572823:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126612.572863:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721354624:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126612.572927:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.576569:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721354624:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126612.576600:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126612.576655:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721415552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3951us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.576666:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6999 00000100:00100000:2.0:1746126612.578399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.578446:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721415808 00000100:00100000:0.0:1746126612.578457:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721415808 00002000:00100000:0.0:1746126612.578504:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009220b800 x1830945721415808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.578520:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b800 with x1830945721415808 ext(2097152->3145727) 00002000:00010000:0.0:1746126612.578525:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b800 00000100:00100000:0.0:1746126612.578557:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7660 00000100:00100000:0.0:1746126612.578565:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721415808:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126612.579329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.579409:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721416064 00000100:00100000:3.0:1746126612.579415:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721416064 00002000:00100000:3.0:1746126612.579435:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (3280896->3284991) req@ffff880092209180 x1830945721416064/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.579442:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209180 with x1830945721416064 ext(3280896->3284991) 00002000:00010000:3.0:1746126612.579446:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209180 00000100:00100000:3.0:1746126612.579458:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7661 00000100:00100000:3.0:1746126612.579462:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721416064:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126612.579643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.579724:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721416192 00000100:00100000:1.0:1746126612.579728:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721416192 00000100:00100000:1.0:1746126612.579752:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13440 00000100:00100000:1.0:1746126612.579757:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721416192:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.579766:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.579782:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9b4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.579800:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.579803:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.579812:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.579844:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.579856:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba94c00, rc 0) 00000100:00100000:1.0:1746126612.579877:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721416192:12345-192.168.203.2@tcp:101:cat.0 Request processed in 120us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.579883:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13440 00000100:00100000:3.0:1746126612.580208:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721416064:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 743us (879us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.580215:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7661 00002000:00100000:3.0:1746126612.580221:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (3280896->3284991) req@ffff880092209180 x1830945721416064/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.580228:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209180 with x1830945721416064 ext(3280896->3284991) 00002000:00010000:3.0:1746126612.580231:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209180 00000100:00100000:0.0:1746126612.581531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.581699:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721416320 00000100:00100000:2.0:1746126612.581706:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721416320 00000100:00100000:2.0:1746126612.581747:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13441 00000100:00100000:2.0:1746126612.581752:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721416320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.581765:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.581779:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbda00/0xb50e8258676133d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9bb expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126612.581841:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f256a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721354752:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126612.582210:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.585462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.586119:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721416576 00000100:00100000:3.0:1746126612.586129:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721416576 00002000:00100000:3.0:1746126612.586172:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009204ea00 x1830945721416576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.586181:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ea00 with x1830945721416576 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.586186:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204ea00 00000100:00100000:3.0:1746126612.586210:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7662 00000100:00100000:3.0:1746126612.586216:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721416576:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126612.589297:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f256a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721354752:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126612.589337:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbda00/0xb50e8258676133d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9bb expref: 22 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.589352:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbda00/0xb50e8258676133d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9bb expref: 22 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126612.589392:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbda00, rc 0) 00000100:00100000:2.0:1746126612.589454:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721416320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7700us (7925us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126612.589463:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13441 00000100:00100000:0.0:1746126612.593708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.593785:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721416832 00000100:00100000:1.0:1746126612.593795:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721416832 00002000:00100000:1.0:1746126612.593870:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009204d180 x1830945721416832/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 504/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.593880:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d180 with x1830945721416832 ext(3145728->4194303) 00002000:00010000:1.0:1746126612.593885:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204d180 00000100:00100000:1.0:1746126612.593913:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7663 00000100:00100000:1.0:1746126612.593921:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721416832:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126612.595472:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721415808:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16900us (17071us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126612.595483:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7660 00002000:00100000:0.0:1746126612.595493:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009220b800 x1830945721415808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.595502:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b800 with x1830945721415808 ext(2097152->3145727) 00002000:00010000:0.0:1746126612.595507:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b800 00000100:00100000:2.0:1746126612.608607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.608683:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417088 00000100:00100000:0.0:1746126612.608691:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417088 00002000:00100000:0.0:1746126612.608732:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008f256a00 x1830945721417088/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.608743:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256a00 with x1830945721417088 ext(2097152->3145727) 00002000:00010000:0.0:1746126612.608748:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256a00 00000100:00100000:0.0:1746126612.608764:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7664 00000100:00100000:0.0:1746126612.608770:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721417088:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126612.610664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.612193:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417216 00000100:00100000:2.0:1746126612.612203:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417216 00000100:00100000:2.0:1746126612.612241:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13442 00000100:00100000:2.0:1746126612.612249:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:31217:x1830945721417216:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126612.612264:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.612281:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9c2 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.612309:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.612316:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.612318:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.612321:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3428352->4014079] (req 3428352->4014079) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.612350:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.612364:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126612.612376:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721354880:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.617395:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721416832:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23462us (23686us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746126612.617408:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7663 00002000:00100000:1.0:1746126612.617423:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009204d180 x1830945721416832/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 504/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.617432:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d180 with x1830945721416832 ext(3145728->4194303) 00010000:00010000:1.0:1746126612.617442:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 8 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746126612.617456:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 8 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746126612.617468:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009204d180 00000100:00100000:2.0:1746126612.619226:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.621076:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721354880:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126612.621117:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3428352->4014079] (req 3428352->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.621133:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b200, rc 0) 00000100:00100000:2.0:1746126612.621173:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+22:31217:x1830945721417216:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8924us (10514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.621181:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13442 00000100:00100000:3.0:1746126612.621667:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721416576:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 35449us (36212us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126612.621677:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7662 00002000:00100000:3.0:1746126612.621686:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009204ea00 x1830945721416576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.621694:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ea00 with x1830945721416576 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.621699:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204ea00 00000100:00100000:2.0:1746126612.625212:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721417088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16431us (16603us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.625225:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7664 00002000:00100000:2.0:1746126612.625237:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008f256a00 x1830945721417088/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.625247:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256a00 with x1830945721417088 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.625253:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256a00 00000100:00100000:2.0:1746126612.630942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.630971:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417600 00000100:00100000:2.0:1746126612.630981:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417600 00000100:00100000:2.0:1746126612.631032:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13443 00000100:00100000:2.0:1746126612.631040:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31215:x1830945721417600:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.631059:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.631076:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9c9 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.631119:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.631125:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3428352->4014079] (req 3428352->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.631132:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126612.631135:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.631171:0:4641:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3428352->4014079] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 21 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.631183:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.631193:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b732800, rc 0) 00000100:00100000:2.0:1746126612.631234:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31215:x1830945721417600:12345-192.168.203.2@tcp:101:cat.0 Request processed in 195us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.631240:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13443 00000100:00100000:2.0:1746126612.631283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.631303:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417472 00000100:00100000:2.0:1746126612.631306:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417472 00002000:00100000:2.0:1746126612.631333:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3280896->4194303) req@ffff88008f256680 x1830945721417472/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.631342:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256680 with x1830945721417472 ext(3280896->4194303) 00010000:00010000:2.0:1746126612.631348:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.631364:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126612.631370:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f256680 00000100:00100000:2.0:1746126612.631382:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1747 00000100:00100000:2.0:1746126612.631388:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721417472:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126612.635549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.636456:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417728 00000100:00100000:2.0:1746126612.636467:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417728 00000100:00100000:2.0:1746126612.636512:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13444 00000100:00100000:2.0:1746126612.636519:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+22:31220:x1830945721417728:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126612.636538:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126612.636556:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9d0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.636583:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.636585:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126612.636590:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.636601:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126612.636611:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d87e600, rc 0) 00000100:00100000:2.0:1746126612.636862:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+23:31220:x1830945721417728:12345-192.168.203.2@tcp:101:cat.0 Request processed in 342us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.636872:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13444 00000100:00100000:2.0:1746126612.638403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.638524:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417856 00000100:00100000:1.0:1746126612.638531:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417856 00000100:00100000:1.0:1746126612.638567:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13445 00000100:00100000:1.0:1746126612.638574:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31211:x1830945721417856:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.638588:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.638603:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9d7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.638627:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.638635:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.638641:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.638642:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.638646:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4239359] (req 4194304->4239359) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.638675:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.638685:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 15 pid: 8436 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.638701:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721355136:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.638773:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.638780:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126612.638788:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721355264:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.638974:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.643001:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721355136:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.643017:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721355264:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.643044:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4239359] (req 4194304->4239359) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.643061:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba95200, rc 0) 00000100:00100000:1.0:1746126612.643126:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31211:x1830945721417856:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4551us (4726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.643134:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13445 00000100:00100000:0.0:1746126612.645586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.648431:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721417472:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 17031us (17136us total) trans 17179873184 rc 0/0 00000100:00100000:2.0:1746126612.648445:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1747 00002000:00100000:2.0:1746126612.648457:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3280896->4194303) req@ffff88008f256680 x1830945721417472/t17179873184(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.648466:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256680 with x1830945721417472 ext(3280896->4194303) 00010000:00010000:2.0:1746126612.648476:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 11 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.648490:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 11 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126612.648497:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f256680 00000100:00100000:0.0:1746126612.648756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.648804:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417984 00000100:00100000:2.0:1746126612.648812:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417984 00010000:00010000:2.0:1746126612.648857:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126612.648877:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418112 00000100:00100000:2.0:1746126612.648880:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418112 00010000:00010000:2.0:1746126612.648889:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 16 pid: 8436 timeout: 834 lvb_type: 1 00000100:00100000:2.0:1746126612.648904:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7000 00000100:00100000:2.0:1746126612.648911:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721417984:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126612.648923:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126612.648941:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.648950:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.648972:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e825867613375 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d998 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.649000:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126612.649118:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7001 00000100:00100000:0.0:1746126612.649125:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721418112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.649133:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.649144:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 16 pid: 8436 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.649152:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 16 pid: 8436 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.649165:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba94c00/0xb50e8258676133c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9b4 expref: 16 pid: 8436 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.649177:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.649179:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.649185:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.649193:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.649231:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126612.649241:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721355392:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126612.649502:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721417984:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 590us (3921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.649509:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7000 00000100:00100000:0.0:1746126612.649567:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.654564:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721355392:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126612.654589:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126612.654650:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721418112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5523us (5893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.654661:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7001 00000100:00100000:0.0:1746126612.655652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.655699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.655806:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418368 00000100:00100000:2.0:1746126612.655813:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418368 00002000:00100000:2.0:1746126612.655885:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4235264->4239359) req@ffff88009e3a7100 x1830945721418368/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.655893:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7100 with x1830945721418368 ext(4235264->4239359) 00002000:00010000:2.0:1746126612.655898:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a7100 00000100:00100000:2.0:1746126612.655916:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7665 00000100:00100000:2.0:1746126612.655922:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721418368:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126612.655994:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418496 00000100:00100000:3.0:1746126612.655998:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418496 00010000:00010000:3.0:1746126612.656018:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 11 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:3.0:1746126612.656037:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7002 00000100:00100000:3.0:1746126612.656041:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721418496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.656049:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.656070:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 11 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.656081:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 11 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.656117:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba95800/0xb50e82586761339f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9a6 expref: 11 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.656147:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.656150:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.656157:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.656164:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.656193:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 22 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.656203:0:7073:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 22 pid: 4641 timeout: 834 lvb_type: 0 00000100:00100000:3.0:1746126612.656213:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721355520:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.656275:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126612.656485:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721418368:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 561us (835us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126612.656491:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7665 00002000:00100000:2.0:1746126612.656497:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4235264->4239359) req@ffff88009e3a7100 x1830945721418368/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.656504:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7100 with x1830945721418368 ext(4235264->4239359) 00002000:00010000:2.0:1746126612.656507:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3a7100 00000100:00100000:3.0:1746126612.659058:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721355520:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126612.659082:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.659127:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721418496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3084us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.659137:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7002 00000100:00100000:0.0:1746126612.659888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.659932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.660119:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419008 00000100:00100000:1.0:1746126612.660126:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419008 00000100:00100000:1.0:1746126612.660158:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3761 00000100:00100000:1.0:1746126612.660163:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31211:x1830945721419008:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126612.660344:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31211:x1830945721419008:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 180us (411us total) trans 8589943084 rc 0/0 00000100:00100000:1.0:1746126612.660350:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3761 00000100:00100000:2.0:1746126612.660435:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418752 00000100:00100000:2.0:1746126612.660438:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418752 00002000:00100000:2.0:1746126612.660460:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (3428352->3432447) req@ffff88009e3a7800 x1830945721418752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.660469:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7800 with x1830945721418752 ext(3428352->3432447) 00010000:00010000:2.0:1746126612.660477:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.660490:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126612.660497:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a7800 00000100:00100000:2.0:1746126612.660521:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1748 00000100:00100000:2.0:1746126612.660525:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721418752:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126612.660633:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721418752:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 107us (748us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126612.660639:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1748 00002000:00100000:2.0:1746126612.660643:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (3428352->3432447) req@ffff88009e3a7800 x1830945721418752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.660650:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a7800 with x1830945721418752 ext(3428352->3432447) 00010000:00010000:2.0:1746126612.660653:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.660661:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126612.660667:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a7800 00000100:00100000:0.0:1746126612.669688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.669865:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419264 00000100:00100000:3.0:1746126612.669876:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419264 00002000:00100000:3.0:1746126612.669926:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (4009984->4014079) req@ffff88009e3a4700 x1830945721419264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.669935:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4700 with x1830945721419264 ext(4009984->4014079) 00010000:00010000:3.0:1746126612.669945:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.669959:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.669966:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a4700 00000100:00100000:3.0:1746126612.669994:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1749 00000100:00100000:3.0:1746126612.670001:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721419264:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126612.670488:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721419264:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 485us (813us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.670494:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1749 00002000:00100000:3.0:1746126612.670500:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (4009984->4014079) req@ffff88009e3a4700 x1830945721419264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.670507:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a4700 with x1830945721419264 ext(4009984->4014079) 00010000:00010000:3.0:1746126612.670512:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.670521:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.670526:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a4700 00000100:00100000:0.0:1746126612.676170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.676627:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419520 00000100:00100000:3.0:1746126612.676637:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419520 00002000:00100000:3.0:1746126612.676682:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3428352->4014079) req@ffff88009e3a5f80 x1830945721419520/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.676691:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5f80 with x1830945721419520 ext(3428352->4014079) 00010000:00010000:3.0:1746126612.676702:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.676715:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 23 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.676721:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a5f80 00000100:00100000:3.0:1746126612.676911:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1750 00000100:00100000:3.0:1746126612.676920:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721419520:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126612.690580:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721419520:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 13651us (14410us total) trans 17179873185 rc 0/0 00000100:00100000:3.0:1746126612.690592:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1750 00002000:00100000:3.0:1746126612.690604:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3428352->4014079) req@ffff88009e3a5f80 x1830945721419520/t17179873185(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.690612:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5f80 with x1830945721419520 ext(3428352->4014079) 00010000:00010000:3.0:1746126612.690622:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 25 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.690637:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 25 pid: 4641 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.690643:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e3a5f80 00000100:00100000:0.0:1746126612.695939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.696120:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419648 00000100:00100000:3.0:1746126612.696130:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419648 00010000:00010000:3.0:1746126612.696254:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 25 pid: 4641 timeout: 834 lvb_type: 0 00000100:00100000:3.0:1746126612.696295:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7003 00000100:00100000:3.0:1746126612.696303:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721419648:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.696318:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.696340:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 25 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.696351:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 25 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.696375:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e8258676133d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3428352->4014079) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c2 expref: 25 pid: 4641 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.696405:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.696407:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.696414:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.696422:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.696430:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.696431:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.696434:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.696440:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.696508:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.696520:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721355648:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126612.696623:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.696632:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721355776:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.696651:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126612.698983:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721355648:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.698995:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721355776:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126612.699018:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.699061:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721419648:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2758us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.699071:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7003 00000100:00100000:0.0:1746126612.701505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.701595:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419904 00000100:00100000:3.0:1746126612.701713:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419904 00002000:00100000:3.0:1746126612.701765:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e3a5500 x1830945721419904/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.701775:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5500 with x1830945721419904 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.701779:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a5500 00000100:00100000:3.0:1746126612.702259:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7666 00000100:00100000:3.0:1746126612.702267:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721419904:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126612.702542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.702972:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420160 00000100:00100000:2.0:1746126612.702977:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420160 00002000:00100000:2.0:1746126612.702999:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e3a6d80 x1830945721420160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.703007:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a6d80 with x1830945721420160 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.703010:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a6d80 00000100:00100000:2.0:1746126612.703138:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7667 00000100:00100000:2.0:1746126612.703145:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721420160:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126612.714136:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721420160:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 10978us (11579us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.714149:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7667 00002000:00100000:2.0:1746126612.714160:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e3a6d80 x1830945721420160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.714175:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a6d80 with x1830945721420160 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.714181:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a6d80 00000100:00100000:3.0:1746126612.714813:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721419904:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 12545us (13314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126612.714820:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7666 00002000:00100000:3.0:1746126612.714850:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e3a5500 x1830945721419904/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.714858:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3a5500 with x1830945721419904 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.714861:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3a5500 00000100:00100000:0.0:1746126612.720262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.720327:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420288 00000100:00100000:1.0:1746126612.720337:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420288 00000100:00100000:1.0:1746126612.720390:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13446 00000100:00100000:1.0:1746126612.720398:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:31220:x1830945721420288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.720417:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.720434:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9de expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.720461:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.720468:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126612.720470:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126612.720472:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.720501:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.720512:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 7 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126612.720523:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721355904:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.720619:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.725282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.725382:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420544 00000100:00100000:3.0:1746126612.725393:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420544 00002000:00100000:3.0:1746126612.725444:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4239360->4976639) req@ffff88009f135880 x1830945721420544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.725454:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135880 with x1830945721420544 ext(4239360->4976639) 00010000:00010000:3.0:1746126612.725463:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 8 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.725478:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 8 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.725485:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f135880 00000100:00100000:3.0:1746126612.725520:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1751 00000100:00100000:3.0:1746126612.725527:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721420544:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126612.725629:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721355904:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.725653:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.725667:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba95e00, rc 0) 00000100:00100000:1.0:1746126612.725711:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:31220:x1830945721420288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5314us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.725718:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13446 00000100:00100000:0.0:1746126612.726162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.726255:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420672 00000100:00100000:2.0:1746126612.726259:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420672 00002000:00100000:2.0:1746126612.726277:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4239359) req@ffff88009f136300 x1830945721420672/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.726284:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f136300 with x1830945721420672 ext(4194304->4239359) 00010000:00010000:2.0:1746126612.726289:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126612.726298:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 9 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126612.726304:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f136300 00000100:00100000:2.0:1746126612.726316:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1752 00000100:00100000:2.0:1746126612.726321:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721420672:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126612.733530:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721420672:12345-192.168.203.2@tcp:4:cat.0 Request processed in 7198us (7358us total) trans 21474840339 rc 0/0 00000100:00100000:0.0:1746126612.733541:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1752 00002000:00100000:0.0:1746126612.733554:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4239359) req@ffff88009f136300 x1830945721420672/t21474840339(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/448 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126612.733563:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f136300 with x1830945721420672 ext(4194304->4239359) 00010000:00010000:0.0:1746126612.733573:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 12 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746126612.733587:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 12 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746126612.733594:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f136300 00000100:00100000:3.0:1746126612.734944:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721420544:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9412us (9668us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746126612.734953:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1751 00002000:00100000:3.0:1746126612.734961:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4239360->4976639) req@ffff88009f135880 x1830945721420544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:H/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.734969:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135880 with x1830945721420544 ext(4239360->4976639) 00010000:00010000:3.0:1746126612.734976:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 10 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.734987:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 10 pid: 8436 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126612.734993:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f135880 00000100:00100000:0.0:1746126612.738931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.738980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.739074:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420928 00000100:00100000:3.0:1746126612.739084:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420928 00010000:00010000:3.0:1746126612.739129:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 10 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:3.0:1746126612.739159:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7004 00000100:00100000:3.0:1746126612.739166:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721420928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.739182:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.739203:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 10 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.739215:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 10 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.739239:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95200/0xb50e8258676133ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4239359) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d7 expref: 10 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126612.739263:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.739265:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.739271:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.739278:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.739308:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126612.739319:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721356032:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.739401:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.739463:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420800 00000100:00100000:1.0:1746126612.739467:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420800 00000100:00100000:1.0:1746126612.739487:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13447 00000100:00100000:1.0:1746126612.739492:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721420800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.739504:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.739515:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9e5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.739529:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.739530:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.739534:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.739545:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.739552:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba94a00, rc 0) 00000100:00100000:1.0:1746126612.739574:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721420800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 82us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.739579:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13447 00000100:00100000:0.0:1746126612.742799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.743295:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421184 00000100:00100000:3.0:1746126612.743305:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421184 00002000:00100000:3.0:1746126612.743350:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff88008e720380 x1830945721421184/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.743360:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720380 with x1830945721421184 ext(4972544->4976639) 00002000:00010000:3.0:1746126612.743365:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e720380 00000100:00100000:2.0:1746126612.743367:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721356032:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126612.743384:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7668 00010000:00010000:2.0:1746126612.743389:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.743391:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721421184:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126612.743431:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721420928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4265us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.743440:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7004 00000100:00100000:3.0:1746126612.743546:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721421184:12345-192.168.203.2@tcp:3:cat.0 Request processed in 155us (757us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126612.743552:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7668 00002000:00100000:3.0:1746126612.743558:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff88008e720380 x1830945721421184/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.743564:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720380 with x1830945721421184 ext(4972544->4976639) 00002000:00010000:3.0:1746126612.743566:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e720380 00000100:00100000:0.0:1746126612.750459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.750513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.750654:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421696 00000100:00100000:1.0:1746126612.750654:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421440 00000100:00100000:3.0:1746126612.750663:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421696 00000100:00100000:1.0:1746126612.750663:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421440 00002000:00100000:1.0:1746126612.750707:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008e723800 x1830945721421440/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.750717:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e723800 with x1830945721421440 ext(3145728->4194303) 00002000:00010000:1.0:1746126612.750722:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e723800 00000100:00100000:1.0:1746126612.750742:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7669 00000100:00100000:1.0:1746126612.750749:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721421440:12345-192.168.203.2@tcp:3:multiop.0 00002000:00100000:3.0:1746126612.751490:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008e722680 x1830945721421696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.751497:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722680 with x1830945721421696 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.751501:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722680 00000100:00100000:3.0:1746126612.751515:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7670 00000100:00100000:3.0:1746126612.751521:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721421696:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126612.763966:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721421440:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 13204us (13439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126612.763979:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7669 00002000:00100000:1.0:1746126612.763993:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008e723800 x1830945721421440/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.764002:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e723800 with x1830945721421440 ext(3145728->4194303) 00002000:00010000:1.0:1746126612.764008:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e723800 00000100:00100000:2.0:1746126612.766637:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721421696:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 15105us (16177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.766650:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7670 00002000:00100000:2.0:1746126612.766661:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008e722680 x1830945721421696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.766670:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722680 with x1830945721421696 ext(3145728->4194303) 00002000:00010000:2.0:1746126612.766675:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722680 00000100:00100000:0.0:1746126612.769685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.769758:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421952 00000100:00100000:2.0:1746126612.769768:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421952 00002000:00100000:2.0:1746126612.769813:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008e722d80 x1830945721421952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.769823:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722d80 with x1830945721421952 ext(4194304->4976639) 00002000:00010000:2.0:1746126612.769849:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e722d80 00000100:00100000:2.0:1746126612.769879:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7671 00000100:00100000:2.0:1746126612.769886:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721421952:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126612.779755:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721421952:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 9857us (10067us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126612.779767:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7671 00002000:00100000:2.0:1746126612.779781:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008e722d80 x1830945721421952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 782336/782336 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.779790:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722d80 with x1830945721421952 ext(4194304->4976639) 00002000:00010000:2.0:1746126612.779795:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e722d80 00000100:00100000:0.0:1746126612.805908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.806076:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422208 00000100:00100000:1.0:1746126612.806126:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422208 00000100:00100000:1.0:1746126612.806181:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8915 00000100:00100000:1.0:1746126612.806188:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31225:x1830945721422208:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.806212:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.806229:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94e00/0xb50e825867613401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9ec expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.806447:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806463:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806473:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806483:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806488:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806492:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806585:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94200/0xb50e825867613416 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806593:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94200/0xb50e825867613416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806599:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94200/0xb50e825867613416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126612.806608:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126612.806694:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806701:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806706:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806715:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba94600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.806717:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806723:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806732:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126612.806734:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.806738:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.806742:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94600/0xb50e825867613408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807401:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807408:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807412:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807417:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba94400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.807419:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807424:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807433:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5200) 00010000:00010000:1.0:1746126612.807435:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.807437:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807442:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94400/0xb50e82586761340f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.807490:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94e00/0xb50e825867613401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9ec expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.807500:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94200/0xb50e825867613416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9ec expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.807506:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.807508:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126612.807510:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba94200, rc 0) 00000100:00100000:1.0:1746126612.809421:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31225:x1830945721422208:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3224us (3515us total) trans 8589943085 rc 0/0 00000100:00100000:1.0:1746126612.809431:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8915 00000100:00100000:2.0:1746126612.815374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.815453:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422336 00000100:00100000:0.0:1746126612.815464:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422336 00000100:00100000:0.0:1746126612.815522:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 685 00000100:00100000:0.0:1746126612.815530:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721422336:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.815546:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.815571:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba94200/0xb50e825867613416 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9ec expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.815601:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126612.815605:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126612.815643:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721422336:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126612.815649:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 685 00010000:00010000:0.0:1746126612.816994:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126612.870553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.870622:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422592 00000100:00100000:1.0:1746126612.870632:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422592 00000100:00100000:1.0:1746126612.870692:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8916 00000100:00100000:1.0:1746126612.870700:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31229:x1830945721422592:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126612.870725:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.870743:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95200/0xb50e825867613424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9f3 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.870896:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.870908:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.870920:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.870931:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.870936:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.870942:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871052:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e825867613439 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871061:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e825867613439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871067:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e825867613439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126612.871075:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126612.871169:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871180:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871186:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871192:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba95a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.871195:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871201:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871210:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126612.871213:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.871216:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871222:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95a00/0xb50e82586761342b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871252:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871257:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871261:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871265:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba95000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126612.871267:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871271:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871277:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5e00) 00010000:00010000:1.0:1746126612.871278:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126612.871280:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871285:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95000/0xb50e825867613432 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126612.871321:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95200/0xb50e825867613424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9f3 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.871332:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e825867613439 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9f3 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.871337:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126612.871339:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126612.871341:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba95600, rc 0) 00000100:00100000:1.0:1746126612.871397:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31229:x1830945721422592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 696us (854us total) trans 8589943086 rc 0/0 00000100:00100000:1.0:1746126612.871404:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8916 00000100:00100000:2.0:1746126612.879155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.879201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.879369:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422720 00000100:00100000:0.0:1746126612.879379:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422720 00000100:00100000:0.0:1746126612.879446:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 686 00000100:00100000:0.0:1746126612.879455:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721422720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.879472:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.879496:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba95600/0xb50e825867613439 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9f3 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.879522:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126612.879526:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126612.879568:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721422720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126612.879574:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 686 00000100:00100000:1.0:1746126612.880577:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422976 00000100:00100000:1.0:1746126612.880582:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422976 00000100:00100000:1.0:1746126612.881173:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3762 00000100:00100000:1.0:1746126612.881181:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31229:x1830945721422976:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126612.882052:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31229:x1830945721422976:12345-192.168.203.2@tcp:35:cat.0 Request processed in 869us (2847us total) trans 8589943087 rc 0/0 00000100:00100000:1.0:1746126612.882059:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3762 00000100:00100000:0.0:1746126612.909634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.909682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.909761:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721423488 00000100:00100000:2.0:1746126612.909771:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721423488 00002000:00100000:2.0:1746126612.909821:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5965180 x1830945721423488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.909862:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965180 with x1830945721423488 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.909868:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965180 00000100:00100000:2.0:1746126612.909902:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7672 00000100:00100000:2.0:1746126612.909909:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721423488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.910152:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721423232 00000100:00100000:3.0:1746126612.910156:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721423232 00000100:00100000:3.0:1746126612.910183:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8917 00000100:00100000:3.0:1746126612.910187:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:31231:x1830945721423232:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126612.910200:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126612.910217:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb400/0xb50e825867613447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4d9fa expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.910310:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910321:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910331:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910343:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910348:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910353:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910454:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cac00/0xb50e82586761345c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910462:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cac00/0xb50e82586761345c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.910468:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cac00/0xb50e82586761345c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126612.910476:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126612.914550:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914564:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914570:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914574:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45cb800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126612.914578:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914584:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914601:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126612.914604:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126612.914608:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914612:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb800/0xb50e82586761344e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914645:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914649:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914653:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914657:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45ca600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126612.914658:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914662:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914667:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005100) 00010000:00010000:3.0:1746126612.914668:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126612.914670:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914674:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca600/0xb50e825867613455 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126612.914727:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cb400/0xb50e825867613447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9fa expref: 235 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.914741:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cac00/0xb50e82586761345c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9fa expref: 234 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.914747:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126612.914749:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126612.914751:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45cac00, rc 0) 00000100:00100000:3.0:1746126612.914811:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+234:31231:x1830945721423232:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4622us (5186us total) trans 8589943088 rc 0/0 00000100:00100000:3.0:1746126612.914819:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8917 00000100:00100000:0.0:1746126612.921662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.921702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.923070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.923244:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721424128 00000100:00100000:1.0:1746126612.923254:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721424128 00002000:00100000:1.0:1746126612.923299:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5964e00 x1830945721424128/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.923309:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964e00 with x1830945721424128 ext(2097152->3145727) 00002000:00010000:1.0:1746126612.923314:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5964e00 00000100:00100000:1.0:1746126612.923333:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721423872 00000100:00100000:1.0:1746126612.923336:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721423872 00002000:00100000:1.0:1746126612.923348:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d919880 x1830945721423872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.923355:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919880 with x1830945721423872 ext(3145728->4194303) 00002000:00010000:1.0:1746126612.923358:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d919880 00000100:00100000:0.0:1746126612.925747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.925942:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721424000 00000100:00100000:3.0:1746126612.925950:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721424000 00000100:00100000:3.0:1746126612.926017:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 687 00000100:00100000:3.0:1746126612.926024:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+234:1966:x1830945721424000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.926046:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.926072:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cac00/0xb50e82586761345c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9fa expref: 234 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.926102:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126612.926106:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.926146:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+233:1966:x1830945721424000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 123us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.926158:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 687 00000100:00100000:2.0:1746126612.926271:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7673 00000100:00100000:1.0:1746126612.926272:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721424384 00000100:00100000:1.0:1746126612.926276:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721424384 00000100:00100000:2.0:1746126612.926281:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721424128:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.926293:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7674 00000100:00100000:1.0:1746126612.926299:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3763 00000100:00100000:3.0:1746126612.926301:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721423872:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126612.926304:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:31231:x1830945721424384:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126612.926462:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+234:31231:x1830945721424384:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 158us (723us total) trans 8589943089 rc 0/0 00000100:00100000:1.0:1746126612.926468:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3763 00000100:00100000:1.0:1746126612.929727:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721423488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19808us (20032us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126612.929741:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7672 00002000:00100000:1.0:1746126612.929755:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5965180 x1830945721423488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.929764:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965180 with x1830945721423488 ext(2097152->3145727) 00002000:00010000:1.0:1746126612.929770:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965180 00000100:00100000:0.0:1746126612.940054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.942724:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721424640 00000100:00100000:1.0:1746126612.942738:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721424640 00002000:00100000:1.0:1746126612.944159:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4972543) req@ffff88012d91ad80 x1830945721424640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126612.944171:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91ad80 with x1830945721424640 ext(4194304->4972543) 00002000:00010000:1.0:1746126612.944178:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91ad80 00000100:00100000:1.0:1746126612.944230:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7675 00000100:00100000:1.0:1746126612.944244:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721424640:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.946310:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721423872:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20001us (24599us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126612.946321:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7674 00002000:00100000:3.0:1746126612.946331:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d919880 x1830945721423872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126612.946340:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919880 with x1830945721423872 ext(3145728->4194303) 00002000:00010000:3.0:1746126612.946346:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d919880 00000100:00100000:2.0:1746126612.954469:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721424128:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28178us (32805us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126612.954481:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7673 00002000:00100000:2.0:1746126612.954494:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5964e00 x1830945721424128/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.954503:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964e00 with x1830945721424128 ext(2097152->3145727) 00002000:00010000:2.0:1746126612.954509:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5964e00 00000100:00100000:2.0:1746126612.956415:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721424640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12171us (16364us total) trans 0 rc 778240/778240 00000100:00100000:2.0:1746126612.956429:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7675 00002000:00100000:2.0:1746126612.956437:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4972543) req@ffff88012d91ad80 x1830945721424640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/440 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.956445:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91ad80 with x1830945721424640 ext(4194304->4972543) 00002000:00010000:2.0:1746126612.956450:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91ad80 00000100:00100000:0.0:1746126612.958910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.959009:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721424768 00000100:00100000:1.0:1746126612.959096:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721424768 00000100:00100000:1.0:1746126612.959155:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13448 00000100:00100000:1.0:1746126612.959163:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31225:x1830945721424768:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.959181:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.959199:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da01 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.959226:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 23 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.959233:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.959240:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.959246:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.959248:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.959251:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1536000->2097151] (req 1536000->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.959281:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.959298:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 7 pid: 8437 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.959310:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721356160:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.959439:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.959449:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.959458:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721356288:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.960696:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 23 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.960706:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 23 pid: 4642 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.960714:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721356416:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.961047:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.963264:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721356160:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126612.965280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.965379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.965456:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425024 00000100:00100000:3.0:1746126612.965464:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425024 00000100:00100000:3.0:1746126612.965506:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13449 00000100:00100000:3.0:1746126612.965518:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721425024:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126612.965538:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126612.965556:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a45cbe00/0xb50e825867613471 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da08 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126612.965579:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126612.965590:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a45cbe00/0xb50e825867613471 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da08 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126612.965600:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a45cbe00/0xb50e825867613471 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da08 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126612.965615:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45cbe00, rc 0) 00000100:00100000:1.0:1746126612.965657:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721356288:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126612.965658:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721425024:12345-192.168.203.2@tcp:101:cat.0 Request processed in 140us (280us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126612.965664:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13449 00000100:00100000:1.0:1746126612.965667:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721356416:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.965694:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1536000->2097151] (req 1536000->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.965704:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29600, rc 0) 00000100:00100000:1.0:1746126612.965722:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31225:x1830945721424768:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6561us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.965728:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13448 00000100:00100000:2.0:1746126612.966213:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721424896 00000100:00100000:2.0:1746126612.966218:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721424896 00010000:00010000:2.0:1746126612.966238:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 8 pid: 8437 timeout: 834 lvb_type: 1 00000100:00100000:2.0:1746126612.966686:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7005 00000100:00100000:2.0:1746126612.966692:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721424896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126612.966702:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126612.966720:0:7072:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:2.0:1746126612.966725:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 8 pid: 8437 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.966734:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 8 pid: 8437 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.966751:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebba400/0xb50e82586761316f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8a3 expref: 8 pid: 8437 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.966777:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126612.966797:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721424896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.966802:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7005 00000100:00100000:0.0:1746126612.967344:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.968328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.968467:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425152 00000100:00100000:2.0:1746126612.968473:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425152 00010000:00010000:2.0:1746126612.968497:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00000100:00100000:2.0:1746126612.968516:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425280 00000100:00100000:2.0:1746126612.968518:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425280 00010000:00010000:2.0:1746126612.968527:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 24 pid: 4642 timeout: 834 lvb_type: 1 00000100:00100000:2.0:1746126612.968542:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7006 00000100:00100000:2.0:1746126612.968547:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721425152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126612.968558:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126612.968575:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.968584:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.968602:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093050400/0xb50e82586761325d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e9 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00010000:00010000:2.0:1746126612.968615:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126612.968694:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7007 00000100:00100000:0.0:1746126612.968702:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721425280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.968710:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.968720:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 24 pid: 4642 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.968730:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 24 pid: 4642 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.968748:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee07600/0xb50e825867613137 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d85d expref: 24 pid: 4642 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.968762:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.968763:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.968771:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.968779:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.968808:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126612.968820:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721356544:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126612.969018:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721425152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 469us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.969026:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7006 00000100:00100000:3.0:1746126612.969585:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.973063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.973213:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425536 00000100:00100000:2.0:1746126612.973223:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425536 00000100:00100000:3.0:1746126612.973256:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721356544:192.168.203.2@tcp:105: 00002000:00100000:2.0:1746126612.973275:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1536000->1540095) req@ffff88008e3a9500 x1830945721425536/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746126612.973277:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746126612.973284:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9500 with x1830945721425536 ext(1536000->1540095) 00002000:00010000:2.0:1746126612.973289:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9500 00000100:00100000:2.0:1746126612.973307:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7676 00000100:00100000:3.0:1746126612.973319:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721425280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4618us (4992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126612.973319:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721425536:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126612.973328:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7007 00000100:00100000:2.0:1746126612.974144:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721425536:12345-192.168.203.2@tcp:3:cat.0 Request processed in 829us (1089us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126612.974150:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7676 00002000:00100000:2.0:1746126612.974156:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1536000->1540095) req@ffff88008e3a9500 x1830945721425536/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126612.974163:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9500 with x1830945721425536 ext(1536000->1540095) 00002000:00010000:2.0:1746126612.974166:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9500 00000100:00100000:0.0:1746126612.980511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126612.980605:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425664 00000100:00100000:1.0:1746126612.980615:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425664 00000100:00100000:1.0:1746126612.980721:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13450 00000100:00100000:1.0:1746126612.980730:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31225:x1830945721425664:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126612.980747:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126612.980764:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da0f expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.980791:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.980798:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.980804:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.980809:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.980810:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126612.980813:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.980964:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.980978:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 6 pid: 10890 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.980989:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721356672:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.981947:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.981957:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.981967:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721356800:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.982173:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 15 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126612.982182:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 15 pid: 4640 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126612.982190:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721356928:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.982412:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126612.987993:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721356672:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.988007:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721356800:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126612.988015:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721356928:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126612.988046:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126612.988064:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28a00, rc 0) 00000100:00100000:1.0:1746126612.988130:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31225:x1830945721425664:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7401us (7627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126612.988140:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13450 00000100:00100000:0.0:1746126612.988966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.989044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126612.989136:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425792 00000100:00100000:3.0:1746126612.989144:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425792 00010000:00010000:3.0:1746126612.990343:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 7 pid: 10890 timeout: 834 lvb_type: 1 00000100:00100000:3.0:1746126612.990383:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721425920 00000100:00100000:3.0:1746126612.990388:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721425920 00010000:00010000:3.0:1746126612.990409:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00000100:00100000:3.0:1746126612.990425:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7008 00000100:00100000:3.0:1746126612.990432:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721425792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.990447:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746126612.990467:0:7074:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:3.0:1746126612.990473:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 7 pid: 10890 timeout: 834 lvb_type: 1 00010000:00010000:3.0:1746126612.990482:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 7 pid: 10890 timeout: 834 lvb_type: 1 00010000:00010000:3.0:1746126612.990504:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e82586761318b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8aa expref: 7 pid: 10890 timeout: 834 lvb_type: 1 00010000:00010000:3.0:1746126612.990526:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.990583:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721425792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 152us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.990589:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7008 00000100:00100000:3.0:1746126612.990603:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7009 00000100:00100000:3.0:1746126612.990608:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721425920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126612.990615:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126612.990622:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00010000:00010000:3.0:1746126612.990630:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00010000:00010000:3.0:1746126612.990641:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093050e00/0xb50e825867613264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8f0 expref: 11 pid: 8438 timeout: 834 lvb_type: 1 00010000:00010000:3.0:1746126612.990649:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126612.990663:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721425920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 55us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126612.990668:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7009 00000100:00100000:2.0:1746126612.991160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126612.991211:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721426048 00000100:00100000:0.0:1746126612.991215:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721426048 00010000:00010000:0.0:1746126612.991232:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 16 pid: 4640 timeout: 834 lvb_type: 1 00000100:00100000:0.0:1746126612.991245:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7010 00000100:00100000:0.0:1746126612.991249:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721426048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126612.991256:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126612.991264:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 16 pid: 4640 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.991272:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 16 pid: 4640 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.991284:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f86e00/0xb50e825867613129 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d864 expref: 16 pid: 4640 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746126612.991294:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.991296:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126612.991302:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.991309:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126612.991337:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126612.991346:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721357056:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126612.991398:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126612.999676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126612.999801:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721357056:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126612.999922:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.000065:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721426048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8812us (8904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.000077:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7010 00000100:00100000:3.0:1746126613.000188:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721426304 00000100:00100000:3.0:1746126613.000196:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721426304 00002000:00100000:3.0:1746126613.000238:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1314816->1318911) req@ffff88012b191c00 x1830945721426304/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/0 e 0 to 0 dl 1746126623 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.000247:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191c00 with x1830945721426304 ext(1314816->1318911) 00002000:00010000:3.0:1746126613.000253:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b191c00 00000100:00100000:3.0:1746126613.000268:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7677 00000100:00100000:3.0:1746126613.000275:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721426304:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126613.002172:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721426304:12345-192.168.203.2@tcp:3:cat.0 Request processed in 1889us (2498us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126613.002183:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7677 00002000:00100000:3.0:1746126613.002194:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1314816->1318911) req@ffff88012b191c00 x1830945721426304/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:373/0 lens 488/4536 e 0 to 0 dl 1746126623 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.002202:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191c00 with x1830945721426304 ext(1314816->1318911) 00002000:00010000:3.0:1746126613.002208:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b191c00 00000100:00100000:0.0:1746126613.010180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.010325:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721426560 00000100:00100000:1.0:1746126613.010337:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721426560 00000100:00100000:1.0:1746126613.010404:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3764 00000100:00100000:1.0:1746126613.010413:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31225:x1830945721426560:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126613.012749:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31225:x1830945721426560:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 2330us (2574us total) trans 8589943090 rc 0/0 00000100:00100000:1.0:1746126613.012759:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3764 00000100:00100000:1.0:1746126613.022425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.022456:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721426816 00000100:00100000:3.0:1746126613.022467:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721426816 00000100:00100000:3.0:1746126613.022528:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8918 00000100:00100000:3.0:1746126613.022537:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+234:31235:x1830945721426816:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.022564:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.022583:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cba00/0xb50e82586761347f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da16 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.022701:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022714:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022724:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022735:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022741:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022746:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022863:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cbc00/0xb50e825867613494 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022871:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cbc00/0xb50e825867613494 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022877:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cbc00/0xb50e825867613494 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126613.022886:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126613.022970:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022976:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022982:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022987:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45ca200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126613.022990:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.022997:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023007:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126613.023010:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126613.023013:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023018:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca200/0xb50e825867613486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023051:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023056:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023060:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023064:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45ca400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126613.023066:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023070:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023076:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005000) 00010000:00010000:3.0:1746126613.023078:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126613.023080:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023083:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45ca400/0xb50e82586761348d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.023130:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cba00/0xb50e82586761347f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da16 expref: 237 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.023146:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cbc00/0xb50e825867613494 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da16 expref: 236 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.023152:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.023154:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126613.023156:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45cbc00, rc 0) 00000100:00100000:3.0:1746126613.023211:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:31235:x1830945721426816:12345-192.168.203.2@tcp:101:cat.0 Request processed in 674us (797us total) trans 8589943091 rc 0/0 00000100:00100000:3.0:1746126613.023217:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8918 00000100:00100000:2.0:1746126613.027097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.027161:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427072 00000100:00100000:1.0:1746126613.027171:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427072 00000100:00100000:2.0:1746126613.027196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.027214:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427200 00000100:00100000:2.0:1746126613.027217:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427200 00000100:00100000:2.0:1746126613.027257:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 688 00000100:00100000:2.0:1746126613.027267:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+237:1966:x1830945721427200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.027282:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.027307:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cbc00/0xb50e825867613494 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da16 expref: 237 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.027334:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.027338:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.027382:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+236:1966:x1830945721427200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 118us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.027388:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 688 00000100:00100000:1.0:1746126613.027477:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3765 00000100:00100000:1.0:1746126613.027483:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+235:31235:x1830945721427072:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126613.027659:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+236:31235:x1830945721427072:12345-192.168.203.2@tcp:35:cat.0 Request processed in 176us (580us total) trans 8589943092 rc 0/0 00000100:00100000:1.0:1746126613.027665:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3765 00000100:00100000:0.0:1746126613.030758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.030812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.030867:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427328 00000100:00100000:3.0:1746126613.030876:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427328 00000100:00100000:3.0:1746126613.030923:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427456 00000100:00100000:3.0:1746126613.030924:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427456 00000100:00100000:1.0:1746126613.030930:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13451 00000100:00100000:1.0:1746126613.030945:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721427328:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126613.030946:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13452 00000100:00100000:3.0:1746126613.030951:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721427456:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.030962:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.030962:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.030978:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a45cbe00/0xb50e8258676134a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da24 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.030978:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e8258676134a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da1d expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126613.031026:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721357184:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126613.031027:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721357312:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126613.031111:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.031139:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746126613.032108:0:4641:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126611 -> 1746126612 00002000:00010000:3.0:1746126613.032111:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126611 -> 1746126612 00002000:00010000:3.0:1746126613.032113:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126611 -> 1746126612 00000100:00100000:3.0:1746126613.032132:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721357184:192.168.203.2@tcp:106: 00002000:00010000:1.0:1746126613.032154:0:4640:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126611 -> 1746126612 00010000:00010000:3.0:1746126613.032156:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a45cbe00/0xb50e8258676134a9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da24 expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746126613.032157:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126611 -> 1746126612 00002000:00010000:1.0:1746126613.032159:0:4640:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126611 -> 1746126612 00010000:00010000:3.0:1746126613.032166:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a45cbe00/0xb50e8258676134a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da24 expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126613.032171:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721357312:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.032174:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a45cbe00, rc 0) 00010000:00010000:1.0:1746126613.032183:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e8258676134a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da1d expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.032192:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e8258676134a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da1d expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126613.032197:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721427456:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1246us (1385us total) trans 0 rc 301/301 00010000:00010000:1.0:1746126613.032200:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28e00, rc 0) 00000100:00100000:3.0:1746126613.032203:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13452 00000100:00100000:1.0:1746126613.032377:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721427328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1438us (1629us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126613.032383:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13451 00000100:00100000:0.0:1746126613.039148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.039219:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427584 00000100:00100000:1.0:1746126613.039228:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427584 00000100:00100000:1.0:1746126613.039280:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13453 00000100:00100000:1.0:1746126613.039288:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:31235:x1830945721427584:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126613.039307:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.039324:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da2b expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.039353:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.039359:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126613.039361:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126613.039364:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.039393:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.039405:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 9 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126613.039416:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721357440:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126613.039493:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.042414:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721357440:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126613.042445:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 24 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.042463:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29a00, rc 0) 00000100:00100000:1.0:1746126613.042516:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:31235:x1830945721427584:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3228us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.042526:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13453 00000100:00100000:0.0:1746126613.045713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.047332:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427712 00000100:00100000:3.0:1746126613.047344:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427712 00002000:00100000:3.0:1746126613.047398:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1536000->2097151) req@ffff88012b191500 x1830945721427712/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.047408:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191500 with x1830945721427712 ext(1536000->2097151) 00010000:00010000:3.0:1746126613.047417:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 10 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:3.0:1746126613.047430:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 10 pid: 4640 timeout: 834 lvb_type: 0 00002000:00010000:3.0:1746126613.047436:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b191500 00000100:00100000:3.0:1746126613.047471:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1753 00000100:00100000:3.0:1746126613.047479:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721427712:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126613.060298:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721427712:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12808us (14582us total) trans 17179873186 rc 0/0 00000100:00100000:2.0:1746126613.060310:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1753 00002000:00100000:2.0:1746126613.060321:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1536000->2097151) req@ffff88012b191500 x1830945721427712/t17179873186(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.060330:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191500 with x1830945721427712 ext(1536000->2097151) 00010000:00010000:2.0:1746126613.060341:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 12 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.060355:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 12 pid: 4640 timeout: 834 lvb_type: 0 00002000:00010000:2.0:1746126613.060362:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b191500 00000100:00100000:0.0:1746126613.063353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.063451:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721427840 00000100:00100000:2.0:1746126613.063461:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721427840 00010000:00010000:2.0:1746126613.063496:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 12 pid: 4640 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126613.063523:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7011 00000100:00100000:2.0:1746126613.063530:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721427840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.063543:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.063563:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 12 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.063580:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 12 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.063604:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e82586761346a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1536000->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da01 expref: 12 pid: 4640 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.063637:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.063639:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.063647:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.063655:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.063689:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.063701:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721357568:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.063781:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.068793:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721357568:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126613.068821:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.069751:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721427840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6217us (6403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.069762:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7011 00000100:00100000:0.0:1746126613.075460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.075552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.075651:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428096 00000100:00100000:2.0:1746126613.075662:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428096 00002000:00100000:2.0:1746126613.075711:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88012b191f80 x1830945721428096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.075721:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191f80 with x1830945721428096 ext(1048576->2097151) 00002000:00010000:2.0:1746126613.075727:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b191f80 00000100:00100000:2.0:1746126613.075763:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7678 00000100:00100000:2.0:1746126613.075770:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721428096:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126613.076429:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428224 00000100:00100000:1.0:1746126613.076435:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428224 00000100:00100000:1.0:1746126613.076462:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13454 00000100:00100000:1.0:1746126613.076468:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:31231:x1830945721428224:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126613.076479:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.076496:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da32 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.076518:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.076526:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.076532:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.076534:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.076537:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3674112->4194303] (req 3674112->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.076565:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.076577:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 9 pid: 8436 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126613.076588:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721357696:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126613.076676:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.076684:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746126613.076692:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721357824:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126613.076711:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.088323:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721357696:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126613.088339:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721357824:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126613.088370:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3674112->4194303] (req 3674112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.088388:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29000, rc 0) 00000100:00100000:1.0:1746126613.089664:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:31231:x1830945721428224:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 13190us (14106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.089674:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13454 00000100:00100000:0.0:1746126613.092787:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.093004:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428480 00000100:00100000:2.0:1746126613.093013:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428480 00010000:00010000:2.0:1746126613.093053:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 834 lvb_type: 0 00000100:00100000:2.0:1746126613.093099:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7012 00000100:00100000:2.0:1746126613.093107:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721428480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.093123:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.093148:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.093159:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.093185:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba95e00/0xb50e8258676133f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9de expref: 16 pid: 8436 timeout: 834 lvb_type: 0 00010000:00010000:2.0:1746126613.093213:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.093254:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721428480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 147us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.093261:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7012 00000100:00100000:0.0:1746126613.100016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.100501:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428352 00000100:00100000:1.0:1746126613.100511:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428352 00010000:00010000:1.0:1746126613.100681:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 10 pid: 8436 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746126613.100719:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7013 00000100:00100000:1.0:1746126613.100726:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721428352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.100740:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.100764:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 10 pid: 8436 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746126613.100777:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 10 pid: 8436 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746126613.100799:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba94a00/0xb50e8258676133fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9e5 expref: 10 pid: 8436 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746126613.100817:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.100818:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.100843:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.100851:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.100887:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.100900:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721357952:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126613.100990:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.103323:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721428096:12345-192.168.203.2@tcp:3:cat.0 Request processed in 27544us (27865us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126613.103338:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7678 00002000:00100000:3.0:1746126613.103348:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88012b191f80 x1830945721428096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.103357:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191f80 with x1830945721428096 ext(1048576->2097151) 00002000:00010000:3.0:1746126613.103362:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b191f80 00000100:00100000:1.0:1746126613.104691:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721357952:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126613.104712:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.104754:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721428352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4028us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.104764:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7013 00000100:00100000:0.0:1746126613.105138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.105274:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428736 00000100:00100000:3.0:1746126613.105281:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428736 00002000:00100000:3.0:1746126613.105320:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3674112->3678207) req@ffff880099251f80 x1830945721428736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.105329:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251f80 with x1830945721428736 ext(3674112->3678207) 00002000:00010000:3.0:1746126613.105333:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251f80 00000100:00100000:3.0:1746126613.105358:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7679 00000100:00100000:3.0:1746126613.105365:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721428736:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126613.105884:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721428736:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 519us (746us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126613.105891:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7679 00002000:00100000:3.0:1746126613.105896:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3674112->3678207) req@ffff880099251f80 x1830945721428736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.105903:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251f80 with x1830945721428736 ext(3674112->3678207) 00002000:00010000:3.0:1746126613.105906:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251f80 00000100:00100000:0.0:1746126613.110024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.110252:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428864 00000100:00100000:2.0:1746126613.110262:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428864 00000100:00100000:2.0:1746126613.110318:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13455 00000100:00100000:2.0:1746126613.110326:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:31235:x1830945721428864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.110345:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.110442:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da39 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.110473:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 8 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.110480:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.110481:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.110484:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.110513:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 8 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.110525:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 8 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.110541:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721358080:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.111503:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.118496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.118661:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721358080:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.118693:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.118709:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18800, rc 0) 00000100:00100000:3.0:1746126613.119886:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721428992 00000100:00100000:3.0:1746126613.119895:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721428992 00000100:00100000:3.0:1746126613.119941:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13456 00000100:00100000:3.0:1746126613.119950:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:31231:x1830945721428992:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126613.119967:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.119984:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da40 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.120010:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 10 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.120017:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.120023:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.120025:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.120028:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->3448831] (req 3145728->3448831) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.120055:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.120065:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:3.0:1746126613.120076:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721358208:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.120891:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:31235:x1830945721428864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10560us (10870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.120900:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13455 00000100:00100000:0.0:1746126613.121265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.121286:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721429120 00000100:00100000:0.0:1746126613.121290:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721429120 00002000:00100000:0.0:1746126613.121324:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1318911) req@ffff880099252d80 x1830945721429120/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.121333:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099252d80 with x1830945721429120 ext(1048576->1318911) 00010000:00010000:0.0:1746126613.121340:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 9 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.121350:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 9 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746126613.121355:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099252d80 00000100:00100000:0.0:1746126613.121377:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1754 00000100:00100000:0.0:1746126613.121382:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721429120:12345-192.168.203.2@tcp:4:cat.0 00010000:00010000:3.0:1746126613.122797:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 10 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.122813:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 10 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:3.0:1746126613.122845:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721358336:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.122899:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.126484:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721358208:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126613.127399:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721429120:12345-192.168.203.2@tcp:4:cat.0 Request processed in 6012us (6131us total) trans 21474840340 rc 0/0 00000100:00100000:1.0:1746126613.127410:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1754 00002000:00100000:1.0:1746126613.127422:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1318911) req@ffff880099252d80 x1830945721429120/t21474840340(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.127431:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099252d80 with x1830945721429120 ext(1048576->1318911) 00010000:00010000:1.0:1746126613.127440:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.127453:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746126613.127458:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099252d80 00000100:00100000:3.0:1746126613.130573:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721358336:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.130609:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->3448831] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.130625:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d78bc00, rc 0) 00000100:00100000:3.0:1746126613.130679:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:31231:x1830945721428992:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10729us (12192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.130687:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13456 00000100:00100000:0.0:1746126613.134032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.135719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.135757:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721429376 00000100:00100000:1.0:1746126613.135767:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721429376 00010000:00010000:1.0:1746126613.135803:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 11 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746126613.135809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.136016:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721429248 00000100:00100000:1.0:1746126613.136020:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721429248 00010000:00010000:1.0:1746126613.136031:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746126613.136044:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721429504 00000100:00100000:1.0:1746126613.136045:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721429504 00010000:00010000:1.0:1746126613.136054:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746126613.136081:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7014 00000100:00100000:1.0:1746126613.136095:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721429376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.136108:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.136129:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 11 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.136139:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 11 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.136161:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b732800/0xb50e8258676133de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9c9 expref: 11 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.136179:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126613.136205:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7015 00000100:00100000:0.0:1746126613.136211:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721429248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126613.136218:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721429376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 124us (2195us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126613.136218:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126613.136223:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7014 00010000:00010000:0.0:1746126613.136226:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746126613.136239:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7016 00000100:00100000:1.0:1746126613.136244:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721429504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126613.136246:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.136251:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126613.136258:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e8258676133e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d9d0 expref: 25 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.136263:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.136271:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.136274:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.136276:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.136282:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.136287:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867613478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da0f expref: 11 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.136289:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.136295:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.136296:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.136299:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.136305:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.136317:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.136318:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.136328:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721358592:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126613.136328:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721358464:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126613.136372:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.137109:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.139449:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721358464:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126613.139470:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126613.139528:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721429248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3316us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126613.139537:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7015 00000100:00100000:1.0:1746126613.141559:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721358592:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126613.141582:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.141631:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721429504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5385us (5819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.141640:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7016 00000100:00100000:0.0:1746126613.142312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.142358:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721429760 00000100:00100000:3.0:1746126613.142365:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721429760 00000100:00100000:3.0:1746126613.142411:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8919 00000100:00100000:3.0:1746126613.142417:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31238:x1830945721429760:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126613.142440:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.142458:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2e00/0xb50e8258676134cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da47 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.142561:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142573:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142588:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142599:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142605:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142610:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142714:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2a00/0xb50e8258676134e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142722:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2a00/0xb50e8258676134e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142728:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2a00/0xb50e8258676134e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126613.142736:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126613.142815:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142822:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142851:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142857:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e2800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126613.142860:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142867:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142876:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126613.142879:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126613.142882:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142887:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2800/0xb50e8258676134d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142910:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142915:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142920:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142924:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e3400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126613.142926:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142930:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142936:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005a00) 00010000:00010000:3.0:1746126613.142938:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126613.142940:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142945:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e3400/0xb50e8258676134da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.142977:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2e00/0xb50e8258676134cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da47 expref: 21 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.142987:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2a00/0xb50e8258676134e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da47 expref: 20 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.142993:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.142995:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126613.142997:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2a00, rc 0) 00000100:00100000:3.0:1746126613.143029:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31238:x1830945721429760:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 612us (719us total) trans 8589943093 rc 0/0 00000100:00100000:3.0:1746126613.143035:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8919 00000100:00100000:0.0:1746126613.148122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.148175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.148313:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430144 00000100:00100000:1.0:1746126613.148322:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430144 00000100:00100000:2.0:1746126613.148333:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430272 00000100:00100000:2.0:1746126613.148337:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430272 00002000:00100000:2.0:1746126613.148368:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3444736->3448831) req@ffff88009ee3aa00 x1830945721430272/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.148368:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ee39c00 x1830945721430144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.148378:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3aa00 with x1830945721430272 ext(3444736->3448831) 00002000:00010000:2.0:1746126613.148383:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3aa00 00002000:00100000:1.0:1746126613.148383:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39c00 with x1830945721430144 ext(1048576->2097151) 00002000:00010000:1.0:1746126613.148385:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee39c00 00000100:00100000:2.0:1746126613.148563:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7680 00000100:00100000:2.0:1746126613.148570:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721430272:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126613.148581:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7681 00000100:00100000:1.0:1746126613.148586:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721430144:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126613.148728:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721430272:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 158us (552us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126613.148735:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7680 00002000:00100000:2.0:1746126613.148739:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3444736->3448831) req@ffff88009ee3aa00 x1830945721430272/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.148745:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3aa00 with x1830945721430272 ext(3444736->3448831) 00002000:00010000:2.0:1746126613.148748:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3aa00 00000100:00100000:0.0:1746126613.150644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.151121:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430400 00000100:00100000:2.0:1746126613.151128:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430400 00000100:00100000:2.0:1746126613.151629:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 689 00000100:00100000:2.0:1746126613.151637:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721430400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.151649:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.151673:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e2a00/0xb50e8258676134e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da47 expref: 20 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.151700:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.151704:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.152345:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721430400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 708us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.152352:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 689 00000100:00100000:0.0:1746126613.160514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.161225:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430528 00000100:00100000:3.0:1746126613.161236:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430528 00000100:00100000:3.0:1746126613.161295:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13457 00000100:00100000:3.0:1746126613.161304:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31238:x1830945721430528:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126613.161323:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.161340:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da4e expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.161368:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 17 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.161377:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.162392:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 5 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.162400:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.162402:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.162405:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [700416->860159] (req 700416->860159) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 11 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.162436:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 5 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.162448:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 5 pid: 4641 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.162459:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721358720:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126613.163395:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721430144:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 14805us (15278us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126613.163407:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7681 00002000:00100000:0.0:1746126613.163417:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ee39c00 x1830945721430144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.163426:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39c00 with x1830945721430144 ext(1048576->2097151) 00002000:00010000:0.0:1746126613.163432:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee39c00 00010000:00010000:3.0:1746126613.164144:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.164155:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.164165:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721358848:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.164267:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.164280:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 15 pid: 4642 timeout: 835 lvb_type: 0 00000100:00100000:3.0:1746126613.164288:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721358976:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.164306:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.166506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.167898:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721358720:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.168872:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430656 00000100:00100000:2.0:1746126613.168883:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430656 00010000:00010000:2.0:1746126613.168938:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 6 pid: 4641 timeout: 835 lvb_type: 1 00000100:00100000:2.0:1746126613.168972:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7017 00000100:00100000:2.0:1746126613.168980:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721430656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.168993:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.169018:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 6 pid: 4641 timeout: 835 lvb_type: 1 00010000:00010000:2.0:1746126613.169034:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 6 pid: 4641 timeout: 835 lvb_type: 1 00010000:00010000:2.0:1746126613.169056:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d935800/0xb50e82586761317d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d895 expref: 6 pid: 4641 timeout: 835 lvb_type: 1 00010000:00010000:2.0:1746126613.169081:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1746126613.169147:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126613.170448:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721358848:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.170549:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1966:x1830945721430656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1567us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.170559:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7017 00000100:00100000:1.0:1746126613.171689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.171713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.171767:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721358976:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.171799:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [700416->860159] (req 700416->860159) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 11 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.171814:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3e00, rc 0) 00000100:00100000:3.0:1746126613.171856:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31238:x1830945721430528:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10553us (11353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.171864:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13457 00000100:00100000:2.0:1746126613.172206:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430784 00000100:00100000:2.0:1746126613.172213:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430784 00010000:00010000:2.0:1746126613.172233:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 835 lvb_type: 1 00000100:00100000:2.0:1746126613.172249:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721430912 00000100:00100000:2.0:1746126613.172250:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721430912 00010000:00010000:2.0:1746126613.172257:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 16 pid: 4642 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.172268:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7018 00000100:00100000:2.0:1746126613.172273:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721430784:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.172283:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.172301:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 835 lvb_type: 1 00010000:00010000:2.0:1746126613.172310:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 835 lvb_type: 1 00010000:00010000:2.0:1746126613.172328:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093051400/0xb50e82586761324f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8db expref: 11 pid: 8438 timeout: 835 lvb_type: 1 00010000:00010000:2.0:1746126613.172342:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.172357:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721430784:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.172362:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7018 00000100:00100000:2.0:1746126613.172370:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7019 00000100:00100000:2.0:1746126613.172373:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721430912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.172378:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.172382:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 16 pid: 4642 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.172390:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 16 pid: 4642 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.172401:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee06800/0xb50e82586761314c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d879 expref: 16 pid: 4642 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.172409:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.172411:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.172417:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.172425:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.172449:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 9 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.172459:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721359104:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.172496:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.181693:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721359104:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126613.181719:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.181773:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721430912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9396us (10057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.181784:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7019 00000100:00100000:0.0:1746126613.182304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.182377:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721431168 00000100:00100000:2.0:1746126613.182384:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721431168 00002000:00100000:2.0:1746126613.182425:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (700416->704511) req@ffff88009ee38000 x1830945721431168/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.182435:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38000 with x1830945721431168 ext(700416->704511) 00002000:00010000:2.0:1746126613.182503:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38000 00000100:00100000:2.0:1746126613.182529:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7682 00000100:00100000:2.0:1746126613.182536:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721431168:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126613.182724:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721431168:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 189us (422us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126613.182729:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7682 00002000:00100000:2.0:1746126613.182734:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (700416->704511) req@ffff88009ee38000 x1830945721431168/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.182740:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38000 with x1830945721431168 ext(700416->704511) 00002000:00010000:2.0:1746126613.182743:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38000 00000100:00100000:0.0:1746126613.189437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.189479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.189507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.189542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.189544:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721431424 00000100:00100000:3.0:1746126613.189555:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721431424 00002000:00100000:3.0:1746126613.189596:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee39f80 x1830945721431424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.189606:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39f80 with x1830945721431424 ext(2097152->3145727) 00002000:00010000:3.0:1746126613.189611:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee39f80 00000100:00100000:3.0:1746126613.189638:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721431936 00000100:00100000:3.0:1746126613.189640:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721431936 00002000:00100000:3.0:1746126613.189650:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ee3a680 x1830945721431936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.189656:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3a680 with x1830945721431936 ext(2097152->3145727) 00002000:00010000:3.0:1746126613.189659:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3a680 00000100:00100000:0.0:1746126613.190270:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721431680 00000100:00100000:0.0:1746126613.190274:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721431680 00002000:00100000:0.0:1746126613.190291:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3674111) req@ffff88009ee38e00 x1830945721431680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.190303:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38e00 with x1830945721431680 ext(3145728->3674111) 00002000:00010000:0.0:1746126613.190307:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38e00 00000100:00100000:0.0:1746126613.190316:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721432064 00000100:00100000:0.0:1746126613.190318:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721432064 00002000:00100000:0.0:1746126613.190324:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3448832->4194303) req@ffff88009ee39500 x1830945721432064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.190330:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39500 with x1830945721432064 ext(3448832->4194303) 00002000:00010000:0.0:1746126613.190332:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee39500 00000100:00100000:0.0:1746126613.190341:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7683 00000100:00100000:0.0:1746126613.190346:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721431424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126613.191435:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7684 00000100:00100000:1.0:1746126613.191445:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721431936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126613.192430:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7685 00000100:00100000:3.0:1746126613.192440:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721431680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126613.194765:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7686 00000100:00100000:0.0:1746126613.194779:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721432064:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126613.206497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.208604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.208694:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721432448 00000100:00100000:2.0:1746126613.208704:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721432448 00002000:00100000:2.0:1746126613.208747:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (856064->860159) req@ffff880099371180 x1830945721432448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.208756:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371180 with x1830945721432448 ext(856064->860159) 00002000:00010000:2.0:1746126613.208762:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099371180 00000100:00100000:2.0:1746126613.208793:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7687 00000100:00100000:2.0:1746126613.208801:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721432448:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126613.209013:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721431680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16574us (19503us total) trans 0 rc 528384/528384 00000100:00100000:3.0:1746126613.209020:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7685 00002000:00100000:3.0:1746126613.209027:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3674111) req@ffff88009ee38e00 x1830945721431680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.209034:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38e00 with x1830945721431680 ext(3145728->3674111) 00002000:00010000:3.0:1746126613.209038:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38e00 00000100:00100000:0.0:1746126613.209593:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721432704 00000100:00100000:0.0:1746126613.209598:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721432704 00000100:00100000:0.0:1746126613.209638:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8920 00000100:00100000:0.0:1746126613.209644:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31242:x1830945721432704:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126613.209659:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126613.209677:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e8258676134f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da55 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.209768:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209781:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209794:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209805:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209810:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209815:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209932:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761350b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209939:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761350b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.209945:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761350b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746126613.209953:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126613.210037:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210043:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210048:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210053:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea4d400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126613.210056:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210062:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210072:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126613.210074:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126613.210078:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210082:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d400/0xb50e8258676134fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210128:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210133:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210137:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210140:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ea4de00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126613.210141:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210145:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210153:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135af3b00) 00010000:00010000:0.0:1746126613.210155:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126613.210156:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210161:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4de00/0xb50e825867613504 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.210199:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4d200/0xb50e8258676134f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da55 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.210208:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761350b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da55 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.210214:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126613.210215:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126613.210217:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ea4ce00, rc 0) 00000100:00100000:2.0:1746126613.210441:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721432448:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1639us (1842us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126613.210448:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7687 00002000:00100000:2.0:1746126613.210455:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (856064->860159) req@ffff880099371180 x1830945721432448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.210462:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371180 with x1830945721432448 ext(856064->860159) 00002000:00010000:2.0:1746126613.210466:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099371180 00000100:00100000:0.0:1746126613.210540:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31242:x1830945721432704:12345-192.168.203.2@tcp:101:cat.0 Request processed in 896us (4055us total) trans 8589943094 rc 0/0 00000100:00100000:0.0:1746126613.210546:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8920 00000100:00100000:2.0:1746126613.218727:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721431424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28369us (29289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126613.218738:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7683 00002000:00100000:2.0:1746126613.218750:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee39f80 x1830945721431424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.219653:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39f80 with x1830945721431424 ext(2097152->3145727) 00002000:00010000:2.0:1746126613.219660:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee39f80 00000100:00100000:2.0:1746126613.223743:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721432064:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28960us (34195us total) trans 0 rc 745472/745472 00000100:00100000:2.0:1746126613.223754:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7686 00002000:00100000:2.0:1746126613.223764:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3448832->4194303) req@ffff88009ee39500 x1830945721432064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.223772:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39500 with x1830945721432064 ext(3448832->4194303) 00002000:00010000:2.0:1746126613.223777:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee39500 00000100:00100000:1.0:1746126613.223916:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721431936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 32473us (34436us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126613.223923:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7684 00002000:00100000:1.0:1746126613.223928:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ee3a680 x1830945721431936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.223935:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3a680 with x1830945721431936 ext(2097152->3145727) 00002000:00010000:1.0:1746126613.223937:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee3a680 00000100:00100000:0.0:1746126613.229042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.229097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.229140:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.229217:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433344 00000100:00100000:3.0:1746126613.229227:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433344 00000100:00100000:1.0:1746126613.229265:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721432960 00000100:00100000:1.0:1746126613.229270:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721432960 00000100:00100000:3.0:1746126613.229287:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 690 00000100:00100000:1.0:1746126613.229291:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433216 00000100:00100000:1.0:1746126613.229294:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433216 00000100:00100000:3.0:1746126613.229295:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721433344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126613.229308:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3766 00010000:00010000:3.0:1746126613.229309:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126613.229313:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31238:x1830945721432960:12345-192.168.203.2@tcp:35:multiop.0 00010000:00010000:3.0:1746126613.229335:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ea4ce00/0xb50e82586761350b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da55 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.229354:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.229359:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126613.229399:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721433344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.229408:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 690 00000100:00100000:0.0:1746126613.229509:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3767 00000100:00100000:0.0:1746126613.229515:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31242:x1830945721433216:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126613.229745:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31238:x1830945721432960:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 431us (712us total) trans 8589943095 rc 0/0 00000100:00100000:1.0:1746126613.229751:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3766 00000100:00100000:0.0:1746126613.230353:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31242:x1830945721433216:12345-192.168.203.2@tcp:35:cat.0 Request processed in 837us (1253us total) trans 8589943096 rc 0/0 00000100:00100000:0.0:1746126613.230358:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3767 00000100:00100000:0.0:1746126613.235237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.236422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.236446:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433472 00000100:00100000:3.0:1746126613.236456:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433472 00000100:00100000:3.0:1746126613.236515:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13458 00000100:00100000:3.0:1746126613.236523:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721433472:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.236542:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.236562:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da5c expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.236584:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.236586:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.236595:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.236610:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.236621:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e3400, rc 0) 00000100:00100000:3.0:1746126613.236673:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721433472:12345-192.168.203.2@tcp:101:cat.0 Request processed in 151us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.236680:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13458 00000100:00100000:0.0:1746126613.237420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.237794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.237812:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433600 00000100:00100000:2.0:1746126613.237819:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433600 00000100:00100000:2.0:1746126613.237868:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433728 00000100:00100000:2.0:1746126613.237871:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433728 00000100:00100000:2.0:1746126613.237886:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13459 00000100:00100000:2.0:1746126613.237891:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721433600:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.237905:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.237919:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da63 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.237936:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.237938:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126613.237943:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13460 00010000:00010000:2.0:1746126613.237944:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126613.237951:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721433728:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.237955:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.237958:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.237963:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb19400, rc 0) 00010000:00010000:1.0:1746126613.237966:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f130400/0xb50e825867613527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da6a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.237993:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721433600:12345-192.168.203.2@tcp:101:cat.0 Request processed in 102us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.238001:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13459 00000100:00100000:1.0:1746126613.238007:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721359232:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126613.238063:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.238713:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433856 00000100:00100000:3.0:1746126613.238718:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433856 00000100:00100000:3.0:1746126613.238739:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13461 00000100:00100000:3.0:1746126613.238744:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721433856:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.238752:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.238763:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2200/0xb50e82586761352e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da71 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126613.238793:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721359360:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126613.238820:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.239010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.239023:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433984 00000100:00100000:1.0:1746126613.239026:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433984 00000100:00100000:1.0:1746126613.239041:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13462 00000100:00100000:1.0:1746126613.239045:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721433984:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126613.239051:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.239058:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f130000/0xb50e825867613535 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da78 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.239080:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721359488:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126613.239113:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.242495:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721359360:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.242531:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2200/0xb50e82586761352e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da71 expref: 12 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.242545:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2200/0xb50e82586761352e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da71 expref: 12 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.242559:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2200, rc 0) 00000100:00100000:3.0:1746126613.242616:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721433856:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3870us (4821us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126613.242625:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13461 00000100:00100000:1.0:1746126613.242733:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721359232:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126613.242751:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f130400/0xb50e825867613527 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da6a expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.242764:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f130400/0xb50e825867613527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da6a expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.242776:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f130400, rc 0) 00000100:00100000:1.0:1746126613.242796:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721433728:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4847us (5378us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126613.242802:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13460 00002000:00010000:1.0:1746126613.242861:0:4640:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126611 -> 1746126612 00002000:00010000:1.0:1746126613.242864:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126611 -> 1746126612 00002000:00010000:1.0:1746126613.242866:0:4640:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126611 -> 1746126612 00000100:00100000:1.0:1746126613.242875:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721359488:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126613.242889:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f130000/0xb50e825867613535 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da78 expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.242895:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f130000/0xb50e825867613535 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da78 expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.242901:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f130000, rc 0) 00000100:00100000:1.0:1746126613.242917:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721433984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3871us (3908us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126613.242921:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13462 00000100:00100000:0.0:1746126613.251811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.251986:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434240 00000100:00100000:1.0:1746126613.251996:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434240 00002000:00100000:1.0:1746126613.252050:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8801367eb100 x1830945721434240/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.252066:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb100 with x1830945721434240 ext(4194304->4976639) 00002000:00010000:1.0:1746126613.252071:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb100 00000100:00100000:1.0:1746126613.252112:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7688 00000100:00100000:1.0:1746126613.252120:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721434240:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126613.254962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.255007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.255052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.255130:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434496 00000100:00100000:3.0:1746126613.255138:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434496 00002000:00100000:3.0:1746126613.255178:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8801367e8700 x1830945721434496/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 504/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.255187:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8700 with x1830945721434496 ext(0->1048575) 00002000:00010000:3.0:1746126613.255191:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e8700 00000100:00100000:3.0:1746126613.255205:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434752 00000100:00100000:3.0:1746126613.255207:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434752 00002000:00100000:3.0:1746126613.255216:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8801367e9180 x1830945721434752/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.255228:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9180 with x1830945721434752 ext(1048576->2097151) 00002000:00010000:3.0:1746126613.255231:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9180 00000100:00100000:3.0:1746126613.255239:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7689 00000100:00100000:3.0:1746126613.255245:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721434496:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126613.256954:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435008 00000100:00100000:1.0:1746126613.256963:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435008 00002000:00100000:1.0:1746126613.256997:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8801367e8380 x1830945721435008/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.257005:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8380 with x1830945721435008 ext(1048576->2097151) 00002000:00010000:1.0:1746126613.257010:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e8380 00000100:00100000:1.0:1746126613.258670:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7690 00000100:00100000:1.0:1746126613.258682:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721434752:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126613.258918:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7691 00000100:00100000:2.0:1746126613.258931:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721435008:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126613.274343:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721434240:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22213us (22532us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126613.274356:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7688 00002000:00100000:1.0:1746126613.274368:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8801367eb100 x1830945721434240/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.274377:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb100 with x1830945721434240 ext(4194304->4976639) 00002000:00010000:1.0:1746126613.274383:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb100 00000100:00100000:3.0:1746126613.275376:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721435008:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16444us (20318us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126613.275385:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7691 00002000:00100000:3.0:1746126613.275392:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8801367e8380 x1830945721435008/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.275400:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8380 with x1830945721435008 ext(1048576->2097151) 00002000:00010000:3.0:1746126613.275405:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e8380 00000100:00100000:1.0:1746126613.282525:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721434752:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23835us (27504us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126613.282538:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7690 00002000:00100000:1.0:1746126613.282551:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8801367e9180 x1830945721434752/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.282560:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9180 with x1830945721434752 ext(1048576->2097151) 00002000:00010000:1.0:1746126613.282565:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9180 00000100:00100000:0.0:1746126613.286015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.286168:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435136 00000100:00100000:1.0:1746126613.286177:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435136 00000100:00100000:1.0:1746126613.286224:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13463 00000100:00100000:1.0:1746126613.286231:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721435136:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126613.286249:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.286265:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f131c00/0xb50e82586761353c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da7f expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.286310:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721359616:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126613.286395:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.289760:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721434496:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34505us (34798us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746126613.289773:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7689 00002000:00100000:3.0:1746126613.289785:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8801367e8700 x1830945721434496/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 504/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.289795:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8700 with x1830945721434496 ext(0->1048575) 00002000:00010000:3.0:1746126613.289801:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e8700 00000100:00100000:2.0:1746126613.294221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.295059:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435392 00000100:00100000:1.0:1746126613.295068:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435392 00000100:00100000:1.0:1746126613.295142:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8921 00000100:00100000:1.0:1746126613.295152:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+236:31245:x1830945721435392:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126613.295188:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.295207:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da86 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.295313:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295326:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295338:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295350:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295354:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295358:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295459:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130600/0xb50e825867613558 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295467:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130600/0xb50e825867613558 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295472:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130600/0xb50e825867613558 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126613.295481:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126613.295563:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295569:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295574:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295580:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f131800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126613.295584:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295591:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295601:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126613.295604:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126613.295608:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295612:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131800/0xb50e82586761354a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295629:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295633:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295638:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295642:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f130400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126613.295644:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295649:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295654:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5e00) 00010000:00010000:1.0:1746126613.295656:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126613.295658:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295662:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130400/0xb50e825867613551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.295696:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da86 expref: 239 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.295707:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130600/0xb50e825867613558 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da86 expref: 238 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.295713:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126613.295715:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126613.295717:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f130600, rc 0) 00000100:00100000:1.0:1746126613.299548:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+238:31245:x1830945721435392:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4381us (5320us total) trans 8589943097 rc 0/0 00000100:00100000:1.0:1746126613.299560:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8921 00000100:00100000:1.0:1746126613.299653:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721359616:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126613.299684:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f131c00/0xb50e82586761353c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da7f expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.299698:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f131c00/0xb50e82586761353c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da7f expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126613.299709:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f131c00, rc 0) 00000100:00100000:1.0:1746126613.299764:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721435136:12345-192.168.203.2@tcp:101:cat.0 Request processed in 13533us (13758us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126613.299771:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13463 00000100:00100000:0.0:1746126613.304165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.304232:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435520 00000100:00100000:1.0:1746126613.304242:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435520 00000100:00100000:1.0:1746126613.304293:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13464 00000100:00100000:1.0:1746126613.304301:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721435520:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126613.304319:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.304337:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f131600/0xb50e825867613566 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da8d expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.304389:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721359744:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126613.304916:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.309625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.312244:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435776 00000100:00100000:1.0:1746126613.312260:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435776 00000100:00100000:1.0:1746126613.312340:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3768 00000100:00100000:1.0:1746126613.312348:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+238:31245:x1830945721435776:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126613.312594:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+239:31245:x1830945721435776:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 246us (2979us total) trans 8589943098 rc 0/0 00000100:00100000:1.0:1746126613.312602:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3768 00000100:00100000:0.0:1746126613.312994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.313051:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435904 00000100:00100000:3.0:1746126613.313056:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435904 00000100:00100000:3.0:1746126613.313117:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 691 00000100:00100000:3.0:1746126613.313123:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+239:1966:x1830945721435904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126613.313133:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126613.313158:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130600/0xb50e825867613558 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da86 expref: 239 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.313175:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.313179:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126613.313203:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+238:1966:x1830945721435904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.313208:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 691 00000100:00100000:0.0:1746126613.314231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.316445:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436032 00000100:00100000:2.0:1746126613.316456:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436032 00000100:00100000:2.0:1746126613.316514:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13465 00000100:00100000:2.0:1746126613.316522:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721436032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.316540:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.316558:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134a31a00/0xb50e82586761356d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da94 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.316615:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099370a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721359872:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126613.316700:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.317378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.318752:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436160 00000100:00100000:3.0:1746126613.318760:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436160 00002000:00010000:0.0:1746126613.322160:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126612 -> 1746126613 00000100:00100000:0.0:1746126613.322193:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721359744:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126613.322227:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f131600/0xb50e825867613566 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da8d expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126613.322242:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f131600/0xb50e825867613566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da8d expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126613.322264:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f131600, rc 0) 00000100:00100000:0.0:1746126613.322314:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721435520:12345-192.168.203.2@tcp:101:cat.0 Request processed in 18012us (18159us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126613.322323:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13464 00000100:00100000:0.0:1746126613.322354:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13466 00000100:00100000:0.0:1746126613.322364:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721436160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126613.322378:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126613.322391:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867613574 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4da9b expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126613.322434:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721360000:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126613.322484:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920846c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746126613.330934:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126612 -> 1746126613 00000100:00100000:2.0:1746126613.330965:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099370a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721359872:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126613.331002:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134a31a00/0xb50e82586761356d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da94 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.331018:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a31a00/0xb50e82586761356d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da94 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.331046:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a31a00, rc 0) 00000100:00100000:2.0:1746126613.331106:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721436032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 14583us (16881us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126613.331115:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13465 00002000:00010000:2.0:1746126613.332755:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126612 -> 1746126613 00000100:00100000:2.0:1746126613.332776:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721360000:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126613.332798:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867613574 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da9b expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.332808:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009367ee00/0xb50e825867613574 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da9b expref: 16 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.332818:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009367ee00, rc 0) 00000100:00100000:2.0:1746126613.332859:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721436160:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10499us (15484us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126613.332865:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13466 00000100:00100000:0.0:1746126613.334239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.334294:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436288 00000100:00100000:2.0:1746126613.334302:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436288 00000100:00100000:2.0:1746126613.334337:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13467 00000100:00100000:2.0:1746126613.334342:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:31245:x1830945721436288:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.334357:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.334372:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4daa2 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.334398:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 10 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.334405:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.334408:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.334411:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [348160->778239] (req 348160->778239) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.334439:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 10 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.334452:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 10 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.334463:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099370a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721360128:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.334533:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.337186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.337250:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436416 00000100:00100000:0.0:1746126613.337256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.337258:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436416 00000100:00100000:2.0:1746126613.337307:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13468 00000100:00100000:2.0:1746126613.337314:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31242:x1830945721436416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.337332:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.337348:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4daa9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.337376:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.337384:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.337386:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.337389:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.337422:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.337432:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.337443:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721360256:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.337522:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.337602:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099370a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721360128:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.337623:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [348160->778239] (req 348160->778239) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.337635:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a30200, rc 0) 00000100:00100000:3.0:1746126613.337660:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:31245:x1830945721436288:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3316us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.337666:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13467 00000100:00100000:3.0:1746126613.337694:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436544 00000100:00100000:3.0:1746126613.337698:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436544 00002000:00100000:3.0:1746126613.337725:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (700416->860159) req@ffff8800a448fb80 x1830945721436544/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.337733:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448fb80 with x1830945721436544 ext(700416->860159) 00010000:00010000:3.0:1746126613.337740:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 13 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.337749:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 13 pid: 4641 timeout: 835 lvb_type: 0 00002000:00010000:3.0:1746126613.337757:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448fb80 00000100:00100000:3.0:1746126613.337771:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1755 00000100:00100000:3.0:1746126613.337777:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721436544:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126613.345517:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721360256:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.345553:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.345572:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a31a00, rc 0) 00000100:00100000:2.0:1746126613.345708:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31242:x1830945721436416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8391us (8527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.345717:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13468 00000100:00100000:0.0:1746126613.346146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.346769:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436672 00000100:00100000:1.0:1746126613.346777:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436672 00002000:00100000:1.0:1746126613.346817:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3674112->4194303) req@ffff88009e806d80 x1830945721436672/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.346847:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806d80 with x1830945721436672 ext(3674112->4194303) 00010000:00010000:1.0:1746126613.346855:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.346867:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 16 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746126613.346879:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e806d80 00000100:00100000:1.0:1746126613.346910:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1756 00000100:00100000:1.0:1746126613.346918:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721436672:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126613.350295:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721436544:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12507us (13026us total) trans 21474840341 rc 0/0 00000100:00100000:3.0:1746126613.350307:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1755 00002000:00100000:3.0:1746126613.350319:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (700416->860159) req@ffff8800a448fb80 x1830945721436544/t21474840341(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.350328:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448fb80 with x1830945721436544 ext(700416->860159) 00010000:00010000:3.0:1746126613.350338:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 14 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.350350:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 14 pid: 4641 timeout: 835 lvb_type: 0 00002000:00010000:3.0:1746126613.350357:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448fb80 00000100:00100000:0.0:1746126613.367651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.367704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.367727:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437056 00000100:00100000:0.0:1746126613.367736:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437056 00010000:00010000:0.0:1746126613.367772:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 14 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746126613.368770:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7020 00000100:00100000:0.0:1746126613.368781:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721437056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126613.368798:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126613.368837:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 14 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.368849:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 14 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.368873:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e3e00/0xb50e8258676134ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 700416->860159) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da4e expref: 14 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.368894:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.368896:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.368904:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.368917:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.368951:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126613.368962:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e804700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721360384:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.369876:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436928 00000100:00100000:2.0:1746126613.369885:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436928 00000100:00100000:0.0:1746126613.369895:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084240 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.369930:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8922 00000100:00100000:2.0:1746126613.369936:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31248:x1830945721436928:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.369960:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.369976:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30c00/0xb50e825867613589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dab0 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.370094:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370106:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370118:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370130:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370136:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370141:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370248:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31800/0xb50e82586761359e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370257:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31800/0xb50e82586761359e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370263:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31800/0xb50e82586761359e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126613.370271:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126613.370357:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370364:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370373:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370378:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134a30000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.370382:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370388:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370398:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126613.370401:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.370404:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.370408:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30000/0xb50e825867613590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372609:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372624:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372631:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372636:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134a31400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.372640:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372647:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372668:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215100) 00010000:00010000:2.0:1746126613.372671:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.372674:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372679:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31400/0xb50e825867613597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.372742:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a30c00/0xb50e825867613589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab0 expref: 25 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.372756:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31800/0xb50e82586761359e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab0 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.372762:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.372764:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126613.372766:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a31800, rc 0) 00000100:00100000:2.0:1746126613.372824:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31248:x1830945721436928:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2886us (5182us total) trans 8589943099 rc 0/0 00000100:00100000:2.0:1746126613.372847:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8922 00000100:00100000:0.0:1746126613.373945:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e804700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721360384:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126613.373967:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126613.374003:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721437056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5225us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126613.374011:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7020 00000100:00100000:0.0:1746126613.375038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.377577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.377594:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437312 00000100:00100000:0.0:1746126613.377595:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437440 00000100:00100000:0.0:1746126613.377603:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437440 00000100:00100000:3.0:1746126613.377605:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437312 00002000:00100000:3.0:1746126613.377643:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (348160->352255) req@ffff88009e804700 x1830945721437312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746126613.377653:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 692 00002000:00100000:3.0:1746126613.377654:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804700 with x1830945721437312 ext(348160->352255) 00002000:00010000:3.0:1746126613.377658:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804700 00000100:00100000:0.0:1746126613.377661:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721437440:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126613.377674:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126613.377679:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7692 00000100:00100000:3.0:1746126613.377685:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721437312:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:0.0:1746126613.377697:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a31800/0xb50e82586761359e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab0 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.377721:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126613.377726:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126613.377871:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721437440:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 210us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126613.377878:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 692 00000100:00100000:3.0:1746126613.378028:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721437312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 342us (2992us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126613.378034:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7692 00002000:00100000:3.0:1746126613.378039:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (348160->352255) req@ffff88009e804700 x1830945721437312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.378046:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804700 with x1830945721437312 ext(348160->352255) 00002000:00010000:3.0:1746126613.378049:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804700 00000100:00100000:1.0:1746126613.382576:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721436672:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 35644us (36416us total) trans 21474840342 rc 0/0 00000100:00100000:1.0:1746126613.382591:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1756 00002000:00100000:1.0:1746126613.382606:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3674112->4194303) req@ffff88009e806d80 x1830945721436672/t21474840342(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.382616:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806d80 with x1830945721436672 ext(3674112->4194303) 00010000:00010000:1.0:1746126613.382628:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.382643:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746126613.383043:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e806d80 00000100:00100000:0.0:1746126613.386494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.386620:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437696 00000100:00100000:1.0:1746126613.386629:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437696 00002000:00100000:1.0:1746126613.386678:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (774144->778239) req@ffff88009e807100 x1830945721437696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.386688:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e807100 with x1830945721437696 ext(774144->778239) 00002000:00010000:1.0:1746126613.386693:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e807100 00000100:00100000:1.0:1746126613.386728:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7693 00000100:00100000:1.0:1746126613.386736:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721437696:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126613.387741:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721437696:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1003us (1252us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126613.387748:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7693 00002000:00100000:0.0:1746126613.387754:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (774144->778239) req@ffff88009e807100 x1830945721437696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.387762:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e807100 with x1830945721437696 ext(774144->778239) 00002000:00010000:0.0:1746126613.387765:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e807100 00000100:00100000:0.0:1746126613.390477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.390571:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437824 00000100:00100000:2.0:1746126613.390581:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437824 00010000:00010000:2.0:1746126613.390611:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.390638:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7021 00000100:00100000:2.0:1746126613.390644:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721437824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.390658:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.390681:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.390693:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.390717:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e8258676134b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da32 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.390741:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.390744:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.390751:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.390758:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.390792:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.390803:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721360512:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.390899:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.398891:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721360512:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126613.398916:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.398964:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721437824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8318us (8493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.398975:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7021 00000100:00100000:0.0:1746126613.402005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.402105:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438080 00000100:00100000:2.0:1746126613.402114:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438080 00002000:00100000:2.0:1746126613.402159:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e804000 x1830945721438080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.402169:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804000 with x1830945721438080 ext(2097152->3145727) 00002000:00010000:2.0:1746126613.402174:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804000 00000100:00100000:2.0:1746126613.402201:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7694 00000100:00100000:2.0:1746126613.402211:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721438080:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126613.423194:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721438080:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20970us (21184us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126613.423208:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7694 00002000:00100000:3.0:1746126613.423222:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e804000 x1830945721438080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.423231:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804000 with x1830945721438080 ext(2097152->3145727) 00002000:00010000:3.0:1746126613.423237:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804000 00000100:00100000:0.0:1746126613.426124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.429219:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438208 00000100:00100000:2.0:1746126613.429235:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438208 00000100:00100000:2.0:1746126613.429397:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13469 00000100:00100000:2.0:1746126613.429405:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31242:x1830945721438208:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.429422:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.429439:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dab7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.429467:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.429474:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.429476:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.429479:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.429582:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.429605:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 23 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.429618:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721360640:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.429721:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.431805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.431884:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438336 00000100:00100000:0.0:1746126613.431891:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438336 00002000:00100000:0.0:1746126613.431935:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3448831) req@ffff88009b2fca80 x1830945721438336/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.431945:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fca80 with x1830945721438336 ext(3145728->3448831) 00010000:00010000:0.0:1746126613.431954:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 24 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.431967:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 24 pid: 4641 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746126613.431977:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b2fca80 00000100:00100000:0.0:1746126613.432006:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1757 00000100:00100000:0.0:1746126613.432013:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721438336:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126613.432468:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721360640:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.432494:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.432507:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a30a00, rc 0) 00000100:00100000:2.0:1746126613.432537:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31242:x1830945721438208:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3133us (6423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.432545:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13469 00000100:00100000:2.0:1746126613.439009:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721438336:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 6983us (7200us total) trans 17179873187 rc 0/0 00000100:00100000:2.0:1746126613.439023:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1757 00002000:00100000:2.0:1746126613.439034:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3448831) req@ffff88009b2fca80 x1830945721438336/t17179873187(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.439043:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fca80 with x1830945721438336 ext(3145728->3448831) 00010000:00010000:2.0:1746126613.439054:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 26 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.439071:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 26 pid: 4641 timeout: 835 lvb_type: 0 00002000:00010000:2.0:1746126613.439079:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b2fca80 00000100:00100000:0.0:1746126613.440556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.440947:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438464 00000100:00100000:2.0:1746126613.440955:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438464 00000100:00100000:2.0:1746126613.441002:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13470 00000100:00100000:2.0:1746126613.441009:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31248:x1830945721438464:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.441025:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.441041:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dabe expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.441064:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.441066:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.441070:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->4112383] (req 3530752->4112383) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.441091:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->4112383] (req 3530752->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.441102:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a98600, rc 0) 00000100:00100000:2.0:1746126613.441236:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31248:x1830945721438464:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 227us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.441242:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13470 00000100:00100000:0.0:1746126613.446580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.447151:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438592 00000100:00100000:2.0:1746126613.447161:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438592 00010000:00010000:2.0:1746126613.447203:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 26 pid: 4641 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.447253:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7022 00000100:00100000:2.0:1746126613.447260:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721438592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.447275:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126613.447294:0:9817:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126612 -> 1746126613 00010000:00010000:2.0:1746126613.447301:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 26 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.447312:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 26 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.447334:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d78bc00/0xb50e8258676134c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da40 expref: 26 pid: 4641 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.447399:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.447401:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.447408:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.447415:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.447422:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.447423:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.447425:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.447435:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.447464:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.447474:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721360768:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126613.448581:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.448590:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721360896:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.448615:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.459884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.459937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.459957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.459979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.460576:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439104 00000100:00100000:2.0:1746126613.460586:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439104 00000100:00100000:2.0:1746126613.460631:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8923 00000100:00100000:2.0:1746126613.460638:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+238:31252:x1830945721439104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.460662:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.460680:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59200/0xb50e8258676135ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dac5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.460790:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460802:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460816:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460861:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460867:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460872:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460973:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e8258676135cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460981:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e8258676135cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.460987:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e8258676135cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126613.460996:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126613.461075:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461094:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461100:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461105:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c59a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.461109:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461115:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461124:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126613.461127:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.461130:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461135:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e8258676135c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461155:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461160:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461165:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461169:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c59e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.461171:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461175:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461180:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215d00) 00010000:00010000:2.0:1746126613.461182:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.461185:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461189:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59e00/0xb50e8258676135c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.461542:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59200/0xb50e8258676135ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dac5 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.461555:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e8258676135cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dac5 expref: 240 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.461562:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.461563:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126613.461565:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c59400, rc 0) 00000100:00100000:3.0:1746126613.461723:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438848 00000100:00100000:3.0:1746126613.461727:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438848 00002000:00100000:3.0:1746126613.461760:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3530752->3534847) req@ffff88009b2fd880 x1830945721438848/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.461769:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fd880 with x1830945721438848 ext(3530752->3534847) 00002000:00010000:3.0:1746126613.461773:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2fd880 00000100:00100000:3.0:1746126613.461788:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439360 00000100:00100000:3.0:1746126613.461790:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439360 00002000:00100000:3.0:1746126613.461798:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009b2ff480 x1830945721439360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.461809:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff480 with x1830945721439360 ext(2097152->3145727) 00002000:00010000:3.0:1746126613.461812:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2ff480 00000100:00100000:2.0:1746126613.461847:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+240:31252:x1830945721439104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1209us (1909us total) trans 8589943100 rc 0/0 00000100:00100000:2.0:1746126613.461854:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8923 00000100:00100000:3.0:1746126613.461915:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439616 00000100:00100000:3.0:1746126613.461918:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439616 00000100:00100000:2.0:1746126613.461929:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721360768:192.168.203.2@tcp:105: 00002000:00100000:3.0:1746126613.461932:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009b2fed80 x1830945721439616/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.461938:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fed80 with x1830945721439616 ext(3145728->4194303) 00000100:00100000:2.0:1746126613.461938:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721360896:192.168.203.2@tcp:105: 00002000:00010000:3.0:1746126613.461940:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fed80 00010000:00010000:2.0:1746126613.461955:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.461964:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7695 00000100:00100000:1.0:1746126613.461972:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721438848:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126613.462006:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7696 00000100:00100000:0.0:1746126613.462012:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721439360:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126613.462115:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7697 00000100:00100000:3.0:1746126613.462120:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721439616:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126613.462240:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721438592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 14980us (15669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.462248:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7022 00000100:00100000:1.0:1746126613.462602:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721438848:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 631us (2728us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126613.462608:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7695 00002000:00100000:1.0:1746126613.462613:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (3530752->3534847) req@ffff88009b2fd880 x1830945721438848/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.462619:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fd880 with x1830945721438848 ext(3530752->3534847) 00002000:00010000:1.0:1746126613.462621:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2fd880 00000100:00100000:0.0:1746126613.470936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.470980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.471016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.471100:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439872 00000100:00100000:3.0:1746126613.471110:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439872 00000100:00100000:3.0:1746126613.471154:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3769 00000100:00100000:3.0:1746126613.471161:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+240:31252:x1830945721439872:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126613.471405:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+241:31252:x1830945721439872:12345-192.168.203.2@tcp:35:cat.0 Request processed in 243us (478us total) trans 8589943101 rc 0/0 00000100:00100000:3.0:1746126613.471412:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3769 00000100:00100000:2.0:1746126613.472124:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440000 00000100:00100000:2.0:1746126613.472130:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440000 00000100:00100000:2.0:1746126613.472166:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 693 00000100:00100000:2.0:1746126613.472172:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+241:1963:x1830945721440000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.472182:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.472206:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e8258676135cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dac5 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.472227:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.472231:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.472256:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+240:1963:x1830945721440000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.472262:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 693 00000100:00100000:1.0:1746126613.472967:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440256 00000100:00100000:1.0:1746126613.472972:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440256 00002000:00100000:1.0:1746126613.472997:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (4108288->4112383) req@ffff88008f15e300 x1830945721440256/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.473005:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15e300 with x1830945721440256 ext(4108288->4112383) 00002000:00010000:1.0:1746126613.473009:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15e300 00000100:00100000:1.0:1746126613.473023:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7698 00000100:00100000:1.0:1746126613.473027:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721440256:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126613.473150:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721440256:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 122us (2133us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126613.473155:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7698 00002000:00100000:1.0:1746126613.473160:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x325:0x0] (4108288->4112383) req@ffff88008f15e300 x1830945721440256/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.473171:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15e300 with x1830945721440256 ext(4108288->4112383) 00002000:00010000:1.0:1746126613.473173:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15e300 00000100:00100000:0.0:1746126613.473317:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721439360:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 11305us (13358us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126613.473325:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7696 00002000:00100000:0.0:1746126613.473330:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009b2ff480 x1830945721439360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.473335:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff480 with x1830945721439360 ext(2097152->3145727) 00002000:00010000:0.0:1746126613.473339:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2ff480 00000100:00100000:0.0:1746126613.476725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.488380:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440384 00000100:00100000:2.0:1746126613.488396:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440384 00000100:00100000:2.0:1746126613.488455:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13471 00000100:00100000:2.0:1746126613.488464:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721440384:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.488482:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.488500:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dacc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.488522:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.488524:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.488533:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.488547:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.488557:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba3400, rc 0) 00000100:00100000:2.0:1746126613.488609:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721440384:12345-192.168.203.2@tcp:101:cat.0 Request processed in 146us (11896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.488626:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13471 00000100:00100000:2.0:1746126613.489105:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721439616:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 26984us (29124us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126613.489115:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7697 00002000:00100000:2.0:1746126613.489124:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009b2fed80 x1830945721439616/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.489133:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fed80 with x1830945721439616 ext(3145728->4194303) 00002000:00010000:2.0:1746126613.489137:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fed80 00000100:00100000:0.0:1746126613.489246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.489306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.489323:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440768 00000100:00100000:0.0:1746126613.489326:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440768 00000100:00100000:0.0:1746126613.489357:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3770 00000100:00100000:0.0:1746126613.489362:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d991450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31248:x1830945721440768:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126613.489525:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d991450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31248:x1830945721440768:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 163us (218us total) trans 8589943102 rc 0/0 00000100:00100000:0.0:1746126613.489531:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3770 00000100:00100000:2.0:1746126613.490527:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440512 00000100:00100000:2.0:1746126613.490534:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440512 00000100:00100000:2.0:1746126613.490565:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13472 00000100:00100000:2.0:1746126613.490570:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721440512:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.490581:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.490599:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba2e00/0xb50e8258676135e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dad3 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.490645:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721361024:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126613.493419:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00002000:00010000:2.0:1746126613.494154:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126612 -> 1746126613 00000100:00100000:2.0:1746126613.494182:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721361024:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126613.494220:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2e00/0xb50e8258676135e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dad3 expref: 26 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.494233:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2e00/0xb50e8258676135e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dad3 expref: 26 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.494245:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2e00, rc 0) 00000100:00100000:2.0:1746126613.494311:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721440512:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3739us (5064us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126613.494320:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13472 00000100:00100000:3.0:1746126613.495036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.495220:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440896 00000100:00100000:2.0:1746126613.495226:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440896 00000100:00100000:2.0:1746126613.495264:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13473 00000100:00100000:2.0:1746126613.495271:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31242:x1830945721440896:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.495286:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.495300:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dada expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.495325:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.495332:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.495334:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.495337:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 14 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.495363:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.495375:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 14 pid: 8436 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.495387:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721361152:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.495453:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.499106:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721361152:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.499147:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 14 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.499163:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2000, rc 0) 00000100:00100000:2.0:1746126613.499788:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31242:x1830945721440896:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4514us (4751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.499798:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13473 00000100:00100000:1.0:1746126613.504281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.504760:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721441024 00000100:00100000:2.0:1746126613.504770:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721441024 00002000:00100000:2.0:1746126613.504818:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3530752->4112383) req@ffff88009f02d500 x1830945721441024/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.504844:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02d500 with x1830945721441024 ext(3530752->4112383) 00010000:00010000:2.0:1746126613.504854:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 14 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.504868:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 14 pid: 8436 timeout: 835 lvb_type: 0 00002000:00010000:2.0:1746126613.504875:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f02d500 00000100:00100000:2.0:1746126613.504904:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1758 00000100:00100000:2.0:1746126613.504912:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721441024:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126613.508710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.509650:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721441280 00000100:00100000:3.0:1746126613.509661:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721441280 00002000:00100000:3.0:1746126613.509708:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f15c700 x1830945721441280/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 504/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.509717:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15c700 with x1830945721441280 ext(0->1048575) 00002000:00010000:3.0:1746126613.509722:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f15c700 00000100:00100000:3.0:1746126613.509744:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7699 00000100:00100000:3.0:1746126613.509752:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721441280:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126613.517374:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721441024:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 12450us (13092us total) trans 17179873188 rc 0/0 00000100:00100000:2.0:1746126613.517387:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1758 00002000:00100000:2.0:1746126613.517399:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3530752->4112383) req@ffff88009f02d500 x1830945721441024/t17179873188(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.517409:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02d500 with x1830945721441024 ext(3530752->4112383) 00010000:00010000:2.0:1746126613.517419:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 16 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.517435:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 16 pid: 8436 timeout: 835 lvb_type: 0 00002000:00010000:2.0:1746126613.517441:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f02d500 00000100:00100000:3.0:1746126613.519191:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721441280:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9434us (10485us total) trans 0 rc 618496/618496 00000100:00100000:3.0:1746126613.519201:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7699 00002000:00100000:3.0:1746126613.519209:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f15c700 x1830945721441280/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 504/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.519217:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15c700 with x1830945721441280 ext(0->1048575) 00002000:00010000:3.0:1746126613.519222:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f15c700 00000100:00100000:0.0:1746126613.520328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.520393:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721441408 00000100:00100000:2.0:1746126613.520401:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721441408 00010000:00010000:2.0:1746126613.520430:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 16 pid: 8436 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.520450:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7023 00000100:00100000:2.0:1746126613.520455:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721441408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126613.520467:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126613.520484:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 16 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.520494:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 16 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.520514:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a98600/0xb50e8258676135b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3530752->18446744073709551615] (req 3530752->4112383) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dabe expref: 16 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.520975:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.520978:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.520985:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 15 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.520994:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 15 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.521024:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 15 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.521035:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721361280:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.522471:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.526512:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721361280:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126613.526561:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.526668:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721441408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6209us (6341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.526679:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7023 00000100:00100000:0.0:1746126613.529690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.529790:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721441664 00000100:00100000:3.0:1746126613.529800:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721441664 00002000:00100000:3.0:1746126613.529881:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009f134a80 x1830945721441664/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.529891:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134a80 with x1830945721441664 ext(3145728->4194303) 00002000:00010000:3.0:1746126613.529896:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f134a80 00000100:00100000:3.0:1746126613.529928:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7700 00000100:00100000:3.0:1746126613.529935:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721441664:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126613.538209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.538442:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721441920 00000100:00100000:2.0:1746126613.538451:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721441920 00000100:00100000:2.0:1746126613.538514:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8924 00000100:00100000:2.0:1746126613.538522:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+240:31256:x1830945721441920:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.538547:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.538566:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2200/0xb50e8258676135f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dae1 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.538683:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538695:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538705:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538716:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538722:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538727:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538875:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2e00/0xb50e825867613607 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538884:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2e00/0xb50e825867613607 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538890:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2e00/0xb50e825867613607 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126613.538898:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126613.538984:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.538991:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.539000:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.539004:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ba3600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.539007:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.539012:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.539022:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126613.539024:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.539028:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.539032:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3600/0xb50e8258676135f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746126613.540476:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721441664:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 10534us (10789us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126613.540488:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7700 00002000:00100000:3.0:1746126613.540497:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009f134a80 x1830945721441664/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.540505:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134a80 with x1830945721441664 ext(3145728->4194303) 00002000:00010000:3.0:1746126613.540510:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f134a80 00010000:00010000:2.0:1746126613.540605:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540612:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540618:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540622:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ba3200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.540625:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540630:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540645:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215d00) 00010000:00010000:2.0:1746126613.540648:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.540651:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540655:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba3200/0xb50e825867613600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.540704:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2200/0xb50e8258676135f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dae1 expref: 243 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.540717:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2e00/0xb50e825867613607 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dae1 expref: 242 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.540722:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.540724:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126613.540726:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2e00, rc 0) 00000100:00100000:2.0:1746126613.540748:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+242:31256:x1830945721441920:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2227us (2551us total) trans 8589943103 rc 0/0 00000100:00100000:2.0:1746126613.540754:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8924 00000100:00100000:0.0:1746126613.541562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.541618:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721442176 00000100:00100000:2.0:1746126613.541625:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721442176 00002000:00100000:2.0:1746126613.541656:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f135500 x1830945721442176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.541664:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135500 with x1830945721442176 ext(2097152->3145727) 00002000:00010000:2.0:1746126613.541667:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f135500 00000100:00100000:2.0:1746126613.541692:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7701 00000100:00100000:2.0:1746126613.541698:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721442176:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126613.544906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.546167:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721442432 00000100:00100000:3.0:1746126613.546178:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721442432 00000100:00100000:3.0:1746126613.546237:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3771 00000100:00100000:3.0:1746126613.546246:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+242:31256:x1830945721442432:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126613.546465:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+243:31256:x1830945721442432:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 220us (1569us total) trans 8589943104 rc 0/0 00000100:00100000:3.0:1746126613.546471:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3771 00000100:00100000:2.0:1746126613.549209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.549386:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721442560 00000100:00100000:3.0:1746126613.549396:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721442560 00000100:00100000:3.0:1746126613.549460:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 694 00000100:00100000:3.0:1746126613.549467:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+243:1963:x1830945721442560:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126613.549483:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126613.549507:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba2e00/0xb50e825867613607 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dae1 expref: 243 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.549527:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.549532:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126613.549573:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+242:1963:x1830945721442560:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.549578:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 694 00000100:00100000:0.0:1746126613.554536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.556137:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721442688 00000100:00100000:2.0:1746126613.556151:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721442688 00000100:00100000:2.0:1746126613.556209:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13474 00000100:00100000:2.0:1746126613.556217:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721442688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.556236:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.556256:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba2200/0xb50e825867613615 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dae8 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.556310:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721361408:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126613.556399:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.556973:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721442176:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15273us (15412us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126613.556983:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7701 00002000:00100000:3.0:1746126613.556992:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f135500 x1830945721442176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.557007:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135500 with x1830945721442176 ext(2097152->3145727) 00002000:00010000:3.0:1746126613.557011:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f135500 00002000:00010000:0.0:1746126613.561217:0:4641:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126612 -> 1746126613 00002000:00010000:0.0:1746126613.561224:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126612 -> 1746126613 00000100:00100000:0.0:1746126613.561248:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721361408:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126613.561282:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba2200/0xb50e825867613615 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dae8 expref: 14 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126613.561295:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba2200/0xb50e825867613615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dae8 expref: 14 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126613.561321:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba2200, rc 0) 00000100:00100000:0.0:1746126613.561454:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721442688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5236us (6923us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126613.561466:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13474 00000100:00100000:0.0:1746126613.565738:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.565848:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721442816 00000100:00100000:2.0:1746126613.565858:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721442816 00000100:00100000:3.0:1746126613.569330:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13475 00000100:00100000:3.0:1746126613.569349:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:31252:x1830945721442816:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.569370:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.569389:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4daef expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.569413:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.569415:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.569421:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.569433:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.569443:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbd600, rc 0) 00000100:00100000:3.0:1746126613.572265:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:31252:x1830945721442816:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2911us (6524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.572277:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13475 00000100:00100000:0.0:1746126613.572870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.573157:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721443072 00000100:00100000:3.0:1746126613.573165:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721443072 00002000:00100000:3.0:1746126613.573214:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a5b6ad80 x1830945721443072/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.573223:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6ad80 with x1830945721443072 ext(4194304->4976639) 00002000:00010000:3.0:1746126613.573229:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6ad80 00000100:00100000:3.0:1746126613.573249:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7702 00000100:00100000:3.0:1746126613.573256:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721443072:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126613.586051:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721443072:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12782us (13168us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126613.586064:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7702 00002000:00100000:3.0:1746126613.586078:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a5b6ad80 x1830945721443072/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.586095:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6ad80 with x1830945721443072 ext(4194304->4976639) 00002000:00010000:3.0:1746126613.586100:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6ad80 00000100:00100000:0.0:1746126613.590116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.590167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.590208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.590238:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721443328 00000100:00100000:0.0:1746126613.590248:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721443328 00002000:00100000:0.0:1746126613.590299:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5b69c00 x1830945721443328/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.590310:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69c00 with x1830945721443328 ext(2097152->3145727) 00002000:00010000:0.0:1746126613.590316:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b69c00 00000100:00100000:0.0:1746126613.590331:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721443584 00000100:00100000:0.0:1746126613.590334:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721443584 00002000:00100000:0.0:1746126613.590344:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a5b68000 x1830945721443584/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.590351:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68000 with x1830945721443584 ext(3145728->4194303) 00002000:00010000:0.0:1746126613.590353:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b68000 00000100:00100000:0.0:1746126613.590377:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721443840 00000100:00100000:0.0:1746126613.590379:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721443840 00002000:00100000:0.0:1746126613.590390:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d918a80 x1830945721443840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.590397:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918a80 with x1830945721443840 ext(3145728->4194303) 00002000:00010000:0.0:1746126613.590400:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d918a80 00000100:00100000:0.0:1746126613.590413:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7703 00000100:00100000:0.0:1746126613.590420:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721443328:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126613.590936:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7704 00000100:00100000:3.0:1746126613.590943:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721443584:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126613.592114:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7705 00000100:00100000:1.0:1746126613.592124:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721443840:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126613.595709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.595962:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721443968 00000100:00100000:3.0:1746126613.595971:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721443968 00000100:00100000:3.0:1746126613.596026:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13476 00000100:00100000:3.0:1746126613.596034:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721443968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.596052:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.596072:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fbde00/0xb50e825867613623 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4daf6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126613.596135:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721361536:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126613.598178:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.605864:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721361536:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.605902:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fbde00/0xb50e825867613623 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daf6 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.605916:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fbde00/0xb50e825867613623 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daf6 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.605943:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbde00, rc 0) 00000100:00100000:3.0:1746126613.605987:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721443968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9952us (10285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126613.605995:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13476 00000100:00100000:1.0:1746126613.616520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.617297:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721443328:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26871us (27184us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126613.617310:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7703 00002000:00100000:1.0:1746126613.617325:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5b69c00 x1830945721443328/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.617334:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69c00 with x1830945721443328 ext(2097152->3145727) 00002000:00010000:1.0:1746126613.617341:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b69c00 00000100:00100000:3.0:1746126613.617537:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721444096 00000100:00100000:3.0:1746126613.617547:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721444096 00000100:00100000:3.0:1746126613.617605:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13477 00000100:00100000:3.0:1746126613.617612:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721444096:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.617627:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.617645:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fbc400/0xb50e82586761362a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dafd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126613.617704:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721361664:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126613.617789:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.620415:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721443584:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29462us (30237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126613.620427:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7704 00002000:00100000:3.0:1746126613.620438:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a5b68000 x1830945721443584/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.620447:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68000 with x1830945721443584 ext(3145728->4194303) 00002000:00010000:3.0:1746126613.620453:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b68000 00000100:00100000:3.0:1746126613.627276:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721361664:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.627309:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fbc400/0xb50e82586761362a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dafd expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.627323:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fbc400/0xb50e82586761362a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dafd expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.627370:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbc400, rc 0) 00000100:00100000:3.0:1746126613.627842:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721444096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10212us (11315us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126613.627851:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13477 00000100:00100000:0.0:1746126613.627925:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721443840:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35803us (37716us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126613.627933:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7705 00002000:00100000:0.0:1746126613.627941:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d918a80 x1830945721443840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.627950:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918a80 with x1830945721443840 ext(3145728->4194303) 00002000:00010000:0.0:1746126613.627955:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d918a80 00000100:00100000:0.0:1746126613.641142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.641524:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721444352 00000100:00100000:1.0:1746126613.641537:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721444352 00002000:00100000:1.0:1746126613.641589:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88012d91aa00 x1830945721444352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.641600:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91aa00 with x1830945721444352 ext(4194304->4976639) 00002000:00010000:1.0:1746126613.641605:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91aa00 00000100:00100000:1.0:1746126613.641767:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7706 00000100:00100000:1.0:1746126613.641776:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721444352:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126613.654360:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721444352:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12571us (13214us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746126613.654374:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7706 00002000:00100000:0.0:1746126613.654387:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88012d91aa00 x1830945721444352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.654396:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91aa00 with x1830945721444352 ext(4194304->4976639) 00002000:00010000:0.0:1746126613.654402:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91aa00 00000100:00100000:0.0:1746126613.722599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.722704:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721444608 00000100:00100000:2.0:1746126613.722714:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721444608 00000100:00100000:2.0:1746126613.722775:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8925 00000100:00100000:2.0:1746126613.722783:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31260:x1830945721444608:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.722807:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.722855:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e825867613631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db04 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.722968:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.722980:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.722991:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723003:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723008:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723013:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723136:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59c00/0xb50e825867613646 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723144:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59c00/0xb50e825867613646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723151:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59c00/0xb50e825867613646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126613.723160:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126613.723237:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723243:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723249:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723255:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c59800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.723258:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723264:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723274:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126613.723276:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.723280:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723284:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59800/0xb50e825867613638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723311:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723316:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723321:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723325:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c59000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126613.723327:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723331:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723337:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215a00) 00010000:00010000:2.0:1746126613.723339:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126613.723342:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723346:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59000/0xb50e82586761363f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126613.723379:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59a00/0xb50e825867613631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db04 expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.723390:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59c00/0xb50e825867613646 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db04 expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.723396:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126613.723398:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126613.723400:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c59c00, rc 0) 00000100:00100000:2.0:1746126613.723442:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31260:x1830945721444608:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 660us (854us total) trans 8589943105 rc 0/0 00000100:00100000:2.0:1746126613.723448:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8925 00000100:00100000:0.0:1746126613.735572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.735677:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721444736 00000100:00100000:1.0:1746126613.735687:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721444736 00000100:00100000:1.0:1746126613.735757:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 695 00000100:00100000:1.0:1746126613.735766:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721444736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.735782:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.735807:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59c00/0xb50e825867613646 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db04 expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.735865:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126613.735870:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.735913:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721444736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 148us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.735920:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 695 00000100:00100000:0.0:1746126613.794919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.795089:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721444992 00000100:00100000:3.0:1746126613.795098:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721444992 00000100:00100000:3.0:1746126613.795157:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8926 00000100:00100000:3.0:1746126613.795166:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+242:31263:x1830945721444992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.795200:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.795225:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbcc00/0xb50e825867613654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db0b expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.797766:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797783:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797794:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797806:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797812:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797816:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797929:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbda00/0xb50e825867613669 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797937:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbda00/0xb50e825867613669 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.797942:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbda00/0xb50e825867613669 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126613.797950:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126613.798026:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798032:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798037:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798042:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fbd400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126613.798044:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798049:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798058:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126613.798061:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126613.798064:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798068:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbd400/0xb50e82586761365b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798101:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798104:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798108:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798111:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fbdc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126613.798113:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798117:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798121:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005900) 00010000:00010000:3.0:1746126613.798123:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126613.798124:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798128:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbdc00/0xb50e825867613662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126613.798163:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbcc00/0xb50e825867613654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db0b expref: 245 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.798177:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbda00/0xb50e825867613669 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db0b expref: 244 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.798182:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.798184:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126613.798186:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbda00, rc 0) 00000100:00100000:3.0:1746126613.798242:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+244:31263:x1830945721444992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3077us (3333us total) trans 8589943106 rc 0/0 00000100:00100000:3.0:1746126613.798249:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8926 00000100:00100000:0.0:1746126613.805706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.805764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.805860:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721445376 00000100:00100000:1.0:1746126613.805870:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721445376 00000100:00100000:1.0:1746126613.805925:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3772 00000100:00100000:1.0:1746126613.805932:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+244:31263:x1830945721445376:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126613.806152:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+245:31263:x1830945721445376:12345-192.168.203.2@tcp:35:cat.0 Request processed in 219us (455us total) trans 8589943107 rc 0/0 00000100:00100000:1.0:1746126613.806158:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3772 00000100:00100000:3.0:1746126613.808369:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721445120 00000100:00100000:3.0:1746126613.808379:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721445120 00000100:00100000:3.0:1746126613.808439:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 696 00000100:00100000:3.0:1746126613.808446:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+245:1964:x1830945721445120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126613.808459:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126613.808483:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fbda00/0xb50e825867613669 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db0b expref: 245 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.808499:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126613.808503:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126613.808539:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+244:1964:x1830945721445120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 94us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.808545:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 696 00010000:00010000:0.0:1746126613.819015:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126613.834643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.834744:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721445504 00000100:00100000:3.0:1746126613.834753:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721445504 00000100:00100000:3.0:1746126613.834804:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13478 00000100:00100000:3.0:1746126613.834812:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:31256:x1830945721445504:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126613.834857:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.834874:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db12 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.834903:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.834912:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.834918:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 6 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.834924:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.834926:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.834929:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1626112->2097151] (req 1626112->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.834958:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 6 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.834971:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 6 pid: 9686 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.834983:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721361792:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.836338:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.836353:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 14 pid: 8438 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.836362:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721361920:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.837279:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.837289:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.837298:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721362048:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.837340:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.846519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.846745:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721361792:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.846754:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721361920:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.846760:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721362048:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.846789:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1626112->2097151] (req 1626112->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.846805:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbc800, rc 0) 00000100:00100000:3.0:1746126613.846871:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:31256:x1830945721445504:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12060us (12238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.846880:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13478 00000100:00100000:0.0:1746126613.849149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.849169:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721445632 00000100:00100000:1.0:1746126613.849179:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721445632 00010000:00010000:1.0:1746126613.849235:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 7 pid: 9686 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746126613.849266:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7024 00000100:00100000:1.0:1746126613.849272:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721445632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.849285:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.849306:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 7 pid: 9686 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746126613.849316:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 7 pid: 9686 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746126613.849336:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b238800/0xb50e825867613184 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d89c expref: 7 pid: 9686 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746126613.849353:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.849383:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721445632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 113us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.849389:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7024 00000100:00080000:2.0:1746126613.849803:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746126613.850016:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721445760 00000100:00100000:3.0:1746126613.850021:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721445760 00010000:00010000:3.0:1746126613.850037:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.850063:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7025 00000100:00100000:3.0:1746126613.850068:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721445760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126613.850075:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126613.850093:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 835 lvb_type: 1 00010000:00010000:3.0:1746126613.850099:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 835 lvb_type: 1 00010000:00010000:3.0:1746126613.850112:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee07400/0xb50e825867613122 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d856 expref: 27 pid: 4642 timeout: 835 lvb_type: 1 00010000:00010000:3.0:1746126613.850132:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126613.850152:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721445760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.850158:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7025 00000100:00100000:3.0:1746126613.850204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.850363:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721445888 00000100:00100000:0.0:1746126613.850368:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721445888 00010000:00010000:0.0:1746126613.850383:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 15 pid: 8438 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746126613.850399:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7026 00000100:00100000:0.0:1746126613.850403:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721445888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126613.850409:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126613.850417:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 15 pid: 8438 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746126613.850425:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 15 pid: 8438 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746126613.850438:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093050c00/0xb50e825867613256 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d8e2 expref: 15 pid: 8438 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746126613.851401:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.851405:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.855232:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.855259:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.855346:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.855363:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721362176:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126613.855456:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.855548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.855586:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721446144 00000100:00100000:0.0:1746126613.855593:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721446144 00000100:00100000:0.0:1746126613.855636:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8927 00000100:00100000:0.0:1746126613.855642:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31267:x1830945721446144:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126613.855662:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126613.855680:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2200/0xb50e82586761367e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db19 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.855782:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855793:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855801:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855813:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855817:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855822:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855934:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2c00/0xb50e825867613693 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855942:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2c00/0xb50e825867613693 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.855947:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2c00/0xb50e825867613693 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746126613.855955:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126613.856044:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.856054:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.856060:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.856065:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973a3000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126613.856069:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.856074:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857211:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126613.857214:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126613.857219:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857224:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857238:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857244:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857249:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857252:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973a3e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126613.857254:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857263:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857269:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4100) 00010000:00010000:0.0:1746126613.857271:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126613.857273:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857277:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3e00/0xb50e82586761368c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126613.857321:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2200/0xb50e82586761367e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db19 expref: 28 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.857333:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2c00/0xb50e825867613693 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db19 expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.857340:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126613.857639:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126613.857642:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973a2c00, rc 0) 00000100:00100000:0.0:1746126613.857753:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31267:x1830945721446144:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2108us (2204us total) trans 8589943108 rc 0/0 00000100:00100000:0.0:1746126613.857761:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8927 00000100:00100000:1.0:1746126613.857908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.857930:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721446400 00000100:00100000:2.0:1746126613.857937:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721446400 00002000:00100000:2.0:1746126613.857971:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1626112->1630207) req@ffff88008e3a8a80 x1830945721446400/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.857979:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8a80 with x1830945721446400 ext(1626112->1630207) 00002000:00010000:2.0:1746126613.857983:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a8a80 00000100:00100000:2.0:1746126613.858007:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7707 00000100:00100000:0.0:1746126613.858008:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721362176:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.858013:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721446400:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:0.0:1746126613.858024:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126613.858046:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721445888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7642us (7841us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126613.858055:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7026 00000100:00100000:2.0:1746126613.858202:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721446400:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 188us (294us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126613.858208:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7707 00002000:00100000:2.0:1746126613.858213:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1626112->1630207) req@ffff88008e3a8a80 x1830945721446400/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.858225:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8a80 with x1830945721446400 ext(1626112->1630207) 00002000:00010000:2.0:1746126613.858227:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a8a80 00000100:00100000:0.0:1746126613.861033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.861085:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721446656 00000100:00100000:3.0:1746126613.861094:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721446656 00000100:00100000:3.0:1746126613.861134:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3773 00000100:00100000:3.0:1746126613.861141:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31267:x1830945721446656:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126613.861330:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31267:x1830945721446656:12345-192.168.203.2@tcp:35:cat.0 Request processed in 189us (305us total) trans 8589943109 rc 0/0 00000100:00100000:3.0:1746126613.861337:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3773 00000100:00100000:0.0:1746126613.861443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.861942:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721446784 00000100:00100000:1.0:1746126613.861947:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721446784 00000100:00100000:1.0:1746126613.861976:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 697 00000100:00100000:1.0:1746126613.861981:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721446784:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.861991:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.862014:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a2c00/0xb50e825867613693 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db19 expref: 28 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.862052:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126613.862057:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.862094:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721446784:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 111us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.862100:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 697 00000100:00100000:0.0:1746126613.865665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.866285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.866307:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721446912 00000100:00100000:3.0:1746126613.866317:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721446912 00000100:00100000:3.0:1746126613.866367:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13479 00000100:00100000:3.0:1746126613.866374:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721446912:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.866393:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.866410:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fbcc00/0xb50e8258676136a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db20 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126613.866460:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721362304:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126613.866776:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447040 00000100:00100000:2.0:1746126613.866780:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447040 00000100:00100000:2.0:1746126613.866801:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13480 00000100:00100000:2.0:1746126613.866805:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721447040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.866812:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.866822:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c59200/0xb50e8258676136a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db27 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.866863:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721362432:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126613.866998:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.867463:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.868106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.868300:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447168 00000100:00100000:3.0:1746126613.868306:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447168 00000100:00100000:3.0:1746126613.868344:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13481 00000100:00100000:3.0:1746126613.868350:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:31256:x1830945721447168:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126613.868361:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.868372:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db2e expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.868394:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.868401:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.868407:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.868410:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126613.868413:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 5/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->1601535] (req 1048576->1601535) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.868437:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.868448:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 15 pid: 4641 timeout: 835 lvb_type: 1 00000100:00100000:3.0:1746126613.868457:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721362560:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126613.868511:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126613.868518:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:3.0:1746126613.868525:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721362688:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.868542:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.869319:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721362304:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.869345:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fbcc00/0xb50e8258676136a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db20 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.869356:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fbcc00/0xb50e8258676136a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db20 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.869381:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbcc00, rc 0) 00002000:00010000:2.0:1746126613.870820:0:4641:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126611 -> 1746126613 00002000:00010000:2.0:1746126613.870825:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126611 -> 1746126613 00002000:00010000:2.0:1746126613.870843:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126611 -> 1746126613 00000100:00100000:2.0:1746126613.870869:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721362432:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126613.870890:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c59200/0xb50e8258676136a8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db27 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.870900:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c59200/0xb50e8258676136a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db27 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.871243:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c59200, rc 0) 00000100:00100000:3.0:1746126613.871261:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721446912:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4885us (5605us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126613.871269:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721447040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4462us (4984us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126613.871270:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13479 00000100:00100000:2.0:1746126613.871279:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13480 00000100:00100000:2.0:1746126613.871342:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721362560:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.871372:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721362688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.871392:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->1601535] (req 1048576->1601535) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.871403:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fbc400, rc 0) 00000100:00100000:2.0:1746126613.871427:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:31256:x1830945721447168:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3076us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.871432:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13481 00000100:00100000:0.0:1746126613.873336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.873489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.874024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.874199:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447296 00000100:00100000:2.0:1746126613.874208:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447296 00000100:00100000:2.0:1746126613.874222:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447552 00000100:00100000:2.0:1746126613.874224:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447552 00000100:00100000:2.0:1746126613.874256:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13482 00000100:00100000:2.0:1746126613.874262:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31267:x1830945721447552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.874278:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.874295:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db35 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.874320:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.874326:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.874328:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.874331:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.874362:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.874372:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 17 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.874383:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721362816:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126613.875031:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447424 00000100:00100000:3.0:1746126613.875036:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447424 00010000:00010000:3.0:1746126613.875055:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:3.0:1746126613.875076:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7027 00000100:00100000:3.0:1746126613.875095:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721447424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126613.875105:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126613.875126:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.875136:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.875154:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29a00/0xb50e8258676134b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da2b expref: 27 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.875167:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126613.875242:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 14 pid: 4641 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746126613.875260:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7028 00000100:00100000:0.0:1746126613.875265:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721447296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126613.875272:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126613.875280:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 14 pid: 4641 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746126613.875288:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 14 pid: 4641 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746126613.875300:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3400/0xb50e825867613519 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da5c expref: 14 pid: 4641 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746126613.875311:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.875312:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126613.875318:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.875331:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126613.875353:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126613.875361:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721362944:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126613.875534:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126613.875594:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721447424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 512us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.875601:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7027 00000100:00100000:0.0:1746126613.876332:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.879535:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721362944:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126613.879557:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126613.879597:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721447296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4329us (6265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126613.879607:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7028 00000100:00100000:1.0:1746126613.880486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.880712:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447808 00000100:00100000:3.0:1746126613.880720:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447808 00002000:00100000:3.0:1746126613.880768:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1597440->1601535) req@ffff88008e3a9180 x1830945721447808/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.880778:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9180 with x1830945721447808 ext(1597440->1601535) 00002000:00010000:3.0:1746126613.880783:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9180 00000100:00100000:3.0:1746126613.880813:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7708 00000100:00100000:3.0:1746126613.880820:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721447808:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126613.881005:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721447808:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 184us (520us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126613.881011:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7708 00002000:00100000:3.0:1746126613.881017:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1597440->1601535) req@ffff88008e3a9180 x1830945721447808/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.881024:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9180 with x1830945721447808 ext(1597440->1601535) 00002000:00010000:3.0:1746126613.881027:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9180 00000100:00100000:2.0:1746126613.881289:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721362816:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.881315:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.881330:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c59400, rc 0) 00000100:00100000:2.0:1746126613.881357:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31267:x1830945721447552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7096us (7334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.881364:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13482 00000100:00100000:1.0:1746126613.886331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.886436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.886501:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721447936 00000100:00100000:2.0:1746126613.886510:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721447936 00000100:00100000:2.0:1746126613.886567:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13483 00000100:00100000:2.0:1746126613.886575:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31260:x1830945721447936:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.886595:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.886613:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db3c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.886643:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.886651:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.886653:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.886657:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.886686:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.886696:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 25 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.886707:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721363072:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.886790:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.887931:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448064 00000100:00100000:0.0:1746126613.887940:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448064 00002000:00100000:0.0:1746126613.887988:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31d:0x0] (348160->778239) req@ffff88009f11c700 x1830945721448064/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.887997:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c700 with x1830945721448064 ext(348160->778239) 00010000:00010000:0.0:1746126613.888005:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.888016:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746126613.888028:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f11c700 00000100:00100000:0.0:1746126613.888121:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1759 00000100:00100000:0.0:1746126613.888129:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721448064:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126613.895425:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721363072:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.895463:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.895482:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c58400, rc 0) 00000100:00100000:2.0:1746126613.895528:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31260:x1830945721447936:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8952us (9206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.895537:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13483 00000100:00100000:0.0:1746126613.897262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.902961:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448192 00000100:00100000:3.0:1746126613.902976:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448192 00002000:00100000:3.0:1746126613.903023:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1601535) req@ffff880092b14380 x1830945721448192/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.903032:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14380 with x1830945721448192 ext(1048576->1601535) 00010000:00010000:3.0:1746126613.903041:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 26 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.903053:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 26 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:3.0:1746126613.903060:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b14380 00000100:00100000:3.0:1746126613.903101:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1760 00000100:00100000:3.0:1746126613.903110:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721448192:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126613.903462:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721448064:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 15332us (17023us total) trans 21474840343 rc 0/0 00000100:00100000:0.0:1746126613.903471:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1759 00002000:00100000:0.0:1746126613.903477:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31d:0x0] (348160->778239) req@ffff88009f11c700 x1830945721448064/t21474840343(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126613.903484:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c700 with x1830945721448064 ext(348160->778239) 00010000:00010000:0.0:1746126613.903491:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 20 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746126613.904797:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 20 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746126613.904806:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f11c700 00000100:00100000:0.0:1746126613.910761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.910855:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448320 00000100:00100000:1.0:1746126613.910865:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448320 00010000:00010000:1.0:1746126613.910904:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 20 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746126613.910946:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7029 00000100:00100000:1.0:1746126613.910953:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721448320:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.910965:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.910987:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 20 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.910997:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 20 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.911018:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134a30200/0xb50e82586761357b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 348160->778239) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa2 expref: 20 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.911035:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.911037:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.911044:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.911051:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.911093:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.911105:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721363200:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126613.911173:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.918300:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721448192:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 15179us (21036us total) trans 17179873189 rc 0/0 00000100:00100000:2.0:1746126613.918312:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1760 00002000:00100000:2.0:1746126613.918326:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1601535) req@ffff880092b14380 x1830945721448192/t17179873189(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.918335:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14380 with x1830945721448192 ext(1048576->1601535) 00010000:00010000:2.0:1746126613.918345:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 28 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:2.0:1746126613.918359:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 28 pid: 4640 timeout: 835 lvb_type: 0 00002000:00010000:2.0:1746126613.918366:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b14380 00000100:00100000:1.0:1746126613.920031:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721363200:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126613.920050:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.920093:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721448320:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9139us (9341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.920103:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7029 00000100:00100000:0.0:1746126613.924001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126613.924106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.924169:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448704 00000100:00100000:1.0:1746126613.924180:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448704 00010000:00010000:1.0:1746126613.924215:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 28 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.924436:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448576 00000100:00100000:2.0:1746126613.924441:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448576 00002000:00100000:2.0:1746126613.924476:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092b14e00 x1830945721448576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.924485:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14e00 with x1830945721448576 ext(0->1048575) 00002000:00010000:2.0:1746126613.924490:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b14e00 00000100:00100000:2.0:1746126613.924507:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7709 00000100:00100000:2.0:1746126613.924514:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721448576:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126613.925332:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7030 00000100:00100000:1.0:1746126613.925341:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721448704:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.925353:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126613.925369:0:9817:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126612 -> 1746126613 00002000:00010000:1.0:1746126613.925372:0:9817:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126612 -> 1746126613 00010000:00010000:1.0:1746126613.925379:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 28 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.925390:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 28 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.925412:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc400/0xb50e8258676136af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1601535) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db2e expref: 28 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.925432:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.925434:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.925440:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.925449:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.925480:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.925491:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721363328:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126613.926582:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.931147:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721363328:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126613.931171:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.931226:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721448704:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5884us (7116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.931236:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7030 00000100:00100000:0.0:1746126613.932721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.932892:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448832 00000100:00100000:2.0:1746126613.932900:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448832 00000100:00100000:2.0:1746126613.932953:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13484 00000100:00100000:2.0:1746126613.932961:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31260:x1830945721448832:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126613.932986:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.933003:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db43 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.933037:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.933045:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 17 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.933051:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.933053:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.933057:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->1187839] (req 1048576->1187839) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.933098:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 17 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.933110:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 17 pid: 20294 timeout: 835 lvb_type: 1 00000100:00100000:2.0:1746126613.933122:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721363456:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.933210:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.933219:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 18 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.933227:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099373b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721363584:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.933247:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.936363:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721448576:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 11840us (12362us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126613.936375:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7709 00002000:00100000:2.0:1746126613.936384:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092b14e00 x1830945721448576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/440 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126613.936394:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14e00 with x1830945721448576 ext(0->1048575) 00002000:00010000:2.0:1746126613.936400:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b14e00 00000100:00100000:0.0:1746126613.944479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.944703:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721449088 00000100:00100000:1.0:1746126613.944714:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721449088 00010000:00010000:1.0:1746126613.944750:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 19 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746126613.944790:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7031 00000100:00100000:1.0:1746126613.944797:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721449088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.944812:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.944861:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 19 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.944872:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 19 pid: 4640 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.944898:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126613.944899:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721363456:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.944925:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18800/0xb50e8258676134be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da39 expref: 19 pid: 4640 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.944944:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099373b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721363584:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.944974:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->1187839] (req 1048576->1187839) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.944984:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b090600, rc 0) 00000100:00100000:2.0:1746126613.945547:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31260:x1830945721448832:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12586us (12832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.945554:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13484 00000100:00100000:1.0:1746126613.945972:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721449088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1173us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.945979:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7031 00000100:00100000:0.0:1746126613.946048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.946093:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721448960 00000100:00100000:1.0:1746126613.946097:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721448960 00010000:00010000:1.0:1746126613.946117:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 15 pid: 20294 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746126613.946147:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7032 00000100:00100000:1.0:1746126613.946153:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721448960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.946163:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.946177:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 15 pid: 20294 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746126613.946187:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 15 pid: 20294 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746126613.946201:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19400/0xb50e825867613520 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4da63 expref: 15 pid: 20294 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746126613.946215:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.946216:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126613.946221:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.946229:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.946257:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126613.946267:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721363712:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126613.946327:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.955953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.956022:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721449344 00000100:00100000:3.0:1746126613.956032:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721449344 00000100:00100000:2.0:1746126613.956090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:3.0:1746126613.956095:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1183744->1187839) req@ffff880099373b80 x1830945721449344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.956105:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373b80 with x1830945721449344 ext(1183744->1187839) 00002000:00010000:3.0:1746126613.956110:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099373b80 00000100:00100000:2.0:1746126613.956111:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721449472 00000100:00100000:2.0:1746126613.956115:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721449472 00000100:00100000:3.0:1746126613.956148:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7710 00000100:00100000:3.0:1746126613.956156:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721449344:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126613.956271:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721363712:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126613.956290:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126613.956401:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721449344:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 243us (457us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126613.956403:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721448960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10250us (10355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126613.956407:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7710 00000100:00100000:1.0:1746126613.956411:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7032 00002000:00100000:3.0:1746126613.956414:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1183744->1187839) req@ffff880099373b80 x1830945721449344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:374/0 lens 488/4536 e 0 to 0 dl 1746126624 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.956421:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373b80 with x1830945721449344 ext(1183744->1187839) 00002000:00010000:3.0:1746126613.956423:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099373b80 00000100:00100000:2.0:1746126613.956470:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13485 00000100:00100000:2.0:1746126613.956476:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31267:x1830945721449472:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.956487:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.956503:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db4a expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.956526:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.956533:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.956535:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126613.956538:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.956564:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.956576:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 26 pid: 8436 timeout: 835 lvb_type: 0 00000100:00100000:2.0:1746126613.956591:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099373100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721363840:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126613.957695:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126613.962363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.962484:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099373100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721363840:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126613.962516:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.962534:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad6ae00, rc 0) 00000100:00100000:2.0:1746126613.962578:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31267:x1830945721449472:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6101us (6488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.962587:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13485 00000100:00100000:3.0:1746126613.963256:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721449600 00000100:00100000:3.0:1746126613.963264:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721449600 00002000:00100000:3.0:1746126613.963302:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1626112->2097151) req@ffff8800a4f57100 x1830945721449600/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/0 e 0 to 0 dl 1746126624 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126613.963311:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f57100 with x1830945721449600 ext(1626112->2097151) 00010000:00010000:3.0:1746126613.963317:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 27 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746126613.963335:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 27 pid: 8436 timeout: 835 lvb_type: 0 00002000:00010000:3.0:1746126613.963341:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f57100 00000100:00100000:3.0:1746126613.963358:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1761 00000100:00100000:3.0:1746126613.963364:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721449600:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126613.966282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.966291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.966378:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721449856 00000100:00100000:3.0:1746126613.966387:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721449856 00000100:00100000:3.0:1746126613.966436:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3774 00000100:00100000:3.0:1746126613.966442:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31260:x1830945721449856:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126613.966639:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31260:x1830945721449856:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 197us (375us total) trans 8589943110 rc 0/0 00000100:00100000:3.0:1746126613.966645:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3774 00000100:00100000:1.0:1746126613.967179:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721450112 00000100:00100000:1.0:1746126613.967185:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721450112 00000100:00100000:1.0:1746126613.967226:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8928 00000100:00100000:1.0:1746126613.967232:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+244:31271:x1830945721450112:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126613.967246:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126613.967262:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664e00/0xb50e8258676136d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db51 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.967345:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967358:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967368:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967379:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967384:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967388:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967476:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664400/0xb50e8258676136e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967485:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664400/0xb50e8258676136e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967490:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664400/0xb50e8258676136e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126613.967501:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126613.967553:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967559:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967564:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967569:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e665a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126613.967573:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967579:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967588:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126613.967591:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126613.967594:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967599:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665a00/0xb50e8258676136d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967625:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967631:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967634:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967641:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e664600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126613.967643:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967647:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967652:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5600) 00010000:00010000:1.0:1746126613.967653:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126613.967655:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967658:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664600/0xb50e8258676136e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126613.967686:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664e00/0xb50e8258676136d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db51 expref: 247 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.967695:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664400/0xb50e8258676136e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db51 expref: 246 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.967701:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126613.967704:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126613.967706:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e664400, rc 0) 00000100:00100000:1.0:1746126613.967744:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+246:31271:x1830945721450112:12345-192.168.203.2@tcp:101:cat.0 Request processed in 511us (1454us total) trans 8589943111 rc 0/0 00000100:00100000:1.0:1746126613.967750:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8928 00000100:00100000:2.0:1746126613.976947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.976973:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721450368 00000100:00100000:2.0:1746126613.976982:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721450368 00000100:00100000:3.0:1746126613.978948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126613.979171:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721450496 00000100:00100000:2.0:1746126613.979227:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3775 00000100:00100000:2.0:1746126613.979241:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+246:31271:x1830945721450368:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126613.979444:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+247:31271:x1830945721450368:12345-192.168.203.2@tcp:35:cat.0 Request processed in 207us (2505us total) trans 8589943112 rc 0/0 00000100:00100000:2.0:1746126613.979451:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3775 00000100:00100000:1.0:1746126613.979568:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721450496 00000100:00100000:1.0:1746126613.979615:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 698 00000100:00100000:1.0:1746126613.979620:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+247:1966:x1830945721450496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126613.979630:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126613.979653:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e664400/0xb50e8258676136e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db51 expref: 247 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126613.979668:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126613.979672:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126613.979693:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+246:1966:x1830945721450496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 73us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126613.979698:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 698 00000100:00100000:2.0:1746126613.987236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.987266:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721450624 00000100:00100000:2.0:1746126613.987274:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721450624 00000100:00100000:2.0:1746126613.987312:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13486 00000100:00100000:2.0:1746126613.987318:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721450624:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.987335:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.987352:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db58 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126613.987376:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.987378:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126613.987386:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.987400:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.987414:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad6a800, rc 0) 00000100:00100000:2.0:1746126613.987453:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721450624:12345-192.168.203.2@tcp:101:cat.0 Request processed in 134us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126613.987458:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13486 00000100:00100000:2.0:1746126613.987485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.987495:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721450880 00000100:00100000:2.0:1746126613.987498:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721450880 00000100:00100000:2.0:1746126613.987512:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13487 00000100:00100000:2.0:1746126613.987516:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721450880:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.987522:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.987533:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b091600/0xb50e8258676136fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db66 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.987569:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099370a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721363968:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126613.987617:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.987662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126613.987675:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721450752 00000100:00100000:2.0:1746126613.987678:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721450752 00000100:00100000:2.0:1746126613.987692:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13488 00000100:00100000:2.0:1746126613.987696:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721450752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126613.987701:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126613.987707:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53bf200/0xb50e825867613703 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db5f expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126613.987728:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721364096:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126613.987745:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126613.987778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126613.987931:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721451008 00000100:00100000:3.0:1746126613.987935:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721451008 00000100:00100000:3.0:1746126613.987951:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13489 00000100:00100000:3.0:1746126613.987956:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721451008:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126613.987961:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126613.987973:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1400/0xb50e82586761370a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db6d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126613.987998:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721364224:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126613.988045:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126613.995379:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721449600:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 32001us (33012us total) trans 17179873190 rc 0/0 00000100:00100000:1.0:1746126613.995393:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1761 00002000:00100000:1.0:1746126613.995408:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1626112->2097151) req@ffff8800a4f57100 x1830945721449600/t17179873190(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:374/0 lens 488/448 e 0 to 0 dl 1746126624 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126613.995418:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f57100 with x1830945721449600 ext(1626112->2097151) 00010000:00010000:1.0:1746126613.995429:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 33 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126613.995446:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 33 pid: 8436 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746126613.995453:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f57100 00002000:00010000:3.0:1746126613.996489:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126612 -> 1746126613 00002000:00010000:3.0:1746126613.996494:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126612 -> 1746126613 00002000:00010000:3.0:1746126613.996496:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126612 -> 1746126613 00000100:00100000:3.0:1746126613.996517:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721364224:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.996549:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1400/0xb50e82586761370a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db6d expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.996562:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1b1400/0xb50e82586761370a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db6d expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.996583:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b1400, rc 0) 00000100:00100000:3.0:1746126613.996624:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721451008:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8667us (8844us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126613.996633:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13489 00002000:00010000:3.0:1746126613.996752:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126612 -> 1746126613 00000100:00100000:3.0:1746126613.996767:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099370a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721363968:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126613.996785:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b091600/0xb50e8258676136fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db66 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.996794:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b091600/0xb50e8258676136fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db66 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126613.996801:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b091600, rc 0) 00000100:00100000:3.0:1746126613.996817:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721450880:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9300us (9331us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126613.996822:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13487 00000100:00100000:2.0:1746126613.997278:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721364096:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126613.997295:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a53bf200/0xb50e825867613703 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db5f expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.997304:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53bf200/0xb50e825867613703 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db5f expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126613.997315:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53bf200, rc 0) 00000100:00100000:2.0:1746126613.997338:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721450752:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9641us (9674us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126613.997343:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13488 00000100:00100000:0.0:1746126614.002425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.003330:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721451136 00000100:00100000:1.0:1746126614.003340:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721451136 00010000:00010000:1.0:1746126614.003685:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 29 pid: 8436 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746126614.003721:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7033 00000100:00100000:1.0:1746126614.003729:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721451136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.003746:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.003767:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 29 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126614.003780:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 29 pid: 8436 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746126614.003803:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fbc800/0xb50e825867613677 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db12 expref: 29 pid: 8436 timeout: 835 lvb_type: 0 00000100:00080000:3.0:1746126614.004383:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746126614.005058:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.005061:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.005070:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.005088:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.005128:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.005142:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721364352:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126614.005437:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126614.006562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.006633:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721451392 00000100:00100000:1.0:1746126614.006640:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721451392 00002000:00100000:1.0:1746126614.006686:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e9d6a00 x1830945721451392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.006696:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6a00 with x1830945721451392 ext(0->1048575) 00002000:00010000:1.0:1746126614.006700:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d6a00 00000100:00100000:1.0:1746126614.006718:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7711 00000100:00100000:1.0:1746126614.006725:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721451392:12345-192.168.203.2@tcp:3:cat.0 00000100:00080000:3.0:1746126614.010302:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126614.019704:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721364352:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126614.019727:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.019797:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721451136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 16066us (17381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.019807:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7033 00000100:00100000:0.0:1746126614.021141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.021192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.021271:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721451648 00000100:00100000:1.0:1746126614.021279:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721451648 00002000:00100000:1.0:1746126614.021353:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a4f56d80 x1830945721451648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.021362:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56d80 with x1830945721451648 ext(1048576->2097151) 00002000:00010000:1.0:1746126614.021367:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f56d80 00000100:00080000:3.0:1746126614.021381:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746126614.021382:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721452032 00000100:00100000:1.0:1746126614.021384:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721452032 00002000:00100000:1.0:1746126614.021394:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1470463) req@ffff8800a4f56680 x1830945721452032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.021400:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56680 with x1830945721452032 ext(1048576->1470463) 00002000:00010000:1.0:1746126614.021404:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f56680 00000100:00100000:1.0:1746126614.021415:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7712 00000100:00100000:1.0:1746126614.021421:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721451648:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126614.021443:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7713 00000100:00100000:2.0:1746126614.021452:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721452032:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126614.027583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.027674:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721452160 00000100:00100000:2.0:1746126614.027684:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721452160 00002000:00100000:2.0:1746126614.027737:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1187840->2097151) req@ffff88009e9d4700 x1830945721452160/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.027749:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4700 with x1830945721452160 ext(1187840->2097151) 00002000:00010000:2.0:1746126614.027754:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d4700 00000100:00100000:2.0:1746126614.027778:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7714 00000100:00100000:2.0:1746126614.027787:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721452160:12345-192.168.203.2@tcp:3:multiop.0 00000100:00080000:3.0:1746126614.029207:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126614.035227:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721451392:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28490us (28659us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126614.035241:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7711 00002000:00100000:1.0:1746126614.035253:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e9d6a00 x1830945721451392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.035263:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6a00 with x1830945721451392 ext(0->1048575) 00002000:00010000:1.0:1746126614.035268:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d6a00 00000100:00100000:2.0:1746126614.046583:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721452032:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 25122us (25380us total) trans 0 rc 421888/421888 00000100:00100000:2.0:1746126614.046596:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7713 00002000:00100000:2.0:1746126614.046608:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1470463) req@ffff8800a4f56680 x1830945721452032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 421888/421888 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.046617:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56680 with x1830945721452032 ext(1048576->1470463) 00002000:00010000:2.0:1746126614.046622:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f56680 00000100:00100000:2.0:1746126614.048559:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721452160:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 20766us (20980us total) trans 0 rc 909312/909312 00000100:00100000:2.0:1746126614.048568:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7714 00002000:00100000:2.0:1746126614.048576:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1187840->2097151) req@ffff88009e9d4700 x1830945721452160/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 909312/909312 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.048583:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4700 with x1830945721452160 ext(1187840->2097151) 00002000:00010000:2.0:1746126614.048588:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d4700 00000100:00100000:1.0:1746126614.052228:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721451648:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 30796us (31082us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126614.052239:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7712 00002000:00100000:1.0:1746126614.052249:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a4f56d80 x1830945721451648/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.052258:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56d80 with x1830945721451648 ext(1048576->2097151) 00002000:00010000:1.0:1746126614.052263:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f56d80 00000100:00100000:0.0:1746126614.055090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.055180:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721452288 00000100:00100000:2.0:1746126614.055189:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721452288 00000100:00100000:2.0:1746126614.055239:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13490 00000100:00100000:2.0:1746126614.055245:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:31271:x1830945721452288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126614.055262:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.055278:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db74 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.055301:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.055303:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.055309:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 29 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.055327:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 29 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.055336:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53bfa00, rc 0) 00000100:00100000:2.0:1746126614.055373:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:31271:x1830945721452288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 129us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.055378:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13490 00000100:00100000:0.0:1746126614.070224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.071439:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721452544 00000100:00100000:1.0:1746126614.071449:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721452544 00002000:00100000:1.0:1746126614.071497:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012ddac380 x1830945721452544/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.071507:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac380 with x1830945721452544 ext(1048576->2097151) 00002000:00010000:1.0:1746126614.071512:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddac380 00000100:00100000:1.0:1746126614.071541:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7715 00000100:00100000:1.0:1746126614.071547:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721452544:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126614.090722:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721452544:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19164us (20497us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126614.090733:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7715 00002000:00100000:1.0:1746126614.090744:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012ddac380 x1830945721452544/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.090752:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac380 with x1830945721452544 ext(1048576->2097151) 00002000:00010000:1.0:1746126614.090758:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddac380 00000100:00100000:0.0:1746126614.105898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.106060:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721452800 00000100:00100000:1.0:1746126614.106069:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721452800 00000100:00100000:1.0:1746126614.106156:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8929 00000100:00100000:1.0:1746126614.106165:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31276:x1830945721452800:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126614.106191:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126614.106211:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464200/0xb50e825867613718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db7b expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.106320:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106333:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106345:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106358:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106363:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106369:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106470:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761372d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106478:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761372d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106484:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761372d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126614.106492:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126614.106574:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106581:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106587:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106598:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093963a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126614.106601:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106608:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106619:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126614.106621:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126614.106624:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106632:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093963a00/0xb50e82586761371f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106649:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106654:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106657:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106660:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126614.106662:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106666:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106671:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5600) 00010000:00010000:1.0:1746126614.106673:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126614.106674:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.106678:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962400/0xb50e825867613726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00080000:3.0:1746126614.107544:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746126614.109871:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e464200/0xb50e825867613718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db7b expref: 31 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.109890:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761372d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db7b expref: 30 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.109904:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126614.109907:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126614.109910:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093962200, rc 0) 00000100:00100000:1.0:1746126614.109978:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:31276:x1830945721452800:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3813us (4091us total) trans 8589943113 rc 0/0 00000100:00100000:1.0:1746126614.109987:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8929 00000100:00100000:2.0:1746126614.113304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.113443:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721452928 00000100:00100000:0.0:1746126614.113453:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721452928 00000100:00100000:3.0:1746126614.114770:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13491 00000100:00100000:3.0:1746126614.114785:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:31271:x1830945721452928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126614.114803:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.114822:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db82 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.114869:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.114876:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126614.114878:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126614.114881:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 30 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.114910:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.114922:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 14 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.114934:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721364480:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126614.115035:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126614.124116:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721364480:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126614.124151:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 30 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.124169:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b0e00, rc 0) 00000100:00100000:3.0:1746126614.124225:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:31271:x1830945721452928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9444us (10929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.124234:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13491 00000100:00100000:1.0:1746126614.148352:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.148395:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721453184 00000100:00100000:1.0:1746126614.148401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.148404:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721453184 00000100:00100000:2.0:1746126614.148473:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 699 00000100:00100000:2.0:1746126614.148482:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945721453184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126614.148505:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126614.148532:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962200/0xb50e82586761372d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db7b expref: 30 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.148563:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.148567:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126614.148612:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721453184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 131us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.148618:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 699 00000100:00100000:0.0:1746126614.148751:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721453056 00000100:00100000:0.0:1746126614.148755:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721453056 00002000:00100000:0.0:1746126614.148789:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1470464->2097151) req@ffff88009f11d180 x1830945721453056/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126614.148799:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11d180 with x1830945721453056 ext(1470464->2097151) 00010000:00010000:0.0:1746126614.148807:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746126614.148819:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746126614.148853:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f11d180 00000100:00100000:0.0:1746126614.148868:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1762 00000100:00100000:0.0:1746126614.148874:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721453056:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126614.150166:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.150240:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721453312 00000100:00100000:3.0:1746126614.150246:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721453312 00000100:00100000:3.0:1746126614.150282:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13492 00000100:00100000:3.0:1746126614.150288:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31276:x1830945721453312:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126614.150299:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.150313:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db89 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.150337:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126614.150342:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.150349:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126614.150352:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1265664->1400831] (req 1265664->1400831) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.150391:0:4640:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.150408:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1265664->1400831] (req 1265664->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.150416:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b1000, rc 0) 00000100:00100000:3.0:1746126614.150456:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31276:x1830945721453312:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 169us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.150462:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13492 00000100:00100000:2.0:1746126614.160032:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721453056:12345-192.168.203.2@tcp:4:cat.0 Request processed in 11146us (11617us total) trans 17179873191 rc 0/0 00000100:00100000:2.0:1746126614.160046:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1762 00002000:00100000:2.0:1746126614.160058:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1470464->2097151) req@ffff88009f11d180 x1830945721453056/t17179873191(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/448 e 0 to 0 dl 1746126625 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.160069:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11d180 with x1830945721453056 ext(1470464->2097151) 00010000:00010000:2.0:1746126614.160091:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.160108:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746126614.160114:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f11d180 00000100:00100000:2.0:1746126614.167754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.167958:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721453568 00000100:00100000:1.0:1746126614.167974:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721453568 00000100:00100000:1.0:1746126614.168037:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8930 00000100:00100000:1.0:1746126614.168045:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+246:31277:x1830945721453568:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126614.168068:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126614.168096:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093963e00/0xb50e825867613749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db90 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.168203:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168215:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168225:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168238:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168242:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168248:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168344:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761375e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168352:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761375e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168358:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761375e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126614.168365:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126614.168451:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168457:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168463:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168468:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093963600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126614.168471:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168478:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168488:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126614.168490:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126614.168494:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168501:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093963600/0xb50e825867613750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168524:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168528:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168532:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168536:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126614.168538:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168542:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168548:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5e00) 00010000:00010000:1.0:1746126614.168550:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126614.168551:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168555:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962600/0xb50e825867613757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126614.168587:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093963e00/0xb50e825867613749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db90 expref: 249 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.168598:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761375e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db90 expref: 248 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.168608:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126614.168610:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126614.168612:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093963000, rc 0) 00000100:00100000:1.0:1746126614.168655:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+248:31277:x1830945721453568:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 611us (910us total) trans 8589943114 rc 0/0 00000100:00100000:1.0:1746126614.168661:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8930 00000100:00080000:3.0:1746126614.169528:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126614.170974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.171041:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721453696 00000100:00100000:3.0:1746126614.171050:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721453696 00010000:00010000:3.0:1746126614.171091:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.171128:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7034 00000100:00100000:3.0:1746126614.171136:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721453696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.171153:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.171175:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.171187:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.171209:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c58400/0xb50e8258676136bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db3c expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.171243:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.171245:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.171251:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.171259:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.171290:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.171300:0:9817:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 29 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.171310:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721364736:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126614.171393:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126614.177277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.177796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.178153:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721453952 00000100:00100000:2.0:1746126614.178163:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721453952 00002000:00100000:2.0:1746126614.178211:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880134c3ea00 x1830945721453952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.178220:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ea00 with x1830945721453952 ext(1048576->2097151) 00010000:00010000:2.0:1746126614.178229:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.178242:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746126614.178249:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c3ea00 00000100:00100000:2.0:1746126614.178277:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1763 00000100:00100000:2.0:1746126614.178284:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721453952:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126614.179573:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454336 00000100:00100000:2.0:1746126614.179580:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454336 00000100:00100000:2.0:1746126614.179610:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3776 00000100:00100000:2.0:1746126614.179615:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d991050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+248:31277:x1830945721454336:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:0.0:1746126614.179731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.180782:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721364736:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126614.180805:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.180877:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721453696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9741us (9908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.180886:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7034 00000100:00100000:3.0:1746126614.180909:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454080 00000100:00100000:3.0:1746126614.180913:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454080 00000100:00100000:3.0:1746126614.180947:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 700 00000100:00100000:3.0:1746126614.180952:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+249:1964:x1830945721454080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.180964:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.180987:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093963000/0xb50e82586761375e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db90 expref: 249 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.181002:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126614.181006:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.181020:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+248:1964:x1830945721454080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 67us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.181024:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 700 00000100:00100000:2.0:1746126614.185710:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d991050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+248:31277:x1830945721454336:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 6085us (7903us total) trans 8589943115 rc 0/0 00000100:00100000:2.0:1746126614.185721:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3776 00000100:00100000:2.0:1746126614.188311:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721453952:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10016us (11034us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126614.188322:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1763 00002000:00100000:2.0:1746126614.188333:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880134c3ea00 x1830945721453952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.188341:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ea00 with x1830945721453952 ext(1048576->2097151) 00010000:00010000:2.0:1746126614.188351:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.188365:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746126614.188371:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c3ea00 00000100:00100000:1.0:1746126614.201015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.201135:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454464 00000100:00100000:3.0:1746126614.201144:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454464 00000100:00100000:3.0:1746126614.201185:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13493 00000100:00100000:3.0:1746126614.201192:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:31277:x1830945721454464:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126614.201210:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.201227:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db97 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.201259:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.201268:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 31 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.201275:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.201277:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.201280:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1773568->1921023] (req 1773568->1921023) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.201319:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 31 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.201331:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 31 pid: 23766 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.201343:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721364864:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126614.201424:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.201432:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.201722:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721364992:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126614.201759:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.204961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.205014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.205037:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454720 00000100:00100000:1.0:1746126614.205045:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454720 00010000:00010000:1.0:1746126614.205087:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 32 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746126614.205162:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454592 00000100:00100000:0.0:1746126614.205166:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454592 00000100:00100000:0.0:1746126614.205304:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13494 00000100:00100000:0.0:1746126614.205310:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:31271:x1830945721454592:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126614.205327:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126614.205342:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4db9e expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.205368:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.205374:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126614.205376:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126614.205379:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 20 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.205406:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.205415:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 13 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746126614.205426:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721365120:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126614.205495:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.205533:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7035 00000100:00100000:1.0:1746126614.205539:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721454720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.205548:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.205570:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 32 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.205580:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 32 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.205596:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b0e00/0xb50e82586761373b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db82 expref: 32 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.205615:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.205617:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.205622:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.205629:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.205649:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.205657:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721365248:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126614.205676:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.209929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.210066:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721364864:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.210087:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721364992:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.210117:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1773568->1921023] (req 1773568->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.210135:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b1800, rc 0) 00000100:00100000:2.0:1746126614.210189:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:31277:x1830945721454464:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8996us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.210197:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13493 00000100:00100000:1.0:1746126614.210292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.210335:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721365248:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126614.210343:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.210359:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721454720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4820us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.210366:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7035 00000100:00100000:1.0:1746126614.210385:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721455104 00000100:00100000:1.0:1746126614.210391:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721455104 00010000:00010000:1.0:1746126614.210411:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 17 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.210427:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454848 00000100:00100000:1.0:1746126614.210429:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454848 00010000:00010000:1.0:1746126614.210437:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 30 pid: 23766 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.210450:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7036 00000100:00100000:1.0:1746126614.210455:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721455104:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.210466:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.210487:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 17 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.210497:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 17 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.210519:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad6ae00/0xb50e8258676136cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db4a expref: 17 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.210530:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.210544:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721455104:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 89us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.210549:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7036 00000100:00100000:1.0:1746126614.210585:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7037 00000100:00100000:1.0:1746126614.210590:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721454848:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.210596:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.210603:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 30 pid: 23766 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.210616:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 30 pid: 23766 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.210628:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53bfa00/0xb50e825867613711 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db74 expref: 30 pid: 23766 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.210636:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.210637:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.210643:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.210651:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.210675:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.210685:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721365376:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126614.210732:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.210760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.210793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.210920:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721455360 00000100:00100000:1.0:1746126614.210924:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721455360 00002000:00100000:1.0:1746126614.210951:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1265664->1269759) req@ffff88009f11f100 x1830945721455360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.210959:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11f100 with x1830945721455360 ext(1265664->1269759) 00002000:00010000:1.0:1746126614.210964:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11f100 00000100:00100000:1.0:1746126614.210975:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721454976 00000100:00100000:1.0:1746126614.210977:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721454976 00002000:00100000:1.0:1746126614.210989:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1187839) req@ffff88008dad3100 x1830945721454976/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.210996:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3100 with x1830945721454976 ext(1048576->1187839) 00010000:00010000:1.0:1746126614.211001:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 14 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.211012:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 14 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746126614.211017:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad3100 00000100:00100000:1.0:1746126614.211028:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1764 00000100:00100000:1.0:1746126614.211033:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721454976:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126614.211373:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7716 00000100:00100000:2.0:1746126614.211380:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721455360:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126614.212013:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721365120:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126614.212032:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 20 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.212045:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c9000, rc 0) 00000100:00100000:2.0:1746126614.215295:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721455360:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 3905us (4523us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126614.215308:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7716 00002000:00100000:2.0:1746126614.215320:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1265664->1269759) req@ffff88009f11f100 x1830945721455360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/4536 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.215330:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11f100 with x1830945721455360 ext(1265664->1269759) 00002000:00010000:2.0:1746126614.215335:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11f100 00000100:00100000:0.0:1746126614.216322:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:31271:x1830945721454592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11007us (11370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126614.216332:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13494 00000100:00100000:3.0:1746126614.216873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.217140:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721365376:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126614.217159:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126614.217202:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721454848:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6611us (6909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.217210:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7037 00000100:00100000:2.0:1746126614.217237:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721455616 00000100:00100000:2.0:1746126614.217242:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721455616 00002000:00100000:2.0:1746126614.217272:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1773568->1777663) req@ffff88009e9d5500 x1830945721455616/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.217281:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5500 with x1830945721455616 ext(1773568->1777663) 00002000:00010000:2.0:1746126614.217284:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d5500 00000100:00100000:2.0:1746126614.217299:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7717 00000100:00100000:2.0:1746126614.217306:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721455616:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126614.217441:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721455616:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 134us (569us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126614.217447:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7717 00002000:00100000:2.0:1746126614.217451:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1773568->1777663) req@ffff88009e9d5500 x1830945721455616/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/4536 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.217458:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5500 with x1830945721455616 ext(1773568->1777663) 00002000:00010000:2.0:1746126614.217461:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d5500 00000100:00100000:0.0:1746126614.219589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.219656:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721455872 00000100:00100000:2.0:1746126614.219663:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721455872 00002000:00100000:2.0:1746126614.219696:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x323:0x0] (1396736->1400831) req@ffff880134c3ed80 x1830945721455872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.219704:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ed80 with x1830945721455872 ext(1396736->1400831) 00002000:00010000:2.0:1746126614.219708:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3ed80 00000100:00100000:2.0:1746126614.219729:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7718 00000100:00100000:2.0:1746126614.219735:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721455872:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126614.219882:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721455872:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 146us (299us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126614.219888:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7718 00002000:00100000:2.0:1746126614.219893:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1396736->1400831) req@ffff880134c3ed80 x1830945721455872/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/4536 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.219900:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ed80 with x1830945721455872 ext(1396736->1400831) 00002000:00010000:2.0:1746126614.219902:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3ed80 00000100:00100000:1.0:1746126614.221196:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721454976:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 10158us (10397us total) trans 21474840344 rc 0/0 00000100:00100000:1.0:1746126614.221205:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1764 00002000:00100000:1.0:1746126614.221211:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1187839) req@ffff88008dad3100 x1830945721454976/t21474840344(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/448 e 0 to 0 dl 1746126625 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.221219:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3100 with x1830945721454976 ext(1048576->1187839) 00010000:00010000:1.0:1746126614.221227:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.221240:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746126614.221247:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad3100 00000100:00100000:0.0:1746126614.223995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.224631:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721456128 00000100:00100000:1.0:1746126614.224641:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721456128 00002000:00100000:1.0:1746126614.225101:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1916928->1921023) req@ffff880134c3fb80 x1830945721456128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.225110:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3fb80 with x1830945721456128 ext(1916928->1921023) 00002000:00010000:1.0:1746126614.225115:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3fb80 00000100:00100000:1.0:1746126614.225197:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7719 00000100:00100000:1.0:1746126614.225206:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721456128:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126614.225697:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721456128:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 491us (1709us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126614.225705:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7719 00002000:00100000:1.0:1746126614.225710:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1916928->1921023) req@ffff880134c3fb80 x1830945721456128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/4536 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126614.225716:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3fb80 with x1830945721456128 ext(1916928->1921023) 00002000:00010000:1.0:1746126614.225719:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3fb80 00000100:00100000:0.0:1746126614.228156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.228214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.229045:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721456512 00000100:00100000:2.0:1746126614.229055:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721456512 00000100:00100000:2.0:1746126614.229117:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3777 00000100:00100000:2.0:1746126614.229125:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:31276:x1830945721456512:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126614.229352:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:31276:x1830945721456512:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 227us (1202us total) trans 8589943116 rc 0/0 00000100:00100000:2.0:1746126614.229358:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3777 00000100:00100000:3.0:1746126614.229625:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721456256 00000100:00100000:3.0:1746126614.229630:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721456256 00010000:00010000:3.0:1746126614.229653:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.229683:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7038 00000100:00100000:3.0:1746126614.229688:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721456256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.229699:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.229717:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.229729:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.229752:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b090600/0xb50e8258676136c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1187839) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db43 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.229769:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.229771:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.229777:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.229784:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.229810:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126614.229819:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721365504:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126614.229897:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126614.235213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.235488:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721456768 00000100:00100000:0.0:1746126614.235498:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721456768 00002000:00100000:0.0:1746126614.235545:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009204f800 x1830945721456768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126614.235554:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f800 with x1830945721456768 ext(1048576->2097151) 00002000:00010000:0.0:1746126614.235560:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204f800 00000100:00100000:0.0:1746126614.235589:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7720 00000100:00100000:0.0:1746126614.235597:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721456768:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126614.237866:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721365504:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126614.237891:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.237927:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721456256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8236us (9711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.237938:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7038 00000100:00100000:2.0:1746126614.247463:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721456768:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 11853us (12248us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126614.247476:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7720 00002000:00100000:2.0:1746126614.247487:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009204f800 x1830945721456768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/440 e 0 to 0 dl 1746126625 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.247497:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f800 with x1830945721456768 ext(1048576->2097151) 00002000:00010000:2.0:1746126614.247503:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204f800 00000100:00100000:0.0:1746126614.258478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.258569:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721456896 00000100:00100000:1.0:1746126614.258579:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721456896 00000100:00100000:1.0:1746126614.258638:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13495 00000100:00100000:1.0:1746126614.258645:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721456896:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126614.258665:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126614.258683:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f10000/0xb50e82586761377a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dba5 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.258741:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721365632:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126614.258824:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.261043:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721365632:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126614.261090:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f10000/0xb50e82586761377a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dba5 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.261104:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f10000/0xb50e82586761377a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dba5 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.261130:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f10000, rc 0) 00000100:00100000:1.0:1746126614.261188:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721456896:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2541us (2719us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126614.261196:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13495 00000100:00100000:0.0:1746126614.263738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.263797:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457024 00000100:00100000:1.0:1746126614.263806:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457024 00000100:00100000:1.0:1746126614.263894:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13496 00000100:00100000:1.0:1746126614.263902:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721457024:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126614.263920:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126614.263937:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867613781 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbac expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.263989:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721365760:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126614.264066:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.265367:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721365760:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126614.265394:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867613781 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbac expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.265405:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e464200/0xb50e825867613781 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbac expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.265414:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e464200, rc 0) 00000100:00100000:1.0:1746126614.265442:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721457024:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1540us (1711us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126614.265448:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13496 00000100:00100000:0.0:1746126614.270512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.270618:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457152 00000100:00100000:1.0:1746126614.270626:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457152 00000100:00100000:1.0:1746126614.270850:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13497 00000100:00100000:1.0:1746126614.270858:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721457152:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126614.270875:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126614.270892:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613788 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbb3 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.270949:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721365888:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126614.271037:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.275029:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721365888:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126614.275066:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613788 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbb3 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.275090:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613788 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbb3 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.275112:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093962c00, rc 0) 00000100:00100000:1.0:1746126614.275177:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721457152:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4319us (4674us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126614.275186:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13497 00000100:00100000:1.0:1746126614.303024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.303074:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457280 00000100:00100000:2.0:1746126614.303091:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457280 00000100:00100000:2.0:1746126614.303158:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8931 00000100:00100000:2.0:1746126614.303166:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31281:x1830945721457280:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.303189:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.303208:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bf200/0xb50e82586761378f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbba expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.303270:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303283:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303294:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303307:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303313:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303319:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303441:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303451:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 247 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.303457:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.303487:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 247 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.303498:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 247 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.303509:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721366016:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.303593:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2c00 going to sleep for 11 seconds 00000100:00080000:3.0:1746126614.303653:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126614.309167:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721366016:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.309198:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126614.309424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.309533:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457536 00000100:00100000:1.0:1746126614.309540:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457536 00000100:00100000:1.0:1746126614.310472:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3778 00000100:00100000:1.0:1746126614.310480:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+248:27349:x1830945721457536:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126614.310682:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+249:27349:x1830945721457536:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 203us (1260us total) trans 8589943117 rc 0/0 00000100:00100000:1.0:1746126614.310688:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3778 00000100:00100000:0.0:1746126614.321517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.322452:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457664 00000100:00100000:3.0:1746126614.322463:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457664 00010000:00010000:3.0:1746126614.322503:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.322544:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7039 00000100:00100000:3.0:1746126614.322552:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+249:1964:x1830945721457664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.322567:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.322572:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.322583:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.322602:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e8258676132f7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d959 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.322627:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126614.322631:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.322639:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.322644:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.323883:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.323947:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+248:1964:x1830945721457664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1392us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.323956:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7039 00010000:00010000:2.0:1746126614.324041:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324048:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126614.324092:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126614.324096:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126614.324110:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324119:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324127:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324132:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324136:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324141:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a53be000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126614.324144:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324150:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324159:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126614.324162:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126614.324164:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324169:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53be000/0xb50e825867613796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324190:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324195:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324200:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324203:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a53bfc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126614.324205:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324210:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324215:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215100) 00010000:00010000:2.0:1746126614.324217:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126614.324219:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324223:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bfc00/0xb50e82586761379d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.324251:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a53bf200/0xb50e82586761378f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.324264:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.324270:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.324271:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126614.324273:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bca400, rc 0) 00000100:00100000:2.0:1746126614.324299:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31281:x1830945721457280:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 21134us (21285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.324304:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8931 00000100:00100000:0.0:1746126614.334867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.334970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.334994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.335007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.335020:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457792 00000100:00100000:0.0:1746126614.335024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.335029:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457792 00000100:00100000:0.0:1746126614.335054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.335067:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721457920 00000100:00100000:2.0:1746126614.335070:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721457920 00000100:00100000:0.0:1746126614.335085:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721458048 00000100:00100000:0.0:1746126614.335091:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721458048 00000100:00100000:2.0:1746126614.335092:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721458176 00000100:00100000:2.0:1746126614.335094:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721458176 00000100:00100000:2.0:1746126614.335106:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721458304 00000100:00100000:2.0:1746126614.335108:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721458304 00000100:00100000:0.0:1746126614.335120:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721458432 00000100:00100000:0.0:1746126614.335122:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721458432 00000100:00100000:2.0:1746126614.335126:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13498 00000100:00100000:2.0:1746126614.335134:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721457792:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:0.0:1746126614.335136:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13499 00000100:00100000:0.0:1746126614.335143:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721457920:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.335147:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126614.335156:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.335162:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbc1 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.335170:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e8258676137b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbc8 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.335181:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.335183:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.335191:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.335207:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.335215:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099079c00, rc 0) 00000100:00100000:0.0:1746126614.335216:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721366144:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126614.335265:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721457792:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 132us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.335272:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13498 00000100:00100000:2.0:1746126614.335288:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13500 00000100:00100000:2.0:1746126614.335293:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721458176:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.335298:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.335305:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbd6 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.335315:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.335317:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.335321:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126614.335322:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13501 00000100:00100000:1.0:1746126614.335329:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721458048:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:3.0:1746126614.335330:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13502 00010000:00010000:2.0:1746126614.335330:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.335336:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.335337:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bcb800, rc 0) 00000100:00100000:3.0:1746126614.335338:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721458304:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126614.335343:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093962000/0xb50e8258676137c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbcf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.335346:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.335354:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbdd expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.335366:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.335367:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.335372:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.335382:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.335389:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1b0200, rc 0) 00000100:00100000:1.0:1746126614.335577:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721366272:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126614.335878:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721458176:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 584us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126614.335880:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126614.335883:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13500 00000100:00100000:2.0:1746126614.335896:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13503 00000100:00100000:2.0:1746126614.335901:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721458432:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.335909:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.335917:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbe4 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.335928:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.335929:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.335933:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.335942:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 11 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.335947:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:2.0:1746126614.335964:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721458432:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 63us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.335969:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13503 00000100:00100000:3.0:1746126614.336130:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721458304:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 791us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.336135:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13502 00000100:00100000:1.0:1746126614.336816:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126614.341063:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721366144:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126614.341108:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e8258676137b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc8 expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.341121:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0c9e00/0xb50e8258676137b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc8 expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.341156:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c9e00, rc 0) 00000100:00100000:2.0:1746126614.341206:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721457920:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 6062us (6233us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126614.341214:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13499 00000100:00100000:1.0:1746126614.342911:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721366272:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126614.342940:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093962000/0xb50e8258676137c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbcf expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.342959:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093962000/0xb50e8258676137c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbcf expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.342979:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093962000, rc 0) 00000100:00100000:1.0:1746126614.343027:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721458048:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 7698us (8030us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126614.343035:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13501 00000100:00100000:0.0:1746126614.351411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.351602:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721458688 00000100:00100000:2.0:1746126614.351612:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721458688 00000100:00100000:2.0:1746126614.351678:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8932 00000100:00100000:2.0:1746126614.351686:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31281:x1830945721458688:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.351702:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.351719:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba400/0xb50e8258676137d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbeb expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.351787:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.351798:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.351804:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.351859:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.351868:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 8 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.351878:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721366400:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.351957:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126614.358629:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721366400:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.358652:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126614.358724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.359263:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721458816 00000100:00100000:3.0:1746126614.359273:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721458816 00010000:00010000:3.0:1746126614.359307:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 9 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.359346:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7040 00000100:00100000:3.0:1746126614.359353:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721458816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.359371:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.359377:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 9 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.359389:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 9 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.359411:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137a4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbba expref: 9 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.359438:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126614.359443:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.359452:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.359459:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.359478:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126614.359511:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.359519:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126614.359520:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721458816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 167us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.359526:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7040 00000004:00200000:2.0:1746126614.359537:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126614.359653:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba400/0xb50e8258676137d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbeb expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.359694:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbeb expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.359701:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.359703:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126614.359705:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb800, rc 0) 00000100:00100000:2.0:1746126614.359763:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31281:x1830945721458688:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 8077us (8362us total) trans 8589943118 rc 0/0 00000100:00100000:2.0:1746126614.359770:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8932 00000100:00100000:0.0:1746126614.364340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.364427:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459072 00000100:00100000:2.0:1746126614.364437:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459072 00000100:00100000:2.0:1746126614.365223:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8933 00000100:00100000:2.0:1746126614.365232:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31281:x1830945721459072:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.365252:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.365255:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126614.365278:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e8258676137dc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbeb expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.365297:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.365301:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126614.365312:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbf2 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.366568:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bcb000/0xb50e8258676137f1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.366583:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bcb000/0xb50e8258676137f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.366591:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bcb000/0xb50e8258676137f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126614.366601:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126614.366691:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bca400/0xb50e8258676137ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbf2 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.366704:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bcb000/0xb50e8258676137f1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbf2 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.366710:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.366712:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126614.366714:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bcb000, rc 0) 00000100:00100000:2.0:1746126614.367679:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31281:x1830945721459072:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 2446us (3347us total) trans 8589943119 rc 0/0 00000100:00100000:2.0:1746126614.367687:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8933 00000100:00100000:0.0:1746126614.372166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.372275:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459200 00000100:00100000:2.0:1746126614.372283:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459200 00000100:00100000:0.0:1746126614.375346:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8934 00000100:00100000:0.0:1746126614.375362:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31281:x1830945721459200:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126614.375382:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126614.375398:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e8258676137ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dbf9 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.375442:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e8258676137ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbf9 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.375457:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e8258676137ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbf9 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.375469:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126614.375472:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126614.375475:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8e00, rc 0) 00000100:00100000:0.0:1746126614.375530:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31281:x1830945721459200:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 173us (3372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126614.375535:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8934 00000100:00100000:0.0:1746126614.382917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.382950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.383029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.383336:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459328 00000100:00100000:1.0:1746126614.383346:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459328 00000100:00100000:1.0:1746126614.383377:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459584 00000100:00100000:1.0:1746126614.383379:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459584 00000100:00100000:1.0:1746126614.383388:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459456 00000100:00100000:1.0:1746126614.383390:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459456 00000100:00100000:1.0:1746126614.383413:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13504 00000100:00100000:1.0:1746126614.383420:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721459328:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126614.383454:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383469:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383475:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.383480:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.383491:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.383492:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.383495:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383518:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.383528:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 19 pid: 4640 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746126614.383539:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721366528:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126614.383614:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.383621:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 8 pid: 4641 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746126614.383628:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721366656:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126614.383645:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383651:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 14 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.383663:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721366784:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.383674:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.383766:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13505 00000100:00100000:1.0:1746126614.383771:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721459584:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126614.383787:0:20294:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383797:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383802:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126614.383804:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126614.383806:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383817:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383824:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.383851:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721366912:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.383880:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126614.383916:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13506 00000100:00100000:1.0:1746126614.383921:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721459456:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126614.383933:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383943:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383948:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126614.383949:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126614.383951:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383963:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.383970:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 28 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.383977:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721367040:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.383993:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126614.384719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.384735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.384759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.385240:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459712 00000100:00100000:2.0:1746126614.385248:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459712 00000100:00100000:2.0:1746126614.385275:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459840 00000100:00100000:2.0:1746126614.385277:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459840 00000100:00100000:2.0:1746126614.385287:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721459968 00000100:00100000:2.0:1746126614.385289:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721459968 00000100:00100000:2.0:1746126614.385314:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13507 00000100:00100000:2.0:1746126614.385319:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721459712:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126614.385341:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385352:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385358:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.385362:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.385364:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.385365:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 5/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385381:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.385388:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 10 pid: 4641 timeout: 836 lvb_type: 1 00000100:00100000:2.0:1746126614.385400:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721367168:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126614.385430:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13508 00000100:00100000:0.0:1746126614.385440:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721459840:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126614.385450:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385456:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.385463:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721367296:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.385474:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746126614.385474:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.385488:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126614.385490:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13509 00000100:00100000:2.0:1746126614.385494:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721459968:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126614.385496:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126614.385507:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.385510:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.385513:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126614.385515:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126614.385517:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385518:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385525:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 15 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.385530:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.385536:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.385539:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.385541:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126614.385542:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126614.385544:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.385549:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 19 pid: 8436 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.385556:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126614.385561:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721367424:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.385563:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 28 pid: 8436 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.385571:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721367552:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126614.385608:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126614.385616:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 10 pid: 10890 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746126614.385623:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721367680:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.387402:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.387414:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 9 pid: 4641 timeout: 836 lvb_type: 1 00000100:00100000:2.0:1746126614.387424:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e805f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721367808:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.387455:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 15 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.387462:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 15 pid: 4641 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.387474:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e806680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721367936:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.387493:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.387499:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 15 pid: 8436 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.387505:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721368064:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.387518:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746126614.387678:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.387696:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746126614.387708:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721368192:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126614.387734:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126614.387882:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721366528:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.387890:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721366656:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126614.390244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.390302:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460096 00000100:00100000:2.0:1746126614.390311:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460096 00010000:00010000:2.0:1746126614.390338:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 11 pid: 4641 timeout: 836 lvb_type: 1 00000100:00100000:2.0:1746126614.390372:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7041 00000100:00100000:2.0:1746126614.390378:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721460096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126614.390388:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126614.390403:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 11 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.390413:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 11 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.390431:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099079c00/0xb50e8258676137ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbc1 expref: 11 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.390453:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126614.390491:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721460096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 113us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.390497:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7041 00000100:00100000:2.0:1746126614.393001:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721366784:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.393019:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721366912:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.393032:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.393039:0:20294:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.393065:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721367040:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126614.393074:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126614.393425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.393461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.393479:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460224 00000100:00100000:3.0:1746126614.393485:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460224 00010000:00010000:3.0:1746126614.393509:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746126614.398332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.399114:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460352 00000100:00100000:2.0:1746126614.399124:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460352 00002000:00100000:2.0:1746126614.399174:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1265664->1400831) req@ffff880093494380 x1830945721460352/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.399183:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494380 with x1830945721460352 ext(1265664->1400831) 00010000:00010000:2.0:1746126614.399192:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.399204:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746126614.399210:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093494380 00000100:00100000:2.0:1746126614.399234:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1765 00000100:00100000:2.0:1746126614.399241:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721460352:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126614.403483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.403531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.403565:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460480 00000100:00100000:3.0:1746126614.403575:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460480 00010000:00010000:3.0:1746126614.403606:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 20 pid: 4640 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746126614.403634:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7042 00000100:00100000:3.0:1746126614.403640:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721460224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.403650:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.403666:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.403676:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.403693:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c59400/0xb50e8258676136b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db35 expref: 15 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.403708:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.403747:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721460224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 107us (10325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.403752:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7042 00000100:00100000:3.0:1746126614.403763:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7043 00000100:00100000:3.0:1746126614.403767:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721460480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.403773:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.403778:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 20 pid: 4640 timeout: 836 lvb_type: 1 00010000:00010000:3.0:1746126614.403785:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 20 pid: 4640 timeout: 836 lvb_type: 1 00010000:00010000:3.0:1746126614.403794:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e8258676136f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db58 expref: 20 pid: 4640 timeout: 836 lvb_type: 1 00010000:00010000:3.0:1746126614.403800:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.403802:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.403806:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.403813:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.403853:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.403867:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721460480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 99us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.403872:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7043 00000100:00100000:0.0:1746126614.405637:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721460352:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 6390us (12169us total) trans 17179873192 rc 0/0 00000100:00100000:0.0:1746126614.405648:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1765 00002000:00100000:0.0:1746126614.405658:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1265664->1400831) req@ffff880093494380 x1830945721460352/t17179873192(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:375/0 lens 488/448 e 0 to 0 dl 1746126625 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126614.405667:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494380 with x1830945721460352 ext(1265664->1400831) 00010000:00010000:0.0:1746126614.405678:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746126614.405689:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 18 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746126614.405695:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093494380 00000100:00100000:0.0:1746126614.405712:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460608 00000100:00100000:0.0:1746126614.405718:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460608 00002000:00100000:0.0:1746126614.405742:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1773568->1921023) req@ffff88012b191180 x1830945721460608/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/0 e 0 to 0 dl 1746126625 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126614.405749:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191180 with x1830945721460608 ext(1773568->1921023) 00010000:00010000:0.0:1746126614.405754:0:15641:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 29 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746126614.405761:0:15641:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 29 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746126614.405766:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b191180 00000100:00100000:0.0:1746126614.405790:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1766 00000100:00100000:0.0:1746126614.405796:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721460608:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126614.405853:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721367168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.405865:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721367296:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.405882:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405900:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405907:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405929:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405935:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405941:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405946:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126614.405949:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405955:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405970:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.405975:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093962400/0xb50e825867613806 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126614.406051:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721459328:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 22631us (23145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.406059:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13504 00000100:00100000:1.0:1746126614.406380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.406444:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721367552:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.406477:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e805f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721367808:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.406493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.406508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.406533:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e806680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721367936:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126614.406547:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460864 00000100:00100000:1.0:1746126614.406550:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460864 00010000:00010000:1.0:1746126614.406571:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.406595:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460736 00000100:00100000:1.0:1746126614.406598:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460736 00010000:00010000:1.0:1746126614.406608:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 9 pid: 4641 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746126614.406625:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460992 00000100:00100000:1.0:1746126614.406627:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460992 00010000:00010000:1.0:1746126614.406638:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 10 pid: 4641 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746126614.406646:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461120 00000100:00100000:1.0:1746126614.406648:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461120 00010000:00010000:1.0:1746126614.406655:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 31 pid: 8436 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.406665:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7044 00000100:00100000:1.0:1746126614.406669:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721460864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.406679:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.406694:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.406703:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.406720:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e825867613773 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db9e expref: 19 pid: 23766 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.406735:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.406754:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721460864:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.406760:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7044 00000100:00100000:1.0:1746126614.406771:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7045 00000100:00100000:1.0:1746126614.406775:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721460736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.406782:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.406788:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 9 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.406795:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 9 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.406810:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb800/0xb50e8258676137b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbd6 expref: 9 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.406819:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.406821:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.406844:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.406853:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.406874:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.406890:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721460736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 113us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.406894:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7045 00000100:00100000:1.0:1746126614.406905:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7046 00000100:00100000:1.0:1746126614.406909:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721460992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.406916:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.406926:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 10 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.406934:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 10 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.406946:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e8258676137ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbe4 expref: 10 pid: 4641 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.406960:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.406973:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721460992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 64us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.406978:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7046 00000100:00100000:1.0:1746126614.406987:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7047 00000100:00100000:1.0:1746126614.406991:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721461120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.406997:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.407003:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 31 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.407010:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 31 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.407020:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fbd600/0xb50e82586761361c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daef expref: 31 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.407027:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.407040:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721461120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 49us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.407045:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7047 00000100:00100000:1.0:1746126614.407099:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721368064:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126614.407122:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407230:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407238:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407257:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407263:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407269:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407275:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092dafa00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126614.407278:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407284:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407293:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.407299:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092dafa00/0xb50e82586761381b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.407337:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721459712:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 22017us (22621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.407344:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13507 00000100:00100000:0.0:1746126614.407846:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721367424:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126614.407856:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721367680:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126614.407864:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721368192:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126614.407879:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126614.408297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.408349:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461504 00000100:00100000:3.0:1746126614.408355:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461504 00010000:00010000:3.0:1746126614.408378:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 18 pid: 4641 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.408401:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7048 00000100:00100000:3.0:1746126614.408406:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721461504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.408414:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.408433:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 18 pid: 4641 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.408446:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 18 pid: 4641 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.408459:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e8258676135eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dada expref: 18 pid: 4641 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.408473:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.408497:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721461504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.408502:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7048 00000100:00100000:2.0:1746126614.416293:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721460608:12345-192.168.203.2@tcp:4:cat.0 Request processed in 10490us (12814us total) trans 17179873193 rc 0/0 00000100:00100000:2.0:1746126614.416304:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1766 00002000:00100000:2.0:1746126614.416315:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1773568->1921023) req@ffff88012b191180 x1830945721460608/t17179873193(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:375/0 lens 488/448 e 0 to 0 dl 1746126625 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126614.416323:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191180 with x1830945721460608 ext(1773568->1921023) 00010000:00010000:2.0:1746126614.416332:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.416344:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00002000:00010000:2.0:1746126614.416350:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b191180 00000100:00100000:2.0:1746126614.419342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.419471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.419490:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461248 00000100:00100000:2.0:1746126614.419498:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461248 00010000:00010000:2.0:1746126614.419523:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 17 pid: 8436 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.419541:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461632 00000100:00100000:2.0:1746126614.419543:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461632 00010000:00010000:2.0:1746126614.419551:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 18 pid: 8436 timeout: 836 lvb_type: 1 00000100:00100000:2.0:1746126614.420120:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7049 00000100:00100000:2.0:1746126614.420133:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721461248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126614.420152:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126614.420177:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 17 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.420189:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 17 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.420213:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a30a00/0xb50e8258676135ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dab7 expref: 17 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:2.0:1746126614.420231:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.420233:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.420238:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.420246:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.420272:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126614.420316:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721461248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 186us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.420322:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7049 00000100:00100000:2.0:1746126614.420337:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7050 00000100:00100000:2.0:1746126614.420343:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721461632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126614.420351:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126614.420366:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 18 pid: 8436 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.420374:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 18 pid: 8436 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.420387:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba3400/0xb50e8258676135dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dacc expref: 18 pid: 8436 timeout: 836 lvb_type: 1 00010000:00010000:2.0:1746126614.420398:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126614.420412:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721461632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.420417:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7050 00000100:00100000:2.0:1746126614.420937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.421398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.421954:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461376 00000100:00100000:1.0:1746126614.421961:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461376 00010000:00010000:1.0:1746126614.421985:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 7 pid: 10890 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746126614.422010:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461760 00000100:00100000:1.0:1746126614.422012:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461760 00010000:00010000:1.0:1746126614.422022:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.422047:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7051 00000100:00100000:1.0:1746126614.422054:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721461376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.422062:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.422089:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 7 pid: 10890 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.422098:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 7 pid: 10890 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.422111:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1b0200/0xb50e8258676137c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbdd expref: 7 pid: 10890 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746126614.422123:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.422146:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721461376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 93us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.422152:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7051 00000100:00100000:1.0:1746126614.422166:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7052 00000100:00100000:1.0:1746126614.422170:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721461760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.422175:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.422182:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.422189:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.422200:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134a31a00/0xb50e825867613582 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4daa9 expref: 14 pid: 8436 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.422208:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.422210:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.422213:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422220:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422237:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.422251:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721461760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 80us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.422256:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7052 00010000:00010000:1.0:1746126614.422276:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422285:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422309:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422316:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422323:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422329:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092dae400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126614.422333:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422340:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422350:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.422355:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092dae400/0xb50e825867613829 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.422404:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721459968:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 36909us (37644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.422412:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13509 00010000:00010000:0.0:1746126614.422770:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422779:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422803:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422809:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422815:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422820:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0c8c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126614.422822:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422846:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422855:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126614.422860:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e825867613822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126614.423016:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1963:x1830945721459840:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 37578us (38278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126614.423026:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13508 00000100:00100000:1.0:1746126614.423164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.423200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126614.423258:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461888 00000100:00100000:3.0:1746126614.423263:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461888 00010000:00010000:3.0:1746126614.423280:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.423306:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462016 00000100:00100000:3.0:1746126614.423308:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462016 00010000:00010000:3.0:1746126614.423322:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.423335:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7053 00000100:00100000:3.0:1746126614.423340:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721461888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.423349:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.423361:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.423373:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.423385:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1000/0xb50e825867613742 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1400831) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db89 expref: 16 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.423395:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.423397:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.423401:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.423407:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.423432:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.423449:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721461888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.423454:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7053 00000100:00100000:3.0:1746126614.423462:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7054 00000100:00100000:3.0:1746126614.423466:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721462016:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.423472:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.423479:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.423486:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.423496:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f1b1800/0xb50e82586761376c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1921023) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4db97 expref: 30 pid: 4640 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.423503:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.423504:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.423507:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.423512:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126614.423521:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.423532:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721462016:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.423536:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7054 00010000:00010000:1.0:1746126614.423619:0:20294:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423626:0:20294:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423639:0:20294:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423644:0:20294:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423649:0:20294:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423654:0:20294:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093963800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126614.423656:0:20294:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423660:0:20294:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423668:0:20294:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423677:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093963800/0xb50e82586761380d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.423707:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721459584:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 39936us (40757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.423712:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13505 00010000:00010000:1.0:1746126614.423727:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423733:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423743:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423747:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423753:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423757:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e465a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126614.423759:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423763:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423770:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.423775:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e465a00/0xb50e825867613814 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126614.423796:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721459456:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 39875us (40767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.423800:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13506 00000100:00100000:0.0:1746126614.425939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.426093:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462272 00000100:00100000:2.0:1746126614.426102:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462272 00000100:00100000:2.0:1746126614.426156:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8935 00000100:00100000:2.0:1746126614.426163:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31281:x1830945721462272:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:2.0:1746126614.426209:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126614.426234:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e8258676137ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbf9 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426270:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.426274:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126614.426304:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.426316:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 247 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426323:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 29 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426329:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426334:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 247 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426340:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.426370:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 247 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426382:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 247 pid: 14549 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.426398:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e806680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368320:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.426490:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426498:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 29 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.426506:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368448:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.426530:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 29 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426537:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 29 pid: 14548 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.426543:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368576:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.426564:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 247 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.426571:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 247 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.426578:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b190700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368704:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.426594:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126614.430250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.430273:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462528 00000100:00100000:0.0:1746126614.430281:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462528 00010000:00010000:0.0:1746126614.430316:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 30 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:2.0:1746126614.430683:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e806680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368320:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.430693:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368448:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.430700:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368576:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126614.430708:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b190700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721368704:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126614.430734:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126614.431048:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7055 00000100:00100000:0.0:1746126614.431057:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721462528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126614.431069:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126614.431086:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 30 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746126614.431097:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 30 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.431115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126614.431118:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570fa00/0xb50e825867613328 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d96e expref: 30 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.431134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126614.431136:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126614.431140:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126614.431148:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126614.431161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.431172:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462400 00000100:00100000:1.0:1746126614.431176:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462400 00010000:00010000:1.0:1746126614.431188:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 248 pid: 14549 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746126614.431190:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721462528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 135us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.431222:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462656 00000100:00100000:3.0:1746126614.431226:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462656 00010000:00010000:3.0:1746126614.431240:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 30 pid: 14548 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.431252:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462784 00000100:00100000:3.0:1746126614.431253:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462784 00010000:00010000:3.0:1746126614.431259:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746126614.431267:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7056 00000100:00100000:3.0:1746126614.431271:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721462656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.431280:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.431282:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 30 pid: 14548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.431288:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 30 pid: 14548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.431298:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e825867613287 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d90c expref: 30 pid: 14548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.431306:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126614.431308:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.431313:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.431326:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721462656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.431332:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7056 00000100:00100000:3.0:1746126614.431343:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7057 00000100:00100000:3.0:1746126614.431347:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+249:1964:x1830945721462784:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126614.431352:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126614.431355:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.431361:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746126614.431370:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75bc00/0xb50e825867613280 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d905 expref: 249 pid: 14547 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746126614.431408:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7058 00000100:00100000:1.0:1746126614.431413:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+249:1965:x1830945721462400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126614.431420:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126614.431424:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 249 pid: 14549 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.431431:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 249 pid: 14549 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.431446:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093962e00/0xb50e825867613391 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4d99f expref: 249 pid: 14549 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746126614.431455:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126614.431458:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126614.431498:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7055 00010000:00010000:1.0:1746126614.431646:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126614.431655:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126614.431662:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126614.431664:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126614.431671:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126614.431682:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+247:1964:x1830945721462784:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 334us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.431682:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+247:1965:x1830945721462400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 270us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.431687:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7057 00000100:00100000:1.0:1746126614.431696:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7058 00010000:00010000:2.0:1746126614.431777:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.431783:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000040:00080000:2.0:1746126614.432556:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2636, 88 off223824 00000004:00080000:2.0:1746126614.432564:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736346735875ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.432612:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2750, 88 off233952 00000004:00080000:2.0:1746126614.432617:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736346789280ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.432643:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2751, 88 off234040 00000004:00080000:2.0:1746126614.432646:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736346818495ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.432652:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2637, 88 off223912 00000004:00080000:2.0:1746126614.432655:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736346827690ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.432661:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2638, 88 off224000 00000004:00080000:2.0:1746126614.432663:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736346836052ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.432670:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2752, 88 off234128 00000004:00080000:2.0:1746126614.432948:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347119976ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.432962:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2753, 88 off234216 00000004:00080000:2.0:1746126614.432965:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347137285ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.432972:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2639, 88 off224088 00000004:00080000:2.0:1746126614.432974:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736347146641ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.432982:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2754, 88 off234304 00000004:00080000:2.0:1746126614.432986:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347158015ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.432992:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2640, 88 off224176 00000004:00080000:2.0:1746126614.432994:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736347166686ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.433001:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2755, 88 off234392 00000004:00080000:2.0:1746126614.433004:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347176350ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.433009:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2641, 88 off224264 00000004:00080000:2.0:1746126614.433011:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736347184017ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.433018:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2756, 88 off234480 00000004:00080000:2.0:1746126614.433021:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347193695ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.433026:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2642, 88 off224352 00000004:00080000:2.0:1746126614.433029:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736347201953ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126614.433036:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2757, 88 off234568 00000004:00080000:2.0:1746126614.433039:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347211410ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.433045:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2758, 88 off234656 00000004:00080000:2.0:1746126614.433047:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736347219513ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126614.433052:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2643, 88 off224440 00000004:00080000:2.0:1746126614.433054:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736347226460ns, next at 687927188999ns, rc = 0 00000004:00010000:2.0:1746126614.463848:0:14547:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093494a80 reply state ffff88009ac83000 transno 8589943120 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746126614.463859:0:14547:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746126614.463957:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31281:x1830945721462272:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 37790us (38024us total) trans 8589943120 rc 0/0 00000100:00100000:2.0:1746126614.463964:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8935 00000001:00080000:1.0:1746126614.464109:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943108 is committed 00000001:00080000:1.0:1746126614.464123:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943083 is committed 00000001:00080000:1.0:1746126614.464129:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943117 is committed 00000001:00080000:1.0:1746126614.464135:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943113 is committed 00000001:00080000:1.0:1746126614.464182:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943120 is committed 00000004:00080000:1.0:1746126614.464185:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746126614.464190:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2140 committed 00000004:00080000:1.0:1746126614.464194:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2139 committed 00000004:00080000:1.0:1746126614.464196:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746126614.464197:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2138 committed 00000004:00080000:1.0:1746126614.464202:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746126614.464203:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2137 committed 00000004:00080000:1.0:1746126614.464205:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2025 committed 00000004:00080000:1.0:1746126614.464207:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2136 committed 00000004:00080000:1.0:1746126614.464208:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2024 committed 00000004:00080000:1.0:1746126614.464210:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2135 committed 00000004:00080000:1.0:1746126614.464211:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2134 committed 00000004:00080000:1.0:1746126614.464212:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2023 committed 00000004:00080000:1.0:1746126614.464214:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2022 committed 00000004:00080000:1.0:1746126614.464215:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2133 committed 00000004:00080000:1.0:1746126614.464216:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2132 committed 00000004:00080000:1.0:1746126614.464217:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2021 committed 00000001:00080000:1.0:1746126614.464224:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943116 is committed 00000100:00100000:1.0:1746126614.464382:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721368832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126614.464422:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126614.464730:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721369216:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746126614.465013:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.465020:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.465026:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.465030:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fda00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126614.465033:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.465039:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.465051:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.465053:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126614.465056:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126614.465060:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613830 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746126614.465088:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721368960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.465110:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721369088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126614.465292:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721369344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126614.465309:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126614.465325:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721369856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.465337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126614.465346:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721370368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.465357:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126614.465376:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368832 00000100:00100000:1.0:1746126614.465381:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368832 00000100:00100000:1.0:1746126614.465409:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369344 00000100:00100000:1.0:1746126614.465410:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369344 00000100:00100000:1.0:1746126614.465418:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369856 00000100:00100000:1.0:1746126614.465419:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369856 00000100:00100000:1.0:1746126614.465429:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370368 00000100:00100000:1.0:1746126614.465431:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370368 00000100:00100000:1.0:1746126614.465440:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13510 00000100:00100000:1.0:1746126614.465446:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3294:x1830945721368832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126614.465595:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3294:x1830945721368832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (1172us total) trans 21474840345 rc 0/0 00000100:00100000:1.0:1746126614.465600:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13510 00000100:00100000:1.0:1746126614.465611:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13511 00000100:00100000:1.0:1746126614.465615:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3294:x1830945721369344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126614.465690:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3294:x1830945721369344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (381us total) trans 21474840346 rc 0/0 00000100:00100000:1.0:1746126614.465695:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13511 00000100:00100000:1.0:1746126614.465703:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13512 00000100:00100000:1.0:1746126614.465707:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3294:x1830945721369856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.465797:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3294:x1830945721369856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (457us total) trans 17179873194 rc 0/0 00000100:00100000:1.0:1746126614.465801:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13512 00000100:00100000:1.0:1746126614.465809:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13513 00000100:00100000:1.0:1746126614.465813:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3294:x1830945721370368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126614.465926:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126614.465928:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126614.465930:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126614.465932:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126614.465933:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126614.465950:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3294:x1830945721370368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (592us total) trans 17179873195 rc 0/0 00000100:00100000:1.0:1746126614.465955:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13513 00000100:00100000:1.0:1746126614.466005:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873180 gen 2 00000004:00080000:1.0:1746126614.466009:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6d80, transno 17179873085 00000004:00080000:1.0:1746126614.466015:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6a00, transno 17179873086 00000004:00080000:1.0:1746126614.466018:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4380, transno 17179873087 00000004:00080000:1.0:1746126614.466020:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6680, transno 17179873088 00000004:00080000:1.0:1746126614.466021:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4000, transno 17179873089 00000004:00080000:1.0:1746126614.466023:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5500, transno 17179873090 00000004:00080000:1.0:1746126614.466025:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7800, transno 17179873091 00000004:00080000:1.0:1746126614.466026:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7100, transno 17179873092 00000004:00080000:1.0:1746126614.466028:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3f800, transno 17179873093 00000004:00080000:1.0:1746126614.466031:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15d180, transno 17179873101 00000004:00080000:1.0:1746126614.466033:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df6680, transno 17179873102 00000004:00080000:1.0:1746126614.466034:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fdc00, transno 17179873103 00000004:00080000:1.0:1746126614.466047:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15ce00, transno 17179873104 00000004:00080000:1.0:1746126614.466049:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fe300, transno 17179873105 00000004:00080000:1.0:1746126614.466051:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15c000, transno 17179873106 00000004:00080000:1.0:1746126614.466053:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df7b80, transno 17179873107 00000004:00080000:1.0:1746126614.466055:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15fb80, transno 17179873108 00000004:00080000:1.0:1746126614.466057:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df5500, transno 17179873109 00000004:00080000:1.0:1746126614.466059:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff480, transno 17179873113 00000004:00080000:1.0:1746126614.466061:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fd500, transno 17179873114 00000004:00080000:1.0:1746126614.466063:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fc380, transno 17179873115 00000004:00080000:1.0:1746126614.466065:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fca80, transno 17179873116 00000004:00080000:1.0:1746126614.466067:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fdf80, transno 17179873117 00000004:00080000:1.0:1746126614.466068:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff100, transno 17179873118 00000004:00080000:1.0:1746126614.466070:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fce00, transno 17179873119 00000004:00080000:1.0:1746126614.466072:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11ed80, transno 17179873120 00000004:00080000:1.0:1746126614.466074:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fed80, transno 17179873121 00000004:00080000:1.0:1746126614.466084:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8caa00, transno 17179873122 00000004:00080000:1.0:1746126614.466086:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dabb480, transno 17179873123 00000004:00080000:1.0:1746126614.466088:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8ca300, transno 17179873124 00000004:00080000:1.0:1746126614.466090:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c8000, transno 17179873125 00000004:00080000:1.0:1746126614.466092:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008daba680, transno 17179873126 00000004:00080000:1.0:1746126614.466095:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dab9f80, transno 17179873127 00000004:00080000:1.0:1746126614.466096:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8cb480, transno 17179873128 00000004:00080000:1.0:1746126614.466098:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dab8700, transno 17179873129 00000004:00080000:1.0:1746126614.466100:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2e680, transno 17179873130 00000004:00080000:1.0:1746126614.466102:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093230a80, transno 17179873135 00000004:00080000:1.0:1746126614.466104:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918ead80, transno 17179873136 00000004:00080000:1.0:1746126614.466106:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093232680, transno 17179873137 00000004:00080000:1.0:1746126614.466108:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8380, transno 17179873138 00000004:00080000:1.0:1746126614.466110:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093232a00, transno 17179873139 00000004:00080000:1.0:1746126614.466111:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093231c00, transno 17179873140 00000004:00080000:1.0:1746126614.466113:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e9180, transno 17179873141 00000004:00080000:1.0:1746126614.466115:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e9c00, transno 17179873142 00000004:00080000:1.0:1746126614.466116:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df7100, transno 17179873143 00000004:00080000:1.0:1746126614.466118:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b160000, transno 17179873144 00000004:00080000:1.0:1746126614.466120:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c9500, transno 17179873145 00000004:00080000:1.0:1746126614.466122:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c9880, transno 17179873146 00000004:00080000:1.0:1746126614.466124:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed4a680, transno 17179873147 00000004:00080000:1.0:1746126614.466126:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e721880, transno 17179873148 00000004:00080000:1.0:1746126614.466128:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b160e00, transno 17179873149 00000004:00080000:1.0:1746126614.466130:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c8e00, transno 17179873150 00000004:00080000:1.0:1746126614.466132:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c8380, transno 17179873151 00000004:00080000:1.0:1746126614.466134:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed49880, transno 17179873152 00000004:00080000:1.0:1746126614.466136:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02f800, transno 17179873160 00000004:00080000:1.0:1746126614.466138:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02ed80, transno 17179873161 00000004:00080000:1.0:1746126614.466141:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b191880, transno 17179873162 00000004:00080000:1.0:1746126614.466143:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02df80, transno 17179873163 00000004:00080000:1.0:1746126614.466144:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02ca80, transno 17179873164 00000004:00080000:1.0:1746126614.466146:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02f480, transno 17179873165 00000004:00080000:1.0:1746126614.466148:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093df4a80, transno 17179873166 00000004:00080000:1.0:1746126614.466150:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02c700, transno 17179873167 00000004:00080000:1.0:1746126614.466152:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093231500, transno 17179873168 00000004:00080000:1.0:1746126614.466154:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1f80, transno 17179873172 00000004:00080000:1.0:1746126614.466156:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135ed0000, transno 17179873173 00000004:00080000:1.0:1746126614.466158:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2300, transno 17179873174 00000004:00080000:1.0:1746126614.466160:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131d54700, transno 17179873175 00000004:00080000:1.0:1746126614.466161:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d4000, transno 17179873176 00000004:00080000:1.0:1746126614.466163:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e3800, transno 17179873177 00000004:00080000:1.0:1746126614.466165:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135ed2a00, transno 17179873178 00000004:00080000:1.0:1746126614.466167:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2a00, transno 17179873179 00000004:00080000:1.0:1746126614.466169:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131d57800, transno 17179873180 00000100:00100000:1.0:1746126614.466174:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009e9d7800 x1830945721369856/t17179873194(17179873194) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126630 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746126614.466181:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d7800/2, rc 0, transno 17179873194 00000100:00100000:1.0:1746126614.466185:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721369856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126614.466195:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d6680/2, rc 0, transno 17179873195 00000100:00100000:1.0:1746126614.466198:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721370368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.466204:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840335 gen 2 00000004:00080000:1.0:1746126614.466206:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d9ad80, transno 21474840254 00000004:00080000:1.0:1746126614.466211:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98a80, transno 21474840255 00000004:00080000:1.0:1746126614.466213:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98000, transno 21474840256 00000004:00080000:1.0:1746126614.466215:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d9b100, transno 21474840257 00000004:00080000:1.0:1746126614.466217:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d98e00, transno 21474840258 00000004:00080000:1.0:1746126614.466218:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99880, transno 21474840259 00000004:00080000:1.0:1746126614.466220:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99180, transno 21474840260 00000004:00080000:1.0:1746126614.466221:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99500, transno 21474840261 00000004:00080000:1.0:1746126614.466223:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092209f80, transno 21474840265 00000004:00080000:1.0:1746126614.466225:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092208a80, transno 21474840266 00000004:00080000:1.0:1746126614.466227:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad3100, transno 21474840267 00000004:00080000:1.0:1746126614.466229:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009220a300, transno 21474840268 00000004:00080000:1.0:1746126614.466231:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009220aa00, transno 21474840269 00000004:00080000:1.0:1746126614.466232:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092208380, transno 21474840270 00000004:00080000:1.0:1746126614.466234:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad3480, transno 21474840271 00000004:00080000:1.0:1746126614.466235:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009220bb80, transno 21474840272 00000004:00080000:1.0:1746126614.466238:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f256d80, transno 21474840273 00000004:00080000:1.0:1746126614.466239:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f255c00, transno 21474840274 00000004:00080000:1.0:1746126614.466241:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f255180, transno 21474840275 00000004:00080000:1.0:1746126614.466243:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f255500, transno 21474840276 00000004:00080000:1.0:1746126614.466244:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f254a80, transno 21474840277 00000004:00080000:1.0:1746126614.466246:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f255f80, transno 21474840278 00000004:00080000:1.0:1746126614.466247:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f254000, transno 21474840279 00000004:00080000:1.0:1746126614.466249:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15d500, transno 21474840280 00000004:00080000:1.0:1746126614.466251:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11fb80, transno 21474840288 00000004:00080000:1.0:1746126614.466252:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11c380, transno 21474840289 00000004:00080000:1.0:1746126614.466254:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11c000, transno 21474840290 00000004:00080000:1.0:1746126614.466256:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11e300, transno 21474840291 00000004:00080000:1.0:1746126614.466258:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11f800, transno 21474840292 00000004:00080000:1.0:1746126614.466260:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11ca80, transno 21474840293 00000004:00080000:1.0:1746126614.466262:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad0a80, transno 21474840294 00000004:00080000:1.0:1746126614.466263:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11d880, transno 21474840295 00000004:00080000:1.0:1746126614.466265:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b69f80, transno 21474840296 00000004:00080000:1.0:1746126614.466267:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b68a80, transno 21474840297 00000004:00080000:1.0:1746126614.466269:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b6bb80, transno 21474840298 00000004:00080000:1.0:1746126614.466271:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b6a300, transno 21474840299 00000004:00080000:1.0:1746126614.466273:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b69500, transno 21474840300 00000004:00080000:1.0:1746126614.466275:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b6aa00, transno 21474840301 00000004:00080000:1.0:1746126614.466277:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b69180, transno 21474840302 00000004:00080000:1.0:1746126614.466279:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937b9f80, transno 21474840303 00000004:00080000:1.0:1746126614.466281:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af7b80, transno 21474840317 00000004:00080000:1.0:1746126614.466283:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af6680, transno 21474840318 00000004:00080000:1.0:1746126614.466285:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af6300, transno 21474840319 00000004:00080000:1.0:1746126614.466287:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d9aa00, transno 21474840320 00000004:00080000:1.0:1746126614.466289:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af5180, transno 21474840321 00000004:00080000:1.0:1746126614.466290:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af5500, transno 21474840322 00000004:00080000:1.0:1746126614.466292:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af6d80, transno 21474840323 00000004:00080000:1.0:1746126614.466294:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098d99f80, transno 21474840324 00000004:00080000:1.0:1746126614.466296:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5955180, transno 21474840328 00000004:00080000:1.0:1746126614.466298:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5954e00, transno 21474840329 00000004:00080000:1.0:1746126614.466299:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f57800, transno 21474840330 00000004:00080000:1.0:1746126614.466301:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b162d80, transno 21474840331 00000004:00080000:1.0:1746126614.466303:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5955f80, transno 21474840332 00000004:00080000:1.0:1746126614.466304:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5956300, transno 21474840333 00000004:00080000:1.0:1746126614.466306:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5957b80, transno 21474840334 00000004:00080000:1.0:1746126614.466308:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5954700, transno 21474840335 00000100:00100000:1.0:1746126614.466311:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880092ad1c00 x1830945721368832/t21474840345(21474840345) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126630 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746126614.466315:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad1c00/2, rc 0, transno 21474840345 00000100:00100000:1.0:1746126614.466318:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721368832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126614.466326:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcce00/2, rc 0, transno 21474840346 00000100:00100000:1.0:1746126614.466329:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721369344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126614.466583:0:14592:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 6 in flight, 56 done 00000004:00080000:1.0:1746126614.466858:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 72 done 00000100:00100000:1.0:1746126614.466888:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721370880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.466909:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126614.466943:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370880 00000100:00100000:1.0:1746126614.466947:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370880 00000100:00100000:1.0:1746126614.466961:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13514 00000100:00100000:1.0:1746126614.466966:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1830945721370880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.467062:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3294:x1830945721370880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (151us total) trans 17179873196 rc 0/0 00000100:00100000:1.0:1746126614.467066:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13514 00000004:00080000:1.0:1746126614.467098:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8d500/2, rc 0, transno 17179873196 00000100:00100000:1.0:1746126614.467101:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721370880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126614.468242:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126614.468271:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721369600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.468293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126614.468303:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721370112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126614.468316:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126614.468336:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721370624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126614.468354:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126614.468377:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369088 00000100:00100000:2.0:1746126614.468381:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369088 00000100:00100000:2.0:1746126614.468397:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369600 00000100:00100000:2.0:1746126614.468399:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369600 00000100:00100000:2.0:1746126614.468405:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370112 00000100:00100000:2.0:1746126614.468406:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370112 00000100:00100000:2.0:1746126614.468415:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370624 00000100:00100000:2.0:1746126614.468416:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370624 00000100:00100000:2.0:1746126614.468429:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13515 00000100:00100000:2.0:1746126614.468434:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3296:x1830945721369088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.468560:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721369088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (320us total) trans 21474840347 rc 0/0 00000100:00100000:2.0:1746126614.468565:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13515 00000100:00100000:2.0:1746126614.468576:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13516 00000100:00100000:2.0:1746126614.468580:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3296:x1830945721369600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.468679:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721369600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (384us total) trans 21474840348 rc 0/0 00000100:00100000:2.0:1746126614.468684:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13516 00000100:00100000:2.0:1746126614.468692:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13517 00000100:00100000:2.0:1746126614.468696:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721370112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126614.468782:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3296:x1830945721370112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (465us total) trans 17179873197 rc 0/0 00000100:00100000:2.0:1746126614.468787:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13517 00000100:00100000:2.0:1746126614.468797:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13518 00000100:00100000:2.0:1746126614.468800:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721370624:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746126614.468864:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746126614.468868:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126614.468882:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126614.468900:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3296:x1830945721370624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (544us total) trans 17179873198 rc 0/0 00000100:00100000:2.0:1746126614.468905:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13518 00000100:00100000:3.0:1746126614.468906:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721369728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.468912:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369216 00000100:00100000:2.0:1746126614.468915:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369216 00000100:00100000:2.0:1746126614.468926:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13519 00000100:00100000:2.0:1746126614.468930:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3297:x1830945721369216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126614.468974:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126614.468988:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721370240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126614.469001:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126614.469008:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721370752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126614.469022:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126614.469024:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3297:x1830945721369216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (141us total) trans 21474840349 rc 0/0 00000100:00100000:2.0:1746126614.469029:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13519 00000100:00100000:2.0:1746126614.469036:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369728 00000100:00100000:2.0:1746126614.469038:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369728 00000004:00080000:3.0:1746126614.469045:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3a5880/2, rc 0, transno 21474840349 00000100:00100000:2.0:1746126614.469046:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370240 00000100:00100000:2.0:1746126614.469048:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370240 00000100:00100000:3.0:1746126614.469049:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721369216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.469053:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370752 00000100:00100000:2.0:1746126614.469055:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370752 00000100:00100000:2.0:1746126614.469062:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13520 00000100:00100000:3.0:1746126614.469066:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13521 00000100:00100000:2.0:1746126614.469067:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3297:x1830945721369728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126614.469154:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3297:x1830945721369728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (179us total) trans 21474840350 rc 0/0 00000100:00100000:2.0:1746126614.469159:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13520 00000100:00100000:2.0:1746126614.469167:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13522 00000100:00100000:2.0:1746126614.469171:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3297:x1830945721370752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126614.469235:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721370752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (211us total) trans 17179873199 rc 0/0 00000100:00100000:2.0:1746126614.469239:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13522 00000004:00080000:2.0:1746126614.469256:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad1f80/2, rc 0, transno 21474840347 00000100:00100000:2.0:1746126614.469259:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721369088:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126614.469265:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8c000/2, rc 0, transno 21474840348 00000100:00100000:2.0:1746126614.469267:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721369600:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126614.469273:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d5c00/2, rc 0, transno 17179873197 00000100:00100000:2.0:1746126614.469275:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721370112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126614.469279:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204f100/2, rc 0, transno 17179873198 00000100:00100000:2.0:1746126614.469281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721370624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126614.469353:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3297:x1830945721370240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126614.469480:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721370240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 408us (477us total) trans 17179873200 rc 0/0 00000100:00100000:3.0:1746126614.469486:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13521 00000100:00100000:3.0:1746126614.469502:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126614.469517:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721369472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126614.469532:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126614.469541:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721369984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126614.469553:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126614.469562:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721370496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126614.469574:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746126614.469597:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8c380/2, rc 0, transno 21474840350 00000100:00100000:3.0:1746126614.469601:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721369728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126614.469607:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d5880/2, rc 0, transno 17179873200 00000100:00100000:3.0:1746126614.469609:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721370240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126614.469615:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8cb800/2, rc 0, transno 17179873199 00000100:00100000:3.0:1746126614.469617:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721370752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126614.469806:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721368960 00000100:00100000:0.0:1746126614.469810:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721368960 00000100:00100000:0.0:1746126614.469822:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369472 00000100:00100000:0.0:1746126614.469824:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369472 00000100:00100000:0.0:1746126614.469865:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721369984 00000100:00100000:0.0:1746126614.469867:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721369984 00000100:00100000:0.0:1746126614.469873:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721370496 00000100:00100000:0.0:1746126614.469875:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721370496 00000100:00100000:0.0:1746126614.469882:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13523 00000100:00100000:0.0:1746126614.469888:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721368960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126614.469979:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721368960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (476us total) trans 21474840351 rc 0/0 00000100:00100000:0.0:1746126614.469984:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13523 00000100:00100000:0.0:1746126614.469993:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13524 00000100:00100000:0.0:1746126614.469996:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721369472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126614.470070:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721369472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (536us total) trans 21474840352 rc 0/0 00000100:00100000:0.0:1746126614.470074:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13524 00000100:00100000:0.0:1746126614.470091:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13525 00000100:00100000:0.0:1746126614.470096:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721369984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126614.470171:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721369984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (616us total) trans 17179873201 rc 0/0 00000100:00100000:0.0:1746126614.470175:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13525 00000100:00100000:0.0:1746126614.470183:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13526 00000100:00100000:0.0:1746126614.470188:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721370496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126614.470258:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721370496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (682us total) trans 17179873202 rc 0/0 00000100:00100000:0.0:1746126614.470262:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13526 00000004:00080000:3.0:1746126614.470332:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad0000/2, rc 0, transno 21474840351 00000100:00100000:3.0:1746126614.470336:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721368960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126614.470342:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcd880/2, rc 0, transno 21474840352 00000100:00100000:3.0:1746126614.470344:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721369472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126614.470350:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d4380/2, rc 0, transno 17179873201 00000100:00100000:3.0:1746126614.470353:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721369984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126614.470358:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204d500/2, rc 0, transno 17179873202 00000100:00100000:3.0:1746126614.470360:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721370496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126614.470657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.471912:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721462912 00000100:00100000:2.0:1746126614.471919:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721462912 00000100:00100000:2.0:1746126614.471958:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8936 00000100:00100000:2.0:1746126614.471964:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31281:x1830945721462912:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.471979:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.471993:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc00 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.472041:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.472053:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.472067:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.472070:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126614.472072:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092daec00, rc 0) 00000100:00100000:2.0:1746126614.472123:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31281:x1830945721462912:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 159us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.472129:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8936 00000100:00100000:1.0:1746126614.476510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126614.476630:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463040 00000100:00100000:2.0:1746126614.476637:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463040 00000100:00100000:2.0:1746126614.476672:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8937 00000100:00100000:2.0:1746126614.476678:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31281:x1830945721463040:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126614.476692:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.476706:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e82586761383e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc07 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.476762:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126614.476771:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126614.476779:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126614.476795:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126614.476798:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126614.476808:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126614.476823:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1200/0xb50e82586761383e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.476852:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.476857:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126614.476860:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126614.476862:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba1000, rc 0) 00000100:00100000:2.0:1746126614.476894:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31281:x1830945721463040:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 217us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126614.476899:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8937 00000100:00100000:0.0:1746126614.484798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.484863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.484883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.484903:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463168 00000100:00100000:0.0:1746126614.484903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.484915:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463168 00000100:00100000:0.0:1746126614.484917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126614.484939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126614.484960:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463424 00000100:00100000:1.0:1746126614.484963:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463424 00000100:00100000:3.0:1746126614.484997:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463680 00000100:00100000:2.0:1746126614.484999:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463296 00000100:00100000:3.0:1746126614.485001:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463680 00000100:00100000:2.0:1746126614.485002:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463296 00000100:00100000:2.0:1746126614.485021:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463552 00000100:00100000:2.0:1746126614.485023:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463552 00000100:00100000:3.0:1746126614.485147:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721463808 00000100:00100000:3.0:1746126614.485150:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721463808 00000100:00100000:2.0:1746126614.485154:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13527 00000100:00100000:2.0:1746126614.485161:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721463168:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:3.0:1746126614.485165:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13528 00000100:00100000:3.0:1746126614.485169:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721463296:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126614.485175:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126614.485175:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.485190:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc15 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126614.485190:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc0e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126614.485208:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x821 00002000:00010000:2.0:1746126614.485208:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x7a1 00010000:00010000:3.0:1746126614.485221:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.485221:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.485223:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126614.485223:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.485229:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.485229:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.485241:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126614.485241:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.485249:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099079200, rc 0) 00010000:00010000:2.0:1746126614.485249:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba1200, rc 0) 00000100:00100000:3.0:1746126614.485294:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721463296:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.485299:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13528 00000100:00100000:3.0:1746126614.485312:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13529 00000100:00100000:3.0:1746126614.485316:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721463680:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126614.485321:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.485328:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc2a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126614.485338:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c714, atime: 0x6813c715, ctime: 0x6813c714, blocks: 0x163d 00010000:00010000:3.0:1746126614.485347:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.485349:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.485352:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.485361:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.485367:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad6a800, rc 0) 00000100:00100000:3.0:1746126614.485381:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721463680:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 65us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.485386:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13529 00000100:00100000:3.0:1746126614.485399:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13530 00000100:00100000:3.0:1746126614.485404:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721463552:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:1.0:1746126614.485404:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13531 00010000:00010000:3.0:1746126614.485409:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126614.485409:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721463424:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126614.485414:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.485416:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc23 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126614.485420:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc1c expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126614.485424:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x821 00002000:00010000:1.0:1746126614.485428:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x821 00010000:00010000:3.0:1746126614.485430:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.485431:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.485433:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.485434:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.485435:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126614.485438:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.485442:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126614.485445:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.485453:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad6ae00, rc 0) 00010000:00010000:1.0:1746126614.485455:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44e00, rc 0) 00000100:00100000:3.0:1746126614.485466:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721463552:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 63us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.485466:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721463424:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 58us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126614.485471:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13531 00000100:00100000:2.0:1746126614.485526:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721463168:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 365us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.486302:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13530 00000100:00100000:3.0:1746126614.486314:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13532 00000100:00100000:3.0:1746126614.486319:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721463808:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126614.486327:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126614.486335:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc31 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126614.486344:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x1029 00010000:00010000:3.0:1746126614.486351:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.486353:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126614.486356:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.486364:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126614.486370:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad6bc00, rc 0) 00000100:00100000:3.0:1746126614.486387:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721463808:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 69us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126614.486392:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13532 00000100:00100000:2.0:1746126614.487006:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13527 00010000:00010000:0.0:1746126614.821226:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126615.109041:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1830945721371264:0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109118:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.109167:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746126615.109172:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1830945721371136:0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109190:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.109201:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830945721371648:0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109214:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.109240:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371264 00000100:00100000:1.0:1746126615.109245:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371264 00000100:00080000:1.0:1746126615.109261:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126615.109292:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371136 00000100:00100000:1.0:1746126615.109294:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371136 00000100:00100000:1.0:1746126615.109310:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371648 00000100:00100000:1.0:1746126615.109311:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371648 00000100:00100000:1.0:1746126615.109319:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746126615.109324:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830945721371264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109356:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830945721371264:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.109361:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746126615.109373:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1746126615.109377:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830945721371136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109393:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830945721371136:12345-0@lo:400:kworker.0 Request processed in 16us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.109397:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1746126615.109404:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1746126615.109408:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830945721371648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109421:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830945721371648:12345-0@lo:400:kworker.0 Request processed in 13us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.109425:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1746126615.109436:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126615.109454:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1830945721371136:0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109461:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830945721371648:0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.109467:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1830945721371264:0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109595:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721371392:0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126615.109648:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126615.109652:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721371008:0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126615.109691:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721371520:0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126615.109726:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371392 00000100:00100000:0.0:1746126615.109729:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371392 00000100:00100000:0.0:1746126615.109747:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371520 00000100:00100000:0.0:1746126615.109748:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371520 00000100:00100000:0.0:1746126615.109759:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1746126615.109763:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830945721371392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109785:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830945721371392:12345-0@lo:400:kworker.0 Request processed in 22us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.109789:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1746126615.109797:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1746126615.109800:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830945721371520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109817:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830945721371520:12345-0@lo:400:kworker.0 Request processed in 16us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.109820:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1746126615.109864:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721371520:0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.109871:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721371392:0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.110051:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371008 00000100:00100000:1.0:1746126615.110054:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371008 00000100:00100000:1.0:1746126615.110079:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746126615.110084:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3294:x1830945721371008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126615.110107:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3294:x1830945721371008:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.110112:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1746126615.111401:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721371008:0@lo:400:kworker.0 00000100:00100000:0.0:1746126615.140998:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721371776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746126615.141056:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126615.141110:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371776 00000100:00100000:0.0:1746126615.141115:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371776 00000100:00100000:0.0:1746126615.141144:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1746126615.141149:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721371776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746126615.141178:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 549126144 pending 11927552 free 3847225344 avail 3845128192 00000100:00100000:0.0:1746126615.141206:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721371776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.141211:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1746126615.141360:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746126615.141368:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721371904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746126615.141393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.141636:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721371904 00000100:00100000:1.0:1746126615.141639:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721371904 00000100:00100000:1.0:1746126615.141657:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1746126615.141662:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721371904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746126615.141671:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 574554112 pending 18743296 free 3849322496 avail 3847225344 00000100:00100000:1.0:1746126615.141699:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830945721371904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.141704:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1746126615.145707:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721371776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746126615.145810:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721371904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746126615.503744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.504514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.504635:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464064 00000100:00100000:2.0:1746126615.504642:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464064 00000100:00100000:0.0:1746126615.505312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.505336:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464320 00000100:00100000:0.0:1746126615.505340:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464320 00000100:00100000:3.0:1746126615.505354:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464576 00000100:00100000:3.0:1746126615.505358:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464576 00000100:00100000:3.0:1746126615.505482:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7721 00000100:00100000:3.0:1746126615.505490:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721464576:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:3.0:1746126615.505519:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.505531:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.505533:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.505537:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.505550:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126615.506188:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7722 00000100:00100000:2.0:1746126615.506195:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721464064:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:2.0:1746126615.506211:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.506220:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126615.506221:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126615.506224:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.506233:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126615.506280:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7723 00000100:00100000:0.0:1746126615.506287:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721464320:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126615.506302:0:15641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.506310:0:15641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.506312:0:15641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.506314:0:15641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.506322:0:15641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746126615.507329:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746126615.507334:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126615.508105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.508136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.508219:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464832 00000100:00100000:2.0:1746126615.508227:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464832 00000100:00100000:2.0:1746126615.508272:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465088 00000100:00100000:2.0:1746126615.508275:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465088 00000100:00100000:2.0:1746126615.508292:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7724 00000100:00100000:2.0:1746126615.508307:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721464832:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:2.0:1746126615.508338:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.508348:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126615.508350:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126615.508354:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.508363:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.508372:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7725 00000100:00100000:3.0:1746126615.508378:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721465088:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:3.0:1746126615.508394:0:21464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.508400:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.508401:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.508404:0:21464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.508411:0:21464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126615.509393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.509416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.509429:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465600 00000100:00100000:0.0:1746126615.509433:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465600 00000100:00100000:0.0:1746126615.509455:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465728 00000100:00100000:0.0:1746126615.509457:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465728 00000100:00100000:0.0:1746126615.509469:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7726 00000100:00100000:0.0:1746126615.509474:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721465600:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126615.509491:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.509499:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.509500:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.509503:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.509511:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126615.510455:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7727 00000100:00100000:0.0:1746126615.510464:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721465728:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126615.510482:0:21461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.510490:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.510491:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.510495:0:21461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.510502:0:21461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126615.518254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.519030:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465472 00000100:00100000:0.0:1746126615.519038:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465472 00000100:00100000:0.0:1746126615.520244:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7728 00000100:00100000:0.0:1746126615.520254:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721465472:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126615.520284:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.520295:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.520297:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.520302:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.520312:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537629:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537644:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537652:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537658:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ba2000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126615.537662:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537668:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537683:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.537688:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba2000/0xb50e825867613876 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.539251:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721464576:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 33756us (33934us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.539261:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7721 00010000:00010000:3.0:1746126615.546987:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.547002:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.547009:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.547014:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ba0a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126615.547017:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.547023:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.547037:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.547042:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba0a00/0xb50e82586761387d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.547942:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721464064:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 41743us (44201us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.547951:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7722 00010000:00010000:2.0:1746126615.551905:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.551920:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.551929:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.551935:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126615.551938:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.551945:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.551959:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.551965:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093962c00/0xb50e825867613899 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126615.554770:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1963:x1830945721465600:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 45288us (45371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.554780:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7726 00010000:00010000:3.0:1746126615.569205:0:21464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.569219:0:21464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.569232:0:21464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.569238:0:21464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb57400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126615.569242:0:21464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.569249:0:21464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.569263:0:21464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.569268:0:21464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e825867613892 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.569526:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721465088:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 61143us (61383us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.569534:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7725 00010000:00010000:1.0:1746126615.580979:0:15641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.580992:0:15641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.581000:0:15641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.581005:0:15641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093962400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126615.581008:0:15641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.581014:0:15641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.581028:0:15641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.581034:0:15641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093962400/0xb50e825867613884 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126615.581119:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721464320:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 74829us (76602us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.581131:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7723 00010000:00010000:3.0:1746126615.582029:0:21462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.582038:0:21462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.582043:0:21462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.582049:0:21462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45cae00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126615.582051:0:21462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.582057:0:21462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.582075:0:21462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.582081:0:21462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a45cae00/0xb50e82586761388b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.582119:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721464832:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 73812us (74016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.582124:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7724 00010000:00010000:3.0:1746126615.599168:0:21461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.599182:0:21461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.599189:0:21461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.599194:0:21461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093963a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126615.599199:0:21461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.599206:0:21461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.599220:0:21461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.599225:0:21461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093963a00/0xb50e8258676138a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.599318:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721465728:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 88851us (89896us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.599326:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7727 00010000:00010000:2.0:1746126615.604042:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.604056:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.604063:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.604077:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57cd400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126615.604081:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.604087:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.604101:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.604106:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57cd400/0xb50e8258676138a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126615.604182:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721465472:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 83928us (85932us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.604190:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7728 00000100:00100000:0.0:1746126615.614998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.615173:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465984 00000100:00100000:1.0:1746126615.615181:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465984 00000100:00100000:1.0:1746126615.615236:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 701 00000100:00100000:1.0:1746126615.615243:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31281:x1830945721465984:12345-192.168.203.2@tcp:103:mirror_io.0 00010000:00010000:1.0:1746126615.615254:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126615.615275:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bcb000/0xb50e8258676137f1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dbf2 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.615302:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.615305:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126615.615348:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31281:x1830945721465984:12345-192.168.203.2@tcp:103:mirror_io.0 Request processed in 105us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.615354:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 701 00000100:00100000:0.0:1746126615.618192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.618250:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466240 00000100:00100000:2.0:1746126615.618256:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466240 00000100:00100000:2.0:1746126615.618299:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3779 00000100:00100000:2.0:1746126615.618306:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31281:x1830945721466240:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:2.0:1746126615.618486:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31281:x1830945721466240:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 180us (299us total) trans 8589943121 rc 0/0 00000100:00100000:2.0:1746126615.618492:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3779 00000100:00100000:0.0:1746126615.621533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.621651:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466496 00000100:00100000:2.0:1746126615.621658:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466496 00000100:00100000:2.0:1746126615.622206:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3780 00000100:00100000:2.0:1746126615.622214:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31281:x1830945721466496:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:2.0:1746126615.622367:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31281:x1830945721466496:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 154us (840us total) trans 8589943122 rc 0/0 00000100:00100000:2.0:1746126615.622373:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3780 00000100:00100000:0.0:1746126615.652561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.652785:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466752 00000100:00100000:1.0:1746126615.652792:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466752 00000100:00100000:1.0:1746126615.652854:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8938 00000100:00100000:1.0:1746126615.652860:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31294:x1830945721466752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126615.652878:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126615.652892:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc38 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.652964:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.652974:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.652986:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.652995:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653000:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653005:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653108:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653115:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653121:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126615.653128:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126615.653187:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653192:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653197:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653202:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace44c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126615.653205:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653212:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653220:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126615.653223:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126615.653226:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.653230:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654387:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654395:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654401:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654405:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace45800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126615.654407:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654412:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654420:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215a00) 00010000:00010000:1.0:1746126615.654422:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126615.654424:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654429:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.654466:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.654475:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.654481:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.654483:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126615.654485:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44200, rc 0) 00000100:00100000:1.0:1746126615.655726:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31294:x1830945721466752:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2862us (3169us total) trans 8589943123 rc 0/0 00000100:00100000:1.0:1746126615.655734:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8938 00000100:00100000:0.0:1746126615.659712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.659781:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467136 00000100:00100000:1.0:1746126615.659788:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467136 00000100:00100000:1.0:1746126615.659897:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3781 00000100:00100000:1.0:1746126615.659905:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31294:x1830945721467136:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126615.661012:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31294:x1830945721467136:12345-192.168.203.2@tcp:35:cat.0 Request processed in 1105us (1303us total) trans 8589943124 rc 0/0 00000100:00100000:1.0:1746126615.661018:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3781 00000100:00100000:0.0:1746126615.661811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.662017:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467264 00000100:00100000:1.0:1746126615.662022:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467264 00000100:00100000:1.0:1746126615.662316:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8939 00000100:00100000:1.0:1746126615.662322:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+221:31292:x1830945721467264:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126615.662338:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126615.662352:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e8258676138d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc3f expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.662435:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662445:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662453:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662462:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662468:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662473:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662555:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662561:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662566:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126615.662573:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126615.662628:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662634:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662643:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662647:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace44400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126615.662649:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662655:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662663:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126615.662665:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126615.662667:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662671:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44400/0xb50e8258676138d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662680:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662683:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662687:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662689:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace45800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126615.662691:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662695:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662703:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215400) 00010000:00010000:1.0:1746126615.662704:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126615.662706:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662709:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45800/0xb50e8258676138df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.662735:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e8258676138d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.662742:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.662747:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.662749:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126615.662750:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44c00, rc 0) 00000100:00100000:1.0:1746126615.662795:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31292:x1830945721467264:12345-192.168.203.2@tcp:101:cat.0 Request processed in 473us (985us total) trans 8589943125 rc 0/0 00000100:00100000:1.0:1746126615.662800:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8939 00000100:00100000:0.0:1746126615.663256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.663330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.663345:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467520 00000100:00100000:0.0:1746126615.663349:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467520 00000100:00100000:0.0:1746126615.663367:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467776 00000100:00100000:0.0:1746126615.663369:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467776 00000100:00100000:0.0:1746126615.663380:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13533 00000100:00100000:0.0:1746126615.663385:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721467520:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.663392:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.663401:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc4d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.663413:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663415:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663421:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663430:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663436:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5102800, rc 0) 00000100:00100000:0.0:1746126615.663455:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721467520:12345-192.168.203.2@tcp:101:cat.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.663459:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13533 00000100:00100000:0.0:1746126615.663469:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13534 00000100:00100000:0.0:1746126615.663473:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721467776:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.663478:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.663484:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc5b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.663493:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663494:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663498:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663504:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663510:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5103400, rc 0) 00000100:00100000:0.0:1746126615.663521:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721467776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.663526:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13534 00000100:00100000:0.0:1746126615.663553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.663575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.663585:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468032 00000100:00100000:0.0:1746126615.663587:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468032 00000100:00100000:0.0:1746126615.663597:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467392 00000100:00100000:0.0:1746126615.663599:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467392 00000100:00100000:0.0:1746126615.663608:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13535 00000100:00100000:0.0:1746126615.663612:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721468032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.663618:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.663624:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc69 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.663633:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663635:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663639:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663647:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663653:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5102400, rc 0) 00000100:00100000:0.0:1746126615.663665:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721468032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.663669:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13535 00000100:00100000:0.0:1746126615.663676:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13536 00000100:00100000:0.0:1746126615.663680:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721467392:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.663684:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.663689:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc46 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.663697:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663698:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663701:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663709:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663720:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5102200, rc 0) 00000100:00100000:0.0:1746126615.663735:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721467392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.663740:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13536 00000100:00100000:0.0:1746126615.663765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.663789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.663798:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467648 00000100:00100000:0.0:1746126615.663800:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467648 00000100:00100000:0.0:1746126615.663810:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467904 00000100:00100000:0.0:1746126615.663811:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467904 00000100:00100000:0.0:1746126615.663851:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13537 00000100:00100000:0.0:1746126615.663856:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721467648:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.663861:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.663868:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc54 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.663876:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663878:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663881:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663887:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663893:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eae9400, rc 0) 00000100:00100000:0.0:1746126615.663906:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721467648:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.663910:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13537 00000100:00100000:0.0:1746126615.663919:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13538 00000100:00100000:0.0:1746126615.663923:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721467904:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.663927:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.663933:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc62 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.663940:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663941:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.663944:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663951:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.663956:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eae8200, rc 0) 00000100:00100000:0.0:1746126615.663968:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721467904:12345-192.168.203.2@tcp:101:cat.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.663972:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13538 00000100:00100000:2.0:1746126615.671344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.671426:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468288 00000100:00100000:1.0:1746126615.671434:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468288 00000100:00100000:1.0:1746126615.671468:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3782 00000100:00100000:1.0:1746126615.671474:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d993050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31292:x1830945721468288:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126615.671676:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d993050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31292:x1830945721468288:12345-192.168.203.2@tcp:35:cat.0 Request processed in 201us (338us total) trans 8589943126 rc 0/0 00000100:00100000:1.0:1746126615.671682:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3782 00000100:00100000:0.0:1746126615.676472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.678295:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468544 00000100:00100000:2.0:1746126615.678304:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468544 00000100:00100000:2.0:1746126615.678349:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8940 00000100:00100000:2.0:1746126615.678355:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31293:x1830945721468544:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126615.678371:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126615.678386:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cae00/0xb50e82586761391e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc70 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.678449:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126615.678460:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.678465:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.678471:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.678476:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126615.678501:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.678510:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 223 pid: 14548 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746126615.678520:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e806300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721372032:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126615.680507:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.680519:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 11 pid: 14548 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746126615.680528:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721372160:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126615.680573:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.680579:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 9 pid: 14549 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746126615.680586:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721372288:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126615.680599:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126615.685403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.685474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.685545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.685571:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468928 00000100:00100000:2.0:1746126615.685578:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468928 00000100:00100000:1.0:1746126615.685659:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468800 00000100:00100000:1.0:1746126615.685663:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468800 00000100:00100000:1.0:1746126615.685696:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8941 00000100:00100000:1.0:1746126615.685703:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31288:x1830945721468800:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126615.685721:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126615.685734:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45200/0xb50e82586761392c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc77 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.685806:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.685818:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.685824:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126615.687471:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469056 00000100:00100000:2.0:1746126615.687478:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469056 00000100:00100000:3.0:1746126615.687911:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13539 00000100:00100000:3.0:1746126615.687921:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721468928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126615.687933:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126615.687945:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc7e expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.687961:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.687963:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.687970:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.687982:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.687996:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb56c00, rc 0) 00000100:00100000:3.0:1746126615.688038:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721468928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 120us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.688043:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13539 00000100:00100000:3.0:1746126615.688056:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13540 00000100:00100000:3.0:1746126615.688060:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721469056:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126615.688065:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126615.688081:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc85 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.688090:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.688091:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.688095:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 30 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.688102:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 30 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.688108:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb56600, rc 0) 00000100:00100000:3.0:1746126615.688119:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721469056:12345-192.168.203.2@tcp:101:cat.0 Request processed in 59us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.688123:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13540 00000100:00100000:0.0:1746126615.689874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.689953:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469184 00000100:00100000:3.0:1746126615.689958:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469184 00000100:00100000:0.0:1746126615.690105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.690268:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e806300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721372032:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126615.690438:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469312 00000100:00100000:3.0:1746126615.690442:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469312 00000100:00100000:3.0:1746126615.690462:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13541 00000100:00100000:3.0:1746126615.690467:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721469184:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126615.690478:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126615.690490:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc8c expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.690506:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.690507:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.690512:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.690523:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.690530:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac14c00, rc 0) 00000100:00100000:3.0:1746126615.690557:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721469184:12345-192.168.203.2@tcp:101:cat.0 Request processed in 91us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.690562:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13541 00000100:00100000:3.0:1746126615.690573:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13542 00000100:00100000:3.0:1746126615.690577:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721469312:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126615.690583:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126615.690591:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc93 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.690600:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.690601:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.690605:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 19 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.690613:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 19 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.690619:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb57400, rc 0) 00000100:00100000:3.0:1746126615.690634:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721469312:12345-192.168.203.2@tcp:101:cat.0 Request processed in 57us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.690638:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13542 00000100:00100000:0.0:1746126615.691079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.691091:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469440 00000100:00100000:0.0:1746126615.691093:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469440 00000100:00100000:0.0:1746126615.691108:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13543 00000100:00100000:0.0:1746126615.691113:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721469440:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.691119:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.691125:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dc9a expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.691134:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.691135:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.691139:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.691147:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.691154:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eae8000, rc 0) 00000100:00100000:0.0:1746126615.691168:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721469440:12345-192.168.203.2@tcp:101:cat.0 Request processed in 55us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.691173:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13543 00000100:00100000:0.0:1746126615.691217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.691230:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469568 00000100:00100000:0.0:1746126615.691232:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469568 00000100:00100000:0.0:1746126615.691245:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13544 00000100:00100000:0.0:1746126615.691249:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721469568:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.691255:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.691261:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dca1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.691270:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.691271:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126615.691275:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.691283:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126615.691289:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5102600, rc 0) 00000100:00100000:0.0:1746126615.691302:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721469568:12345-192.168.203.2@tcp:101:cat.0 Request processed in 53us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126615.691306:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13544 00000100:00100000:0.0:1746126615.691382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.691398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.691410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.691437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.691451:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721470208 00000100:00100000:0.0:1746126615.691454:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721470208 00002000:00100000:0.0:1746126615.691476:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009f11c380 x1830945721470208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126615.691484:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c380 with x1830945721470208 ext(0->1048575) 00002000:00010000:0.0:1746126615.691488:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11c380 00000100:00100000:0.0:1746126615.691500:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7729 00000100:00100000:0.0:1746126615.691505:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721470208:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.693380:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469824 00000100:00100000:3.0:1746126615.693388:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469824 00010000:00010000:3.0:1746126615.693411:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 12 pid: 14548 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126615.693432:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469696 00000100:00100000:3.0:1746126615.693434:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469696 00010000:00010000:3.0:1746126615.693443:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 226 pid: 14548 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126615.693462:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469952 00000100:00100000:3.0:1746126615.693463:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469952 00010000:00010000:3.0:1746126615.693471:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 10 pid: 14549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126615.693487:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7059 00000100:00100000:3.0:1746126615.693491:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721469824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.693501:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.693505:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 12 pid: 14548 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.693514:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 12 pid: 14548 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.693528:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:1.0:1746126615.693597:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7060 00000100:00100000:1.0:1746126615.693603:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:1963:x1830945721469696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126615.693609:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126615.693613:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 226 pid: 14548 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.693631:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126615.693637:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126615.693641:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126615.693670:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721469824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 178us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.693675:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7059 00000100:00100000:3.0:1746126615.693685:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7061 00000100:00100000:3.0:1746126615.693689:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721469952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.693694:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.693697:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 10 pid: 14549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746126615.693849:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676138c3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc38 expref: 11 pid: 14548 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746126615.693865:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721372160:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126615.693872:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721372288:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126615.693914:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 226 pid: 14548 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746126615.693925:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676138e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc3f expref: 226 pid: 14548 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746126615.693936:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.693940:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126615.693945:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126615.693949:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126615.693966:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+225:1963:x1830945721469696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 364us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.693971:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7060 00000100:00100000:1.0:1746126615.694051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.694077:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721470464 00000100:00100000:1.0:1746126615.694079:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721470464 00002000:00100000:1.0:1746126615.694097:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3f6680 x1830945721470464/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.694104:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6680 with x1830945721470464 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.694107:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6680 00000100:00100000:1.0:1746126615.694118:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7730 00000100:00100000:1.0:1746126615.694122:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721470464:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:3.0:1746126615.695028:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 10 pid: 14549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.695041:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1000/0xb50e825867613845 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc07 expref: 10 pid: 14549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.695054:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126615.695058:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126615.695064:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126615.695078:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126615.695084:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.695088:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.695092:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.695108:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126615.695128:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721469952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1437us (3715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.695133:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7061 00010000:00010000:2.0:1746126615.695220:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126615.695228:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126615.695233:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126615.695246:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126615.695344:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a45cae00/0xb50e82586761391e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.695355:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.695360:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126615.695363:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126615.695365:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009367f600, rc 0) 00000100:00100000:2.0:1746126615.695384:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31293:x1830945721468544:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 17030us (18920us total) trans 8589943127 rc 0/0 00000100:00100000:2.0:1746126615.695393:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8940 00010000:00010000:1.0:1746126615.696874:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.696883:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126615.696895:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126615.696974:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace45200/0xb50e82586761392c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.696990:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.696996:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.696999:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126615.697001:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44600, rc 0) 00000100:00100000:1.0:1746126615.697021:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31288:x1830945721468800:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11318us (13103us total) trans 8589943128 rc 0/0 00000100:00100000:1.0:1746126615.697027:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8941 00000100:00100000:0.0:1746126615.697809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.698034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.699419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.700456:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721470720 00000100:00100000:3.0:1746126615.700463:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721470720 00002000:00100000:3.0:1746126615.700495:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009f11c000 x1830945721470720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.700504:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c000 with x1830945721470720 ext(1048576->2097151) 00002000:00010000:3.0:1746126615.700508:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11c000 00000100:00100000:3.0:1746126615.700523:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721470976 00000100:00100000:3.0:1746126615.700525:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721470976 00002000:00100000:3.0:1746126615.700533:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009f11e300 x1830945721470976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.700545:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11e300 with x1830945721470976 ext(1048576->2097151) 00002000:00010000:3.0:1746126615.700547:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11e300 00000100:00100000:3.0:1746126615.700747:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7731 00000100:00100000:3.0:1746126615.700754:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721470720:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.701710:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7732 00000100:00100000:3.0:1746126615.701716:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721470976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126615.711631:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721471104 00000100:00100000:1.0:1746126615.711641:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721471104 00000100:00100000:1.0:1746126615.711695:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8942 00000100:00100000:1.0:1746126615.711702:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31292:x1830945721471104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126615.711717:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126615.711731:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbac00/0xb50e825867613972 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dca8 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.711793:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbac00/0xb50e825867613972 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca8 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.711805:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbac00/0xb50e825867613972 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca8 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.711820:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.711822:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126615.711825:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbac00, rc 0) 00000100:00100000:1.0:1746126615.711878:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31292:x1830945721471104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 176us (12464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.711884:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8942 00000100:00100000:1.0:1746126615.723063:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721470464:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28927us (28998us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.723085:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7730 00002000:00100000:1.0:1746126615.723097:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e3f6680 x1830945721470464/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.723107:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6680 with x1830945721470464 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.723112:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6680 00000100:00100000:2.0:1746126615.748823:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721470208:12345-192.168.203.2@tcp:3:cat.0 Request processed in 57307us (57374us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.748936:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7729 00002000:00100000:2.0:1746126615.748949:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009f11c380 x1830945721470208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.748959:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c380 with x1830945721470208 ext(0->1048575) 00002000:00010000:2.0:1746126615.748965:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11c380 00000100:00100000:3.0:1746126615.752334:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721470720:12345-192.168.203.2@tcp:3:cat.0 Request processed in 51569us (54516us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.752344:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7731 00002000:00100000:3.0:1746126615.752355:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009f11c000 x1830945721470720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.752363:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c000 with x1830945721470720 ext(1048576->2097151) 00002000:00010000:3.0:1746126615.752368:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11c000 00000100:00100000:0.0:1746126615.764821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.765436:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721470976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 63716us (67398us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.765447:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7732 00002000:00100000:3.0:1746126615.765459:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009f11e300 x1830945721470976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.765467:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11e300 with x1830945721470976 ext(1048576->2097151) 00002000:00010000:3.0:1746126615.765472:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11e300 00000100:00100000:0.0:1746126615.765701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.766021:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721471232 00000100:00100000:2.0:1746126615.766028:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721471232 00000100:00100000:2.0:1746126615.766057:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8943 00000100:00100000:2.0:1746126615.766062:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31294:x1830945721471232:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126615.766088:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126615.766103:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcaf expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.766155:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.766168:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.766186:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126615.766189:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126615.766193:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f86000, rc 0) 00000100:00100000:2.0:1746126615.766223:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31294:x1830945721471232:12345-192.168.203.2@tcp:101:cat.0 Request processed in 160us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126615.766229:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8943 00000100:00100000:3.0:1746126615.766640:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721471488 00000100:00100000:3.0:1746126615.766646:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721471488 00002000:00100000:3.0:1746126615.766675:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009f11d880 x1830945721471488/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.766683:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11d880 with x1830945721471488 ext(0->1048575) 00002000:00010000:3.0:1746126615.766687:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11d880 00000100:00100000:3.0:1746126615.766726:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7733 00000100:00100000:3.0:1746126615.766734:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721471488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126615.773597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.773639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.773680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.773763:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721471744 00000100:00100000:1.0:1746126615.773771:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721471744 00002000:00100000:1.0:1746126615.773804:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5b69f80 x1830945721471744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.773813:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69f80 with x1830945721471744 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.773818:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b69f80 00000100:00100000:1.0:1746126615.773854:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721472000 00000100:00100000:1.0:1746126615.773857:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721472000 00002000:00100000:1.0:1746126615.773868:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5b68a80 x1830945721472000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.773874:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68a80 with x1830945721472000 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.773877:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b68a80 00000100:00100000:1.0:1746126615.773886:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721472256 00000100:00100000:1.0:1746126615.773887:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721472256 00002000:00100000:1.0:1746126615.773896:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5b6bb80 x1830945721472256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.773908:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6bb80 with x1830945721472256 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.773911:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6bb80 00000100:00100000:1.0:1746126615.773922:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7734 00000100:00100000:1.0:1746126615.773929:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721471744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126615.775786:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7735 00000100:00100000:1.0:1746126615.775796:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721472000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126615.777131:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7736 00000100:00100000:2.0:1746126615.777145:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721472256:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.791726:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721471488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24985us (26018us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.791736:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7733 00002000:00100000:3.0:1746126615.791745:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009f11d880 x1830945721471488/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.791753:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11d880 with x1830945721471488 ext(0->1048575) 00002000:00010000:3.0:1746126615.791758:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11d880 00000100:00100000:1.0:1746126615.807992:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721471744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34053us (34392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.808005:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7734 00002000:00100000:1.0:1746126615.808016:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5b69f80 x1830945721471744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.808025:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69f80 with x1830945721471744 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.808031:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b69f80 00000100:00100000:1.0:1746126615.809763:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721472000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 33964us (36117us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.809773:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7735 00002000:00100000:1.0:1746126615.809781:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5b68a80 x1830945721472000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.809789:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68a80 with x1830945721472000 ext(1048576->2097151) 00002000:00010000:1.0:1746126615.809793:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b68a80 00000100:00100000:2.0:1746126615.821691:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721472256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 44540us (48000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.821701:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7736 00002000:00100000:2.0:1746126615.821713:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5b6bb80 x1830945721472256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.821721:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6bb80 with x1830945721472256 ext(1048576->2097151) 00002000:00010000:2.0:1746126615.821726:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6bb80 00000100:00100000:0.0:1746126615.826977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.827011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.827062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.827100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.827182:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721472768 00000100:00100000:3.0:1746126615.827189:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721472768 00002000:00100000:3.0:1746126615.827226:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a5b6a300 x1830945721472768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.827234:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6a300 with x1830945721472768 ext(3145728->4194303) 00002000:00010000:3.0:1746126615.827239:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6a300 00000100:00100000:3.0:1746126615.827262:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721472640 00000100:00100000:3.0:1746126615.827265:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721472640 00002000:00100000:3.0:1746126615.827275:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5b69500 x1830945721472640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.827282:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69500 with x1830945721472640 ext(2097152->3145727) 00002000:00010000:3.0:1746126615.827284:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b69500 00000100:00100000:3.0:1746126615.827294:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721473024 00000100:00100000:3.0:1746126615.827297:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721473024 00002000:00100000:3.0:1746126615.827309:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88012a3f3450 x1830945721473024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.827316:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a3f3450 with x1830945721473024 ext(2097152->3145727) 00002000:00010000:3.0:1746126615.827319:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a3f3450 00000100:00100000:3.0:1746126615.827331:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721473152 00000100:00100000:3.0:1746126615.827334:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721473152 00002000:00100000:3.0:1746126615.827347:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5b6aa00 x1830945721473152/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.827353:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6aa00 with x1830945721473152 ext(3145728->4194303) 00002000:00010000:3.0:1746126615.827355:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6aa00 00000100:00100000:3.0:1746126615.827371:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7737 00000100:00100000:3.0:1746126615.827379:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721472768:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.828577:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7738 00000100:00100000:3.0:1746126615.828585:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721472640:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.829919:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7739 00000100:00100000:3.0:1746126615.829925:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a3f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721473024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126615.830149:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7740 00000100:00100000:1.0:1746126615.830158:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721473152:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:0.0:1746126615.834905:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126615.844446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.852010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.853597:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721473536 00000100:00100000:2.0:1746126615.853608:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721473536 00002000:00100000:2.0:1746126615.853653:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5b69180 x1830945721473536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.853663:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69180 with x1830945721473536 ext(2097152->3145727) 00002000:00010000:2.0:1746126615.853668:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b69180 00000100:00100000:2.0:1746126615.853695:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721473792 00000100:00100000:2.0:1746126615.853699:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721473792 00002000:00100000:2.0:1746126615.853715:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800937b9f80 x1830945721473792/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.853723:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9f80 with x1830945721473792 ext(3145728->4194303) 00002000:00010000:2.0:1746126615.853726:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9f80 00000100:00100000:2.0:1746126615.853765:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7741 00000100:00100000:2.0:1746126615.853773:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721473536:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126615.855211:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7742 00000100:00100000:2.0:1746126615.855219:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721473792:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.856521:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721472768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29140us (29550us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.856529:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7737 00002000:00100000:3.0:1746126615.856536:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800a5b6a300 x1830945721472768/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.856543:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6a300 with x1830945721472768 ext(3145728->4194303) 00002000:00010000:3.0:1746126615.856549:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6a300 00000100:00100000:2.0:1746126615.858946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.859020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.859130:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721474048 00000100:00100000:1.0:1746126615.859137:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721474048 00002000:00100000:1.0:1746126615.859165:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e9500 x1830945721474048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.859173:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9500 with x1830945721474048 ext(2097152->3145727) 00002000:00010000:1.0:1746126615.859178:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9500 00000100:00100000:1.0:1746126615.859200:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721474304 00000100:00100000:1.0:1746126615.859202:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721474304 00002000:00100000:1.0:1746126615.859212:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093af7b80 x1830945721474304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.859218:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7b80 with x1830945721474304 ext(3145728->4194303) 00002000:00010000:1.0:1746126615.859220:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af7b80 00000100:00100000:1.0:1746126615.859238:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7743 00000100:00100000:1.0:1746126615.859245:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721474048:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126615.859252:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7744 00000100:00100000:2.0:1746126615.859259:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721474304:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126615.861571:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721472640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 32980us (34554us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.861579:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7738 00002000:00100000:3.0:1746126615.861588:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5b69500 x1830945721472640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.861594:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69500 with x1830945721472640 ext(2097152->3145727) 00002000:00010000:3.0:1746126615.861599:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b69500 00000100:00100000:3.0:1746126615.878130:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a3f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721473024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 48195us (51057us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126615.878140:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7739 00002000:00100000:3.0:1746126615.878149:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88012a3f3450 x1830945721473024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126615.878157:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a3f3450 with x1830945721473024 ext(2097152->3145727) 00002000:00010000:3.0:1746126615.878162:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a3f3450 00000100:00100000:2.0:1746126615.881721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.881763:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721474560 00000100:00100000:2.0:1746126615.881769:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721474560 00000100:00100000:2.0:1746126615.881816:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8944 00000100:00100000:2.0:1746126615.881823:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31288:x1830945721474560:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126615.881859:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126615.881862:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126615.881885:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbac00/0xb50e825867613972 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca8 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.881903:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126615.881907:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126615.881916:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4ab800/0xb50e825867613980 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcb6 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.881955:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126615.881965:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.881971:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.881978:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126615.882001:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.882011:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 11 pid: 14549 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746126615.882021:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721372416:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126615.882107:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.882114:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 8 pid: 14547 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746126615.882121:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721372544:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126615.882138:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126615.882410:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721473152:12345-192.168.203.2@tcp:3:cat.0 Request processed in 52252us (55308us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.882417:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7740 00002000:00100000:2.0:1746126615.882424:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5b6aa00 x1830945721473152/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.882432:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6aa00 with x1830945721473152 ext(3145728->4194303) 00002000:00010000:2.0:1746126615.882436:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6aa00 00000100:00100000:2.0:1746126615.888812:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721473536:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35032us (44364us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.888823:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7741 00002000:00100000:2.0:1746126615.888854:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5b69180 x1830945721473536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.888863:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69180 with x1830945721473536 ext(2097152->3145727) 00002000:00010000:2.0:1746126615.888868:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b69180 00000100:00100000:0.0:1746126615.904386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.904948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.905101:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721372416:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126615.905110:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721372544:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126615.905129:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126615.905189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.905377:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721474688 00000100:00100000:3.0:1746126615.905384:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721474688 00010000:00010000:3.0:1746126615.905410:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 12 pid: 14549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126615.905433:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721474816 00000100:00100000:3.0:1746126615.905435:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721474816 00010000:00010000:3.0:1746126615.905443:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 9 pid: 14547 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126615.905455:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7062 00000100:00100000:3.0:1746126615.905460:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721474688:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.905470:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.905475:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 12 pid: 14549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.905482:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 12 pid: 14549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.905499:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f86000/0xb50e825867613979 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcaf expref: 12 pid: 14549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.905513:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126615.905516:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.905522:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.905526:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126615.905556:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721474688:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.905561:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7062 00000100:00100000:3.0:1746126615.905572:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7063 00000100:00100000:3.0:1746126615.905576:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721474816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.905581:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.905585:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 9 pid: 14547 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.905592:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 9 pid: 14547 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.905601:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092daec00/0xb50e825867613837 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc00 expref: 9 pid: 14547 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126615.905608:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126615.905610:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.905616:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.905621:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126615.905633:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126615.905645:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721474816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 68us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.905649:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7063 00000100:00100000:1.0:1746126615.907176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.907392:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721474944 00000100:00100000:0.0:1746126615.907397:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721474944 00000100:00100000:0.0:1746126615.907426:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475072 00000100:00100000:0.0:1746126615.907429:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475072 00000100:00100000:0.0:1746126615.907442:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8945 00000100:00100000:0.0:1746126615.907447:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:31292:x1830945721474944:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126615.907459:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.907471:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcbd expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.907509:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126615.907515:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8946 00010000:00010000:0.0:1746126615.907516:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 228 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126615.907522:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31294:x1830945721475072:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126615.907530:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126615.907530:0:14547:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126615.907538:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcc4 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.907539:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 228 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.907548:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126615.907551:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126615.907553:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 228 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126615.907559:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb19000, rc 0) 00010000:00010000:1.0:1746126615.907563:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.907571:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.907578:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.907580:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126615.907583:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 228 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126615.907585:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+228:31292:x1830945721474944:12345-192.168.203.2@tcp:101:cat.0 Request processed in 138us (2396us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126615.907589:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c59400, rc 0) 00000100:00100000:0.0:1746126615.907591:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8945 00000100:00100000:1.0:1746126615.907606:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31294:x1830945721475072:12345-192.168.203.2@tcp:101:cat.0 Request processed in 85us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.907611:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8946 00010000:00010000:2.0:1746126615.907924:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126615.907931:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000040:00080000:2.0:1746126615.908439:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2644, 88 off224528 00000004:00080000:2.0:1746126615.908446:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822618245ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126615.908487:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2759, 88 off234744 00000004:00080000:2.0:1746126615.908491:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822664032ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908502:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2760, 88 off234832 00000004:00080000:2.0:1746126615.908504:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822676774ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908536:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2645, 88 off224616 00000004:00080000:2.0:1746126615.908539:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822711464ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126615.908548:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2646, 88 off224704 00000004:00080000:2.0:1746126615.908550:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822723022ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126615.908558:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2761, 88 off234920 00000004:00080000:2.0:1746126615.908561:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822733204ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908568:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2762, 88 off235008 00000004:00080000:2.0:1746126615.908570:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822742919ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908577:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2647, 88 off224792 00000004:00080000:2.0:1746126615.908579:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822751707ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126615.908586:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2763, 88 off235096 00000004:00080000:2.0:1746126615.908588:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822760614ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908596:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2648, 88 off224880 00000004:00080000:2.0:1746126615.908598:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822770774ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126615.908605:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2764, 88 off235184 00000004:00080000:2.0:1746126615.908607:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822779369ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908614:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2649, 88 off224968 00000004:00080000:2.0:1746126615.908617:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822789112ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126615.908623:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2765, 88 off235272 00000004:00080000:2.0:1746126615.908626:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737822798202ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.908634:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2650, 88 off225056 00000004:00080000:2.0:1746126615.908636:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737822808575ns, next at 687927188999ns, rc = 0 00000100:00100000:0.0:1746126615.910003:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721473792:12345-192.168.203.2@tcp:3:cat.0 Request processed in 54779us (57997us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126615.910012:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7742 00002000:00100000:0.0:1746126615.910021:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800937b9f80 x1830945721473792/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126615.910029:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9f80 with x1830945721473792 ext(3145728->4194303) 00002000:00010000:0.0:1746126615.910034:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9f80 00000040:00080000:2.0:1746126615.910102:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2766, 88 off235360 00000004:00080000:2.0:1746126615.910109:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737824281680ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.910140:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2767, 88 off235448 00000004:00080000:2.0:1746126615.910143:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737824315916ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126615.910154:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2651, 88 off225144 00000004:00080000:2.0:1746126615.910156:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737824329008ns, next at 687927188999ns, rc = 0 00000100:00100000:1.0:1746126615.916601:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721474304:12345-192.168.203.2@tcp:3:cat.0 Request processed in 57336us (57575us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.916611:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7744 00002000:00100000:1.0:1746126615.916622:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093af7b80 x1830945721474304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.916628:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7b80 with x1830945721474304 ext(3145728->4194303) 00002000:00010000:1.0:1746126615.916633:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af7b80 00000100:00100000:1.0:1746126615.917012:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721474048:12345-192.168.203.2@tcp:3:cat.0 Request processed in 57767us (58071us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.917017:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7743 00002000:00100000:1.0:1746126615.917022:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e9500 x1830945721474048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.917028:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9500 with x1830945721474048 ext(2097152->3145727) 00002000:00010000:1.0:1746126615.917031:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9500 00000001:00080000:1.0:1746126615.938490:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943128 is committed 00000001:00080000:1.0:1746126615.938507:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943124 is committed 00000001:00080000:1.0:1746126615.938515:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943129 is committed 00000004:00080000:1.0:1746126615.938518:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746126615.938524:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2149 committed 00000004:00080000:1.0:1746126615.938529:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2148 committed 00000004:00080000:1.0:1746126615.938531:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746126615.938533:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2147 committed 00000004:00080000:1.0:1746126615.938534:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746126615.938536:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2146 committed 00000004:00080000:1.0:1746126615.938538:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746126615.938540:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2145 committed 00000004:00080000:1.0:1746126615.938541:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2032 committed 00000004:00080000:1.0:1746126615.938543:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2144 committed 00000004:00080000:1.0:1746126615.938545:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2143 committed 00000004:00080000:1.0:1746126615.938546:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2031 committed 00000004:00080000:1.0:1746126615.938548:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746126615.938550:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2142 committed 00000004:00080000:1.0:1746126615.938552:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2141 committed 00000004:00080000:1.0:1746126615.938553:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2029 committed 00000001:00080000:1.0:1746126615.938557:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943127 is committed 00000001:00080000:1.0:1746126615.938561:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943122 is committed 00000100:00100000:1.0:1746126615.938738:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.938791:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.938847:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.938863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.938884:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.938898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.938909:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.938920:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.938941:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746126615.938945:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721372672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.938959:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.938970:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.938981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.938990:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939001:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939009:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939021:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939034:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721372928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939047:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939056:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939081:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939093:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939106:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939115:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721374464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939126:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939133:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746126615.939137:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721372800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939150:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939157:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939167:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939172:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939183:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939188:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721374336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939200:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126615.939217:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373056 00000100:00100000:1.0:1746126615.939222:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373056 00000100:00100000:1.0:1746126615.939243:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373568 00000100:00100000:1.0:1746126615.939245:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373568 00000100:00100000:1.0:1746126615.939250:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374080 00000100:00100000:1.0:1746126615.939252:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374080 00000100:00100000:1.0:1746126615.939258:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374592 00000100:00100000:1.0:1746126615.939259:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374592 00000100:00100000:1.0:1746126615.939264:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372672 00000100:00100000:1.0:1746126615.939266:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372672 00000100:00100000:1.0:1746126615.939270:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373184 00000100:00100000:1.0:1746126615.939272:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373184 00000100:00100000:1.0:1746126615.939277:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373696 00000100:00100000:1.0:1746126615.939278:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373696 00000100:00100000:1.0:1746126615.939283:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374208 00000100:00100000:1.0:1746126615.939285:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374208 00000100:00100000:1.0:1746126615.939290:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372928 00000100:00100000:1.0:1746126615.939292:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372928 00000100:00100000:1.0:1746126615.939297:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373440 00000100:00100000:1.0:1746126615.939298:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373440 00000100:00100000:1.0:1746126615.939304:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373952 00000100:00100000:1.0:1746126615.939305:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373952 00000100:00100000:1.0:1746126615.939311:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374464 00000100:00100000:1.0:1746126615.939313:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374464 00000100:00100000:1.0:1746126615.939318:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721372800 00000100:00100000:1.0:1746126615.939320:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721372800 00000100:00100000:1.0:1746126615.939325:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373312 00000100:00100000:1.0:1746126615.939326:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373312 00000100:00100000:1.0:1746126615.939331:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721373824 00000100:00100000:1.0:1746126615.939333:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721373824 00000100:00100000:1.0:1746126615.939338:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374336 00000100:00100000:1.0:1746126615.939339:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374336 00000100:00100000:1.0:1746126615.939348:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13545 00000100:00100000:1.0:1746126615.939353:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721373056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939498:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721373056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (706us total) trans 21474840353 rc 0/0 00000100:00100000:1.0:1746126615.939503:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13545 00000100:00100000:1.0:1746126615.939515:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13546 00000100:00100000:1.0:1746126615.939520:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721373568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939589:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721373568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (725us total) trans 21474840354 rc 0/0 00000100:00100000:1.0:1746126615.939594:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13546 00000100:00100000:1.0:1746126615.939604:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13547 00000100:00100000:1.0:1746126615.939608:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721374080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939702:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721374080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (802us total) trans 17179873203 rc 0/0 00000100:00100000:1.0:1746126615.939707:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13547 00000100:00100000:1.0:1746126615.939716:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13548 00000100:00100000:1.0:1746126615.939720:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721374592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.939787:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721374592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (865us total) trans 17179873204 rc 0/0 00000100:00100000:1.0:1746126615.939791:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13548 00000100:00100000:1.0:1746126615.939800:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13549 00000100:00100000:1.0:1746126615.939804:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721372672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126615.939887:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126615.939890:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.939892:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.939895:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.939897:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1953 00000100:00100000:1.0:1746126615.939914:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721372672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (954us total) trans 21474840355 rc 0/0 00000100:00100000:1.0:1746126615.939919:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13549 00000100:00100000:1.0:1746126615.939928:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13550 00000100:00100000:1.0:1746126615.939931:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721373184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.939994:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721373184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (1012us total) trans 21474840356 rc 0/0 00000100:00100000:1.0:1746126615.939999:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13550 00000100:00100000:1.0:1746126615.940008:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13551 00000100:00100000:1.0:1746126615.940011:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721373696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126615.940084:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126615.940087:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940088:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940090:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940092:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126615.940109:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721373696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (1107us total) trans 17179873205 rc 0/0 00000100:00100000:1.0:1746126615.940114:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13551 00000100:00100000:1.0:1746126615.940123:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13552 00000100:00100000:1.0:1746126615.940127:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721374208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126615.940189:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126615.940192:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126615.940194:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126615.940196:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126615.940198:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126615.940215:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721374208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1193us total) trans 17179873206 rc 0/0 00000100:00100000:1.0:1746126615.940220:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13552 00000100:00100000:1.0:1746126615.940228:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13553 00000100:00100000:1.0:1746126615.940233:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721372928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126615.940292:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126615.940295:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126612 -> 1746126612 00002000:00010000:1.0:1746126615.940296:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940298:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126612 -> 1746126612 00002000:00010000:1.0:1746126615.940300:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:1.0:1746126615.940320:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721372928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1271us total) trans 21474840357 rc 0/0 00000100:00100000:1.0:1746126615.940325:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13553 00000100:00100000:1.0:1746126615.940333:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13554 00000100:00100000:1.0:1746126615.940337:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721373440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.940406:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721373440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1324us total) trans 21474840358 rc 0/0 00000100:00100000:1.0:1746126615.940411:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13554 00000100:00100000:1.0:1746126615.940419:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13555 00000100:00100000:1.0:1746126615.940424:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721373952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126615.940482:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746126615.940484:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940486:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940488:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940490:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746126615.940507:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721373952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1400us total) trans 17179873207 rc 0/0 00000100:00100000:1.0:1746126615.940512:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13555 00000100:00100000:1.0:1746126615.940520:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13556 00000100:00100000:1.0:1746126615.940525:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721374464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.940590:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721374464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1463us total) trans 17179873208 rc 0/0 00000100:00100000:1.0:1746126615.940595:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13556 00000100:00100000:1.0:1746126615.940604:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13557 00000100:00100000:1.0:1746126615.940608:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721372800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126615.940667:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126615.940670:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940671:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940673:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940675:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126615.940692:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721372800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1541us total) trans 21474840359 rc 0/0 00000100:00100000:1.0:1746126615.940696:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13557 00000100:00100000:1.0:1746126615.940705:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13558 00000100:00100000:1.0:1746126615.940710:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721373312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126615.940777:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721373312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1608us total) trans 21474840360 rc 0/0 00000100:00100000:1.0:1746126615.940782:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13558 00000100:00100000:1.0:1746126615.940791:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13559 00000100:00100000:1.0:1746126615.940795:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721373824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126615.940874:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126615.940876:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940878:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940880:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126615.940881:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746126615.940899:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721373824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (1715us total) trans 17179873209 rc 0/0 00000100:00100000:1.0:1746126615.940903:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13559 00000100:00100000:1.0:1746126615.940913:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13560 00000100:00100000:1.0:1746126615.940917:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721374336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.940981:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3297:x1830945721374336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1780us total) trans 17179873210 rc 0/0 00000100:00100000:1.0:1746126615.940986:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13560 00000004:00080000:1.0:1746126615.941035:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f7800/2, rc 0, transno 21474840359 00000100:00100000:1.0:1746126615.941040:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721372800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126615.941047:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4e00/2, rc 0, transno 21474840360 00000100:00100000:1.0:1746126615.941050:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126615.941057:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6300/2, rc 0, transno 17179873209 00000100:00100000:1.0:1746126615.941063:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126615.941085:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6680/2, rc 0, transno 17179873210 00000100:00100000:1.0:1746126615.941087:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721374336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126615.941093:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f7100/2, rc 0, transno 21474840357 00000100:00100000:1.0:1746126615.941096:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721372928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126615.941101:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5f80/2, rc 0, transno 21474840358 00000100:00100000:1.0:1746126615.941103:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126615.941108:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4700/2, rc 0, transno 17179873207 00000100:00100000:1.0:1746126615.941111:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721373952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126615.941115:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4380/2, rc 0, transno 17179873208 00000100:00100000:1.0:1746126615.941118:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721374464:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126615.941144:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746126615.941152:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5500/2, rc 0, transno 21474840355 00000100:00100000:1.0:1746126615.941155:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721372672:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746126615.941159:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000004:00080000:1.0:1746126615.941160:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f7480/2, rc 0, transno 21474840356 00010000:00010000:2.0:1746126615.941161:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746126615.941163:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373184:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746126615.941165:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746126615.941167:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5c00/2, rc 0, transno 17179873205 00000100:00100000:1.0:1746126615.941170:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373696:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126615.941174:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746126615.941175:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5180/2, rc 0, transno 17179873206 00000100:00100000:1.0:1746126615.941177:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374208:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126615.941180:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746126615.941182:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4a80/2, rc 0, transno 21474840353 00000100:00100000:1.0:1746126615.941184:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373056:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746126615.941187:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746126615.941189:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5880/2, rc 0, transno 21474840354 00000100:00100000:1.0:1746126615.941191:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721373568:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746126615.941192:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746126615.941196:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f7b80/2, rc 0, transno 17179873203 00010000:00010000:2.0:1746126615.941198:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126615.941198:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126615.941203:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6a00/2, rc 0, transno 17179873204 00000100:00100000:1.0:1746126615.941205:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126615.941210:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746126615.941214:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374720:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126615.941218:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126615.941224:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721374848:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126615.941233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126615.941275:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126615.941285:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721374976:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126615.941287:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721374720 00000100:00100000:3.0:1746126615.941291:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721374720 00000100:00100000:3.0:1746126615.941312:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13561 00000100:00100000:3.0:1746126615.941317:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721374720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126615.941864:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126615.941874:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721374720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 557us (640us total) trans 17179873211 rc 0/0 00000100:00100000:3.0:1746126615.941879:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13561 00000004:00080000:1.0:1746126615.942439:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0000/2, rc 0, transno 17179873211 00000100:00100000:1.0:1746126615.942443:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721374720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126615.946300:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721374976:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126615.949281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.950755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.950847:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475328 00000100:00100000:2.0:1746126615.950855:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475328 00000100:00100000:2.0:1746126615.950888:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8947 00000100:00100000:2.0:1746126615.950895:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31293:x1830945721475328:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126615.950910:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126615.950924:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135526c00/0xb50e82586761399c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dccb expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.950968:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135526c00/0xb50e82586761399c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dccb expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.950978:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526c00/0xb50e82586761399c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dccb expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.950991:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126615.950994:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126615.950996:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526c00, rc 0) 00000100:00100000:2.0:1746126615.951032:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31293:x1830945721475328:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 137us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126615.951038:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8947 00000100:00100000:2.0:1746126615.951080:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721374848:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126615.951104:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4ab800/0xb50e825867613980 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 225 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746126615.951117:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.951128:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4abe00, rc 0) 00000100:00100000:2.0:1746126615.951143:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31288:x1830945721474560:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 69322us (69429us total) trans 8589943129 rc 0/0 00000100:00100000:2.0:1746126615.951148:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8944 00000100:00100000:3.0:1746126615.951346:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475200 00000100:00100000:3.0:1746126615.951350:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475200 00000100:00100000:3.0:1746126615.951381:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3783 00000100:00100000:3.0:1746126615.951387:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31294:x1830945721475200:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:3.0:1746126615.951441:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31294:x1830945721475200:12345-192.168.203.2@tcp:49:cat.0 Request processed in 54us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.951446:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3783 00000100:00100000:0.0:1746126615.951795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.952318:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475456 00000100:00100000:1.0:1746126615.952322:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475456 00000100:00100000:1.0:1746126615.952563:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3784 00000100:00100000:1.0:1746126615.952570:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31292:x1830945721475456:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:1.0:1746126615.952634:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31292:x1830945721475456:12345-192.168.203.2@tcp:49:cat.0 Request processed in 65us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.952639:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3784 00000100:00100000:0.0:1746126615.954742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126615.954895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126615.954933:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475712 00000100:00100000:1.0:1746126615.954939:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475712 00000100:00100000:1.0:1746126615.954969:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 702 00000100:00100000:1.0:1746126615.954975:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721475712:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126615.954984:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126615.955003:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526c00/0xb50e82586761399c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dccb expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126615.955015:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126615.955018:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126615.955044:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721475712:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126615.955050:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 702 00000100:00100000:3.0:1746126615.955110:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475584 00000100:00100000:3.0:1746126615.955115:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475584 00000100:00100000:3.0:1746126615.955135:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3785 00000100:00100000:3.0:1746126615.955139:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31288:x1830945721475584:12345-192.168.203.2@tcp:49:multiop.0 00000100:00100000:3.0:1746126615.955207:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31288:x1830945721475584:12345-192.168.203.2@tcp:49:multiop.0 Request processed in 67us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.955212:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3785 00000100:00100000:0.0:1746126615.963274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.965901:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721475840 00000100:00100000:2.0:1746126615.965911:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721475840 00000100:00100000:2.0:1746126615.965964:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13562 00000100:00100000:2.0:1746126615.965971:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:31288:x1830945721475840:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126615.965986:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126615.966001:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcd2 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.966022:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126615.966029:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 33 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126615.966037:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126615.966043:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126615.966050:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126615.966053:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 33 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126615.966087:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126615.966099:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 17 pid: 8436 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746126615.966112:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375104:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126615.966182:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126615.966226:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 33 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.966236:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 33 pid: 17475 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126615.966243:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375232:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126615.966272:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126615.966280:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 8 pid: 4642 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126615.966287:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375360:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126615.966304:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126615.966387:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721476224 00000100:00100000:1.0:1746126615.966391:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721476224 00002000:00100000:1.0:1746126615.966417:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093af4000 x1830945721476224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.966430:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4000 with x1830945721476224 ext(3145728->4194303) 00002000:00010000:1.0:1746126615.966435:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4000 00000100:00100000:1.0:1746126615.966447:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7745 00000100:00100000:1.0:1746126615.966452:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721476224:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126615.972914:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.972951:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.972996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.973183:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375104:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126615.973192:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375232:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126615.973198:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375360:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126615.973221:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 33 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.973234:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527400, rc 0) 00000100:00100000:3.0:1746126615.973270:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:31288:x1830945721475840:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7300us (10003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.973278:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13562 00000100:00100000:1.0:1746126615.973456:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721476480 00000100:00100000:1.0:1746126615.973461:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721476480 00002000:00100000:1.0:1746126615.973487:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8801367ea680 x1830945721476480/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.973495:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ea680 with x1830945721476480 ext(3145728->4194303) 00002000:00010000:1.0:1746126615.973499:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ea680 00000100:00100000:0.0:1746126615.974706:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721476352 00000100:00100000:0.0:1746126615.974711:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721476352 00000100:00100000:1.0:1746126615.974720:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7746 00000100:00100000:1.0:1746126615.974726:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721476480:12345-192.168.203.2@tcp:3:multiop.0 00002000:00100000:0.0:1746126615.974886:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367ead80 x1830945721476352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/0 e 0 to 0 dl 1746126626 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126615.974893:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ead80 with x1830945721476352 ext(2097152->3145727) 00002000:00010000:0.0:1746126615.974896:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ead80 00000100:00100000:0.0:1746126615.974918:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7747 00000100:00100000:0.0:1746126615.974923:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721476352:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126615.976479:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721476736 00000100:00100000:3.0:1746126615.976485:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721476736 00010000:00010000:3.0:1746126615.976508:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 18 pid: 8436 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126615.976527:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7064 00000100:00100000:3.0:1746126615.976531:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721476736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.976538:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.976550:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 18 pid: 8436 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.976559:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 18 pid: 8436 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.976575:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eae9400/0xb50e825867613910 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc54 expref: 18 pid: 8436 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.976595:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126615.976632:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721476736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 100us (3635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.976637:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7064 00000100:00100000:2.0:1746126615.984059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126615.984107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.984177:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721476992 00000100:00100000:3.0:1746126615.984184:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721476992 00010000:00010000:3.0:1746126615.984216:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 9 pid: 4642 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126615.984237:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721476864 00000100:00100000:3.0:1746126615.984239:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721476864 00010000:00010000:3.0:1746126615.984248:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 37 pid: 17475 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126615.984261:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7065 00000100:00100000:3.0:1746126615.984267:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721476992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.984278:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.984294:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 9 pid: 4642 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.984303:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 9 pid: 4642 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.984321:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ace44e00/0xb50e825867613868 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc1c expref: 9 pid: 4642 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.984347:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126615.984379:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721476992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126615.984384:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7065 00000100:00100000:3.0:1746126615.984396:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7066 00000100:00100000:3.0:1746126615.984401:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721476864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126615.984407:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126615.984414:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 37 pid: 17475 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.984422:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 37 pid: 17475 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.984433:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac14c00/0xb50e825867613948 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc8c expref: 37 pid: 17475 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126615.984441:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.984443:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126615.984449:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.984455:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.984481:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126615.984492:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721375488:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126615.984537:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126615.992901:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721476224:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 26439us (26709us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126615.992913:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7745 00002000:00100000:1.0:1746126615.992925:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093af4000 x1830945721476224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126615.992934:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4000 with x1830945721476224 ext(3145728->4194303) 00002000:00010000:1.0:1746126615.992939:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4000 00000100:00100000:0.0:1746126615.994694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126615.994756:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721477120 00000100:00100000:3.0:1746126615.994763:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721477120 00000100:00100000:3.0:1746126615.994804:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13563 00000100:00100000:3.0:1746126615.994810:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31293:x1830945721477120:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126615.994823:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126615.994857:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcd9 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.994881:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.994888:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126615.994890:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126615.994893:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.994917:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126615.994928:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126615.994944:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375616:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126615.995711:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126615.998619:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721476352:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23687us (25659us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126615.998629:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7747 00002000:00100000:2.0:1746126615.998638:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367ead80 x1830945721476352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126615.998646:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ead80 with x1830945721476352 ext(2097152->3145727) 00002000:00010000:2.0:1746126615.998651:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ead80 00000100:00100000:0.0:1746126616.001903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.001931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.002039:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721477504 00000100:00100000:2.0:1746126616.002046:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721477504 00002000:00100000:2.0:1746126616.002096:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1470464->1474559) req@ffff880093af5f80 x1830945721477504/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.002110:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5f80 with x1830945721477504 ext(1470464->1474559) 00010000:00010000:2.0:1746126616.002120:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 35 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746126616.002131:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 35 pid: 4642 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746126616.002137:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093af5f80 00000100:00100000:2.0:1746126616.002152:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721477632 00000100:00100000:2.0:1746126616.002154:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721477632 00002000:00100000:2.0:1746126616.002165:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093af6a00 x1830945721477632/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.002172:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6a00 with x1830945721477632 ext(3145728->4194303) 00002000:00010000:2.0:1746126616.002175:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af6a00 00000100:00100000:2.0:1746126616.002184:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1767 00000100:00100000:2.0:1746126616.002190:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721477504:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126616.002313:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721476480:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 27586us (29405us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126616.002319:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7746 00002000:00100000:1.0:1746126616.002325:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8801367ea680 x1830945721476480/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:376/0 lens 488/440 e 0 to 0 dl 1746126626 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126616.002332:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ea680 with x1830945721476480 ext(3145728->4194303) 00002000:00010000:1.0:1746126616.002335:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367ea680 00000100:00100000:1.0:1746126616.002348:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7748 00000100:00100000:1.0:1746126616.002354:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721477632:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126616.002379:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721375488:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126616.002393:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126616.002588:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721477504:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 396us (689us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126616.002593:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1767 00002000:00100000:2.0:1746126616.002599:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1470464->1474559) req@ffff880093af5f80 x1830945721477504/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/4536 e 0 to 0 dl 1746126627 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.002606:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5f80 with x1830945721477504 ext(1470464->1474559) 00010000:00010000:2.0:1746126616.002610:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 33 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126616.002624:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721476864:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 18222us (18516us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126616.002624:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 33 pid: 4642 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746126616.002629:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093af5f80 00000100:00100000:3.0:1746126616.002632:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7066 00000100:00080000:2.0:1746126616.002642:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746126616.002656:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721375616:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.002668:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 19 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.002679:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e664400, rc 0) 00000100:00100000:3.0:1746126616.002697:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31293:x1830945721477120:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7888us (8007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.002703:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13563 00000100:00100000:0.0:1746126616.014341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.014404:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721477888 00000100:00100000:2.0:1746126616.014412:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721477888 00002000:00100000:2.0:1746126616.014465:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093af5c00 x1830945721477888/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.014474:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5c00 with x1830945721477888 ext(4194304->4976639) 00002000:00010000:2.0:1746126616.014478:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af5c00 00000100:00100000:2.0:1746126616.014507:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7749 00000100:00100000:2.0:1746126616.014514:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721477888:12345-192.168.203.2@tcp:3:cat.0 00000100:00080000:0.0:1746126616.015132:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126616.022947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.023010:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478144 00000100:00100000:3.0:1746126616.023018:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478144 00000100:00100000:0.0:1746126616.023024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.023060:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13564 00000100:00100000:3.0:1746126616.023074:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:31288:x1830945721478144:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126616.023090:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126616.023103:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dce0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.023128:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.023136:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.023143:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.023149:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.023150:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.023153:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 23 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.023175:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.023183:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 15 pid: 8436 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.023192:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721375744:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.023261:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.023268:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 23 pid: 17475 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.023274:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721375872:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.023292:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.023302:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 7 pid: 8438 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.023308:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721376000:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126616.023318:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126616.024027:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721477632:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 21671us (22093us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126616.024036:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7748 00002000:00100000:1.0:1746126616.024043:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093af6a00 x1830945721477632/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/440 e 0 to 0 dl 1746126627 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126616.024050:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6a00 with x1830945721477632 ext(3145728->4194303) 00002000:00010000:1.0:1746126616.024054:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af6a00 00000100:00100000:1.0:1746126616.024075:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478272 00000100:00100000:1.0:1746126616.024078:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478272 00002000:00100000:1.0:1746126616.024096:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1470464->2097151) req@ffff880093af7800 x1830945721478272/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126616.024102:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7800 with x1830945721478272 ext(1470464->2097151) 00010000:00010000:1.0:1746126616.024108:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 32 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746126616.024117:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 32 pid: 4642 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746126616.024124:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093af7800 00000100:00100000:1.0:1746126616.024150:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1768 00000100:00100000:1.0:1746126616.024155:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721478272:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126616.025607:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721477888:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11091us (11271us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126616.025614:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7749 00002000:00100000:2.0:1746126616.025619:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093af5c00 x1830945721477888/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/440 e 0 to 0 dl 1746126627 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.025627:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5c00 with x1830945721477888 ext(4194304->4976639) 00002000:00010000:2.0:1746126616.025631:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af5c00 00000100:00100000:3.0:1746126616.025958:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721375744:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126616.025967:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721375872:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.029642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.029814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.030038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.030272:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478528 00000100:00100000:3.0:1746126616.030279:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478528 00010000:00010000:3.0:1746126616.030308:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 22 pid: 17475 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.030328:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478400 00000100:00100000:3.0:1746126616.030331:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478400 00010000:00010000:3.0:1746126616.030347:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 16 pid: 8436 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.030365:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478656 00000100:00100000:3.0:1746126616.030367:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478656 00010000:00010000:3.0:1746126616.030375:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 8 pid: 8438 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.030388:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7067 00000100:00100000:3.0:1746126616.030394:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721478528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126616.030404:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.030421:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 22 pid: 17475 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030429:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 22 pid: 17475 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030446:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb57400/0xb50e82586761394f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc93 expref: 22 pid: 17475 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030463:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126616.030494:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721478528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 100us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.030499:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7067 00000100:00100000:3.0:1746126616.030511:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7068 00000100:00100000:3.0:1746126616.030515:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721478400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126616.030520:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.030526:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 16 pid: 8436 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030533:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 16 pid: 8436 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030542:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5103400/0xb50e8258676138fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc5b expref: 16 pid: 8436 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030548:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126616.030558:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721478400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 44us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.030563:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7068 00000100:00100000:3.0:1746126616.030569:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7069 00000100:00100000:3.0:1746126616.030573:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721478656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126616.030577:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.030581:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 8 pid: 8438 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030588:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 8 pid: 8438 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746126616.030596:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.030597:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.030602:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 20 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.030608:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 20 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.030629:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 20 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.030638:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721376128:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126616.030670:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746126616.030696:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad6ae00/0xb50e825867613861 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc23 expref: 8 pid: 8438 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746126616.030708:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721376000:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.030726:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 20 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.030734:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e665a00, rc 0) 00000100:00100000:3.0:1746126616.030749:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+20:31288:x1830945721478144:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7685us (7809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.030755:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13564 00000100:00080000:1.0:1746126616.030844:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746126616.031810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.031901:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478784 00000100:00100000:3.0:1746126616.031905:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478784 00000100:00100000:3.0:1746126616.031935:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13565 00000100:00100000:3.0:1746126616.031941:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721478784:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126616.031951:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126616.031962:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e664600/0xb50e8258676139b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dce7 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.032350:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721376256:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126616.032411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.032521:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126616.032805:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.032824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.032933:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721478912 00000100:00100000:1.0:1746126616.032937:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721478912 00000100:00100000:1.0:1746126616.032962:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721479168 00000100:00100000:1.0:1746126616.032965:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721479168 00000100:00100000:1.0:1746126616.032975:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721479040 00000100:00100000:1.0:1746126616.032977:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721479040 00000100:00100000:1.0:1746126616.032989:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13566 00000100:00100000:1.0:1746126616.032995:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721478912:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126616.033003:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.033013:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e8258676139bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcee expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.033036:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721376384:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126616.033060:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126616.033082:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13567 00000100:00100000:1.0:1746126616.033088:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721479168:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126616.033094:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.033100:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9c00/0xb50e8258676139c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcfc expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.033119:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721376512:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126616.033137:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126616.033156:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13568 00000100:00100000:3.0:1746126616.033165:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721479040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126616.033172:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126616.033179:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e665600/0xb50e8258676139cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dcf5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.033201:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721376640:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126616.033221:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126616.036200:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721478272:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12038us (13168us total) trans 17179873212 rc 0/0 00000100:00100000:1.0:1746126616.036211:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1768 00002000:00100000:1.0:1746126616.036219:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1470464->2097151) req@ffff880093af7800 x1830945721478272/t17179873212(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/448 e 0 to 0 dl 1746126627 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126616.036228:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7800 with x1830945721478272 ext(1470464->2097151) 00010000:00010000:1.0:1746126616.036236:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746126616.036249:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 36 pid: 4642 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746126616.036254:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093af7800 00000100:00100000:3.0:1746126616.038158:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721376128:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126616.038172:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126616.038578:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721478656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8001us (8537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.038587:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7069 00002000:00010000:3.0:1746126616.038643:0:4642:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126613 -> 1746126615 00002000:00010000:3.0:1746126616.038646:0:4642:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126613 -> 1746126615 00002000:00010000:3.0:1746126616.038648:0:4642:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126613 -> 1746126615 00000100:00100000:0.0:1746126616.038671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.038672:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721376640:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126616.038690:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e665600/0xb50e8258676139cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcf5 expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126616.038697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126616.038699:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e665600/0xb50e8258676139cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcf5 expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.038719:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e665600, rc 0) 00000100:00100000:3.0:1746126616.038740:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721479040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5575us (5916us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126616.038746:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13568 00002000:00010000:1.0:1746126616.038749:0:20294:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126613 -> 1746126615 00002000:00010000:1.0:1746126616.038753:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126613 -> 1746126615 00002000:00010000:1.0:1746126616.038754:0:20294:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126613 -> 1746126615 00000100:00100000:3.0:1746126616.038764:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721376256:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126616.038764:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721376512:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126616.038776:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e664600/0xb50e8258676139b8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce7 expref: 35 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.038780:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9c00/0xb50e8258676139c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcfc expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.038784:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e664600/0xb50e8258676139b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce7 expref: 35 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.038789:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9c00/0xb50e8258676139c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcfc expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.038791:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e664600, rc 0) 00010000:00010000:1.0:1746126616.038811:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c9c00, rc 0) 00000100:00100000:3.0:1746126616.038820:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721478784:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6879us (7010us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126616.038842:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13565 00000100:00100000:1.0:1746126616.038846:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721479168:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5757us (6041us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126616.038851:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13567 00000100:00100000:3.0:1746126616.038858:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721479552 00000100:00100000:3.0:1746126616.038862:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721479552 00010000:00010000:3.0:1746126616.038877:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 34 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746126616.038879:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721376384:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126616.038891:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e8258676139bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcee expref: 21 pid: 4640 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126616.038893:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7070 00010000:00010000:1.0:1746126616.038898:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c8c00/0xb50e8258676139bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcee expref: 21 pid: 4640 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126616.038899:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721479552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126616.038904:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8c00, rc 0) 00010000:00010000:3.0:1746126616.038907:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.038915:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 34 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746126616.038919:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721478912:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5925us (6508us total) trans 0 rc 301/301 00010000:00010000:3.0:1746126616.038923:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 34 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746126616.038924:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13566 00010000:00010000:3.0:1746126616.038938:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e8258676139a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd2 expref: 34 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746126616.038940:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721479424 00000100:00100000:1.0:1746126616.038943:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721479424 00010000:00010000:3.0:1746126616.038947:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.038949:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.038954:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.038961:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746126616.038962:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1212416->1216511) req@ffff880093af4700 x1830945721479424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746126616.038983:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.038994:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721376768:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126616.039027:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00002000:00100000:1.0:1746126616.039075:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4700 with x1830945721479424 ext(1212416->1216511) 00002000:00010000:1.0:1746126616.039080:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4700 00000100:00100000:1.0:1746126616.039094:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7750 00000100:00100000:1.0:1746126616.039099:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721479424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126616.039242:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721479424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 142us (570us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126616.039247:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7750 00002000:00100000:1.0:1746126616.039252:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1212416->1216511) req@ffff880093af4700 x1830945721479424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/4536 e 0 to 0 dl 1746126627 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126616.039259:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4700 with x1830945721479424 ext(1212416->1216511) 00002000:00010000:1.0:1746126616.039262:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4700 00000100:00100000:3.0:1746126616.043888:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721376768:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126616.043906:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126616.043953:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721479552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5054us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.043962:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7070 00000100:00100000:0.0:1746126616.046481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.046932:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721479936 00000100:00100000:3.0:1746126616.046940:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721479936 00000100:00100000:3.0:1746126616.046982:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13569 00000100:00100000:3.0:1746126616.046989:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721479936:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126616.047002:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126616.047016:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e664000/0xb50e8258676139d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd03 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.047055:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721376896:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126616.047131:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126616.047358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.047390:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721480192 00000100:00100000:2.0:1746126616.047394:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721480192 00002000:00100000:2.0:1746126616.047415:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88012b161880 x1830945721480192/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.047423:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161880 with x1830945721480192 ext(4194304->4976639) 00002000:00010000:2.0:1746126616.047427:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b161880 00000100:00100000:2.0:1746126616.047439:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7751 00000100:00100000:2.0:1746126616.047444:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721480192:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126616.049905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.050675:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721480448 00000100:00100000:3.0:1746126616.050682:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721480448 00002000:00100000:3.0:1746126616.050710:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1679360->1683455) req@ffff88012b163480 x1830945721480448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.050718:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163480 with x1830945721480448 ext(1679360->1683455) 00002000:00010000:3.0:1746126616.050723:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b163480 00000100:00100000:3.0:1746126616.050752:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7752 00000100:00100000:3.0:1746126616.050759:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721480448:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126616.051986:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721480448:12345-192.168.203.2@tcp:3:cat.0 Request processed in 1223us (2082us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126616.051993:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7752 00002000:00100000:3.0:1746126616.051999:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1679360->1683455) req@ffff88012b163480 x1830945721480448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/4536 e 0 to 0 dl 1746126627 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.052006:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163480 with x1830945721480448 ext(1679360->1683455) 00002000:00010000:3.0:1746126616.052010:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b163480 00000100:00100000:3.0:1746126616.053108:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721376896:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126616.053133:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e664000/0xb50e8258676139d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd03 expref: 34 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.053144:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e664000/0xb50e8258676139d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd03 expref: 34 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.053153:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e664000, rc 0) 00000100:00100000:3.0:1746126616.053188:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721479936:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6198us (6711us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126616.053198:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13569 00000100:00100000:2.0:1746126616.057794:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721480192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10341us (10428us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126616.057803:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7751 00002000:00100000:2.0:1746126616.057811:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88012b161880 x1830945721480192/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/440 e 0 to 0 dl 1746126627 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.057818:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161880 with x1830945721480192 ext(4194304->4976639) 00002000:00010000:2.0:1746126616.057823:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b161880 00000100:00100000:0.0:1746126616.061190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.061344:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721480576 00000100:00100000:3.0:1746126616.061351:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721480576 00000100:00100000:3.0:1746126616.061389:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13570 00000100:00100000:3.0:1746126616.061395:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31293:x1830945721480576:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126616.061408:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126616.061421:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd0a expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.061443:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 19 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.061449:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126616.061451:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126616.061454:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.061478:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 19 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.061487:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 19 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126616.061498:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721377024:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126616.061876:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126616.062643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.062963:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721480704 00000100:00100000:1.0:1746126616.062967:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721480704 00000100:00100000:1.0:1746126616.063002:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13571 00000100:00100000:1.0:1746126616.063008:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721480704:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126616.063016:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.063025:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e8258676139e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd11 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.063052:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721377152:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126616.063113:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126616.064253:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721377024:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.064393:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 18 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.064403:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e665c00, rc 0) 00000100:00100000:3.0:1746126616.064430:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31293:x1830945721480576:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3036us (3246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.064436:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13570 00000100:00100000:0.0:1746126616.065392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.065524:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721480832 00000100:00100000:2.0:1746126616.065529:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721480832 00002000:00100000:2.0:1746126616.065557:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1216511) req@ffff88012b162680 x1830945721480832/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126616.065565:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b162680 with x1830945721480832 ext(1048576->1216511) 00010000:00010000:2.0:1746126616.065572:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 20 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746126616.065582:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 20 pid: 4642 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746126616.065587:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b162680 00000100:00100000:2.0:1746126616.065613:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1769 00000100:00100000:2.0:1746126616.065619:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721480832:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126616.066057:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721377152:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126616.066085:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e8258676139e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd11 expref: 17 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.066094:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9000/0xb50e8258676139e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd11 expref: 17 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.066117:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c9000, rc 0) 00000100:00100000:1.0:1746126616.066140:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721480704:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3132us (3498us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126616.066145:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13571 00000100:00100000:2.0:1746126616.068594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.068708:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721480960 00000100:00100000:1.0:1746126616.068713:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721480960 00000100:00100000:1.0:1746126616.068749:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13572 00000100:00100000:1.0:1746126616.068754:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721480960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126616.068765:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.068778:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9600/0xb50e8258676139e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd18 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.068813:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721377280:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126616.068885:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126616.069302:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721480832:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3681us (3911us total) trans 21474840361 rc 0/0 00000100:00100000:3.0:1746126616.069310:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1769 00002000:00100000:3.0:1746126616.069317:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1216511) req@ffff88012b162680 x1830945721480832/t21474840361(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:377/0 lens 488/448 e 0 to 0 dl 1746126627 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.069325:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b162680 with x1830945721480832 ext(1048576->1216511) 00010000:00010000:3.0:1746126616.069331:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 22 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126616.069345:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 22 pid: 4642 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746126616.069351:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b162680 00000100:00100000:1.0:1746126616.070126:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721377280:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126616.070145:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9600/0xb50e8258676139e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd18 expref: 17 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.070154:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0c9600/0xb50e8258676139e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd18 expref: 17 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.070162:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c9600, rc 0) 00000100:00100000:1.0:1746126616.070341:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721480960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1586us (1752us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126616.070347:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13572 00000100:00100000:0.0:1746126616.070719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.070963:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721481088 00000100:00100000:3.0:1746126616.070968:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721481088 00010000:00010000:3.0:1746126616.070986:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 22 pid: 4642 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746126616.071003:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7071 00000100:00100000:3.0:1746126616.071009:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721481088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126616.071018:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.071027:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 22 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126616.071035:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 22 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126616.071049:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e665a00/0xb50e8258676139b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dce0 expref: 22 pid: 4642 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746126616.071077:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.071079:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.071084:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.071090:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.071112:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.071121:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721377408:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126616.071173:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126616.074364:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721377408:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126616.074379:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126616.074423:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721481088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3413us (3703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.074432:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7071 00000100:00100000:0.0:1746126616.078395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.078459:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721481344 00000100:00100000:3.0:1746126616.078465:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721481344 00002000:00100000:3.0:1746126616.078496:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1503232->1507327) req@ffff88012b160000 x1830945721481344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.078504:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b160000 with x1830945721481344 ext(1503232->1507327) 00002000:00010000:3.0:1746126616.078508:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b160000 00000100:00100000:3.0:1746126616.078523:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7753 00000100:00100000:3.0:1746126616.078529:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721481344:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126616.078667:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721481344:12345-192.168.203.2@tcp:3:cat.0 Request processed in 137us (278us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126616.078673:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7753 00002000:00100000:3.0:1746126616.078678:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1503232->1507327) req@ffff88012b160000 x1830945721481344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/4536 e 0 to 0 dl 1746126627 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.078684:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b160000 with x1830945721481344 ext(1503232->1507327) 00002000:00010000:3.0:1746126616.078686:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b160000 00000100:00100000:0.0:1746126616.090382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.090642:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721481472 00000100:00100000:1.0:1746126616.090650:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721481472 00000100:00080000:2.0:1746126616.091325:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126616.091359:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8948 00000100:00100000:1.0:1746126616.091366:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31300:x1830945721481472:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126616.091386:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.091399:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9600/0xb50e8258676139f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd1f expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.091439:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091449:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091457:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091466:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091471:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091475:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091560:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091569:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.091578:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.091588:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.091609:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.091616:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 223 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.091624:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721377536:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.091785:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.091796:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 8 pid: 14549 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.091803:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721377664:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.091882:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126616.093754:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721377536:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.093785:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721377664:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126616.093785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126616.093802:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126616.093825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.093929:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721481728 00000100:00100000:2.0:1746126616.093935:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721481728 00000100:00100000:3.0:1746126616.093981:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721481984 00000100:00100000:3.0:1746126616.093984:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721481984 00000100:00100000:2.0:1746126616.094032:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3786 00000100:00100000:2.0:1746126616.094039:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:26822:x1830945721481728:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126616.094168:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3787 00000100:00100000:3.0:1746126616.094172:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d990850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:27349:x1830945721481984:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746126616.094404:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+225:26822:x1830945721481728:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 365us (618us total) trans 8589943130 rc 0/0 00000100:00100000:2.0:1746126616.094410:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3786 00000100:00080000:0.0:1746126616.094461:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746126616.094585:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d990850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:27349:x1830945721481984:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 412us (759us total) trans 8589943131 rc 0/0 00000100:00100000:3.0:1746126616.094590:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3787 00000100:00100000:0.0:1746126616.095947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.096006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.096039:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721482112 00000100:00100000:3.0:1746126616.096043:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721482112 00000100:00100000:1.0:1746126616.096060:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721482240 00010000:00010000:3.0:1746126616.096061:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 10 pid: 14549 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.096062:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721482240 00010000:00010000:1.0:1746126616.096084:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 225 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746126616.096216:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7072 00000100:00100000:3.0:1746126616.096222:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721482112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126616.096231:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.096235:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 10 pid: 14549 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746126616.096249:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 10 pid: 14549 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746126616.096265:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009367f600/0xb50e825867613925 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc70 expref: 10 pid: 14549 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746126616.096275:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126616.096279:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126616.096285:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126616.096289:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126616.096293:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126616.096313:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7073 00000100:00100000:1.0:1746126616.096319:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+225:1963:x1830945721482240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126616.096325:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126616.096328:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 225 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.096337:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 225 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.096347:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44600/0xb50e825867613933 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc77 expref: 225 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.096366:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126616.096369:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096375:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126616.096379:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721482112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 158us (435us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126616.096380:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126616.096387:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7072 00010000:00010000:1.0:1746126616.096395:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126616.096408:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:1963:x1830945721482240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 90us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.096461:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7073 00010000:00010000:1.0:1746126616.096477:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096486:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126616.096510:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126616.096513:0:15560:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126616.096523:0:15560:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096531:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096538:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096543:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096548:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096552:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0c8200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126616.096555:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096560:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096566:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126616.096568:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126616.096570:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096574:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8200/0xb50e8258676139f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096582:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096586:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096590:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096594:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0c9000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126616.096596:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096600:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096605:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215100) 00010000:00010000:1.0:1746126616.096607:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126616.096609:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096613:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9000/0xb50e8258676139fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.096636:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c9600/0xb50e8258676139f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.096647:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.096652:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126616.096654:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126616.096656:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8e00, rc 0) 00000100:00100000:1.0:1746126616.096689:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31300:x1830945721481472:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 5323us (6313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.096694:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8948 00000100:00100000:0.0:1746126616.099799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.099904:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721482368 00000100:00100000:1.0:1746126616.099911:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721482368 00000100:00100000:1.0:1746126616.099944:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13573 00000100:00100000:1.0:1746126616.099950:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721482368:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126616.099962:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.099976:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8000/0xb50e825867613a0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd26 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.100016:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721377792:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126616.100100:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126616.101191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.101592:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721482496 00000100:00100000:2.0:1746126616.101596:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721482496 00000100:00100000:2.0:1746126616.101626:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13574 00000100:00100000:2.0:1746126616.101631:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721482496:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126616.101640:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126616.101651:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927e1000/0xb50e825867613a13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd2d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126616.101678:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721377920:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126616.102462:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126616.103693:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721377792:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126616.103715:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8000/0xb50e825867613a0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd26 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.103725:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0c8000/0xb50e825867613a0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd26 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.103737:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8000, rc 0) 00000100:00100000:2.0:1746126616.103766:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721482368:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3816us (4850us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126616.103772:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13573 00000100:00100000:2.0:1746126616.105955:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721377920:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126616.105979:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927e1000/0xb50e825867613a13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd2d expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.105991:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927e1000/0xb50e825867613a13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd2d expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.105998:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927e1000, rc 0) 00000100:00100000:2.0:1746126616.106038:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721482496:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 4406us (4847us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126616.106045:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13574 00000100:00100000:0.0:1746126616.108357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.108568:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721482752 00000100:00100000:1.0:1746126616.108575:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721482752 00000100:00100000:1.0:1746126616.108624:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8949 00000100:00100000:1.0:1746126616.108631:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31300:x1830945721482752:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126616.108646:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.108660:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8800/0xb50e825867613a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd34 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.108733:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.108748:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.108759:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.108789:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.108798:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 8 pid: 15560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.108809:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721378048:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.108906:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126616.110394:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721378048:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.110411:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126616.110888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.111019:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721482880 00000100:00100000:1.0:1746126616.111023:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721482880 00010000:00010000:1.0:1746126616.111042:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 9 pid: 15560 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.111077:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7074 00000100:00100000:1.0:1746126616.111083:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721482880:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126616.111091:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126616.111096:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 9 pid: 15560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.111104:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 9 pid: 15560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.111120:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8e00/0xb50e825867613a05 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd1f expref: 9 pid: 15560 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.111131:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126616.111135:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.111142:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.111147:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.111159:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126616.111183:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721482880:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.111188:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7074 00010000:00010000:0.0:1746126616.111449:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126616.111456:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126616.111469:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126616.111562:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8800/0xb50e825867613a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd34 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.111575:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd34 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.111580:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126616.111582:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126616.111585:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0c8600, rc 0) 00000100:00100000:0.0:1746126616.111672:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31300:x1830945721482752:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3041us (3320us total) trans 8589943132 rc 0/0 00000100:00100000:0.0:1746126616.111678:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8949 00000100:00100000:2.0:1746126616.115421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.115520:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483136 00000100:00100000:0.0:1746126616.115527:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483136 00000100:00100000:0.0:1746126616.115673:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8950 00000100:00100000:0.0:1746126616.115680:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31300:x1830945721483136:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126616.115697:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126616.115699:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746126616.115719:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0c8600/0xb50e825867613a21 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd34 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.115853:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126616.115857:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126616.115868:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391600/0xb50e825867613a2f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd3b expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.115933:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391800/0xb50e825867613a36 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126616.115943:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391800/0xb50e825867613a36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126616.115952:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391800/0xb50e825867613a36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126616.115960:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126616.116047:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391600/0xb50e825867613a2f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd3b expref: 10 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.116060:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391800/0xb50e825867613a36 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd3b expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.116076:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126616.116078:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126616.116080:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b391800, rc 0) 00000100:00100000:0.0:1746126616.116125:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721483136:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 445us (710us total) trans 8589943133 rc 0/0 00000100:00100000:0.0:1746126616.116133:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8950 00000100:00100000:2.0:1746126616.118147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.118231:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483264 00000100:00100000:0.0:1746126616.118237:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483264 00000100:00100000:0.0:1746126616.118263:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8951 00000100:00100000:0.0:1746126616.118268:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721483264:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126616.118282:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126616.118294:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390e00/0xb50e825867613a44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd42 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.118333:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390e00/0xb50e825867613a44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd42 expref: 10 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.118343:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390e00/0xb50e825867613a44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd42 expref: 10 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.118354:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126616.118357:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126616.118359:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b390e00, rc 0) 00000100:00100000:0.0:1746126616.118397:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31300:x1830945721483264:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.118403:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8951 00000100:00100000:0.0:1746126616.120181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.120408:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483520 00000100:00100000:2.0:1746126616.120413:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483520 00000100:00100000:0.0:1746126616.120429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.121044:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483776 00000100:00100000:2.0:1746126616.121048:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483776 00000100:00100000:2.0:1746126616.121084:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13575 00000100:00100000:2.0:1746126616.121091:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721483520:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126616.121183:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.121588:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13576 00000100:00100000:1.0:1746126616.121596:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721483776:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126616.121615:0:20294:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.121627:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.121634:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126616.121635:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126616.121637:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.121641:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.121650:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 32 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.121657:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.121662:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.121663:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.121663:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 15 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.121665:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.121673:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 15 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746126616.121681:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126616.121684:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721378176:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.121689:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 17 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.121698:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721378304:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.121823:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19240 going to sleep for 11 seconds 00010000:00010000:2.0:1746126616.121841:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 32 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.121849:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 32 pid: 17475 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.121861:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721378432:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.121976:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.121984:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 8 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.121991:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721378560:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126616.122012:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126616.122132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.122180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.122190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.122206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.122260:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484032 00000100:00100000:3.0:1746126616.122264:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484032 00000100:00100000:3.0:1746126616.122279:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483392 00000100:00100000:3.0:1746126616.122280:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483392 00000100:00100000:2.0:1746126616.122285:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483648 00000100:00100000:3.0:1746126616.122288:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721483904 00000100:00100000:2.0:1746126616.122288:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483648 00000100:00100000:3.0:1746126616.122290:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721483904 00000100:00100000:3.0:1746126616.122300:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13577 00000100:00100000:2.0:1746126616.122304:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13578 00000100:00100000:3.0:1746126616.122305:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721484032:12345-192.168.203.2@tcp:1:mirror_io.0 00000100:00100000:2.0:1746126616.122309:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721483392:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126616.122324:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.122333:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.122339:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 20 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126616.122341:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13579 00010000:00010000:2.0:1746126616.122345:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126616.122346:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721483904:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126616.122354:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.122356:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.122358:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.122362:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.122371:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.122372:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.122378:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.122379:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 15 pid: 4641 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746126616.122383:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126616.122387:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721378688:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.122388:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.122389:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.122391:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.122413:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 20 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.122419:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 20 pid: 17475 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.122425:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721378816:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.122440:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.122445:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 9 pid: 8437 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.122456:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721378944:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126616.122465:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126616.122476:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13580 00000100:00100000:2.0:1746126616.122480:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721483648:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126616.122492:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.122500:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.122506:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126616.122507:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126616.122509:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.122518:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.122524:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.122530:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721379072:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126616.122541:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195dd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746126616.122671:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.122683:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.122689:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.122697:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.122701:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.122702:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.122704:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.122716:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.122727:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 17 pid: 4641 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.122734:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721379200:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.122771:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.122777:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.122783:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721379328:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.122798:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126616.122803:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 10 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.122809:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721379456:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126616.122818:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00010000:00010000:1.0:1746126616.122881:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.122888:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 15 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746126616.122894:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721379584:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.122929:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.122935:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746126616.122940:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721379712:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.122955:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.122961:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 9 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746126616.122967:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721379840:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.122976:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126616.124324:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721378176:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126616.124500:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721378304:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.124534:0:20294:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126616.129013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.129035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.129099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.129111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.129123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.129159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.129177:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484160 00000100:00100000:0.0:1746126616.129183:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484160 00010000:00010000:0.0:1746126616.129210:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 18 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.129227:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484416 00000100:00100000:0.0:1746126616.129229:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484416 00010000:00010000:0.0:1746126616.129237:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 33 pid: 17475 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130171:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484672 00000100:00100000:0.0:1746126616.130175:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484672 00010000:00010000:0.0:1746126616.130191:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 16 pid: 4641 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130204:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484544 00000100:00100000:0.0:1746126616.130206:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484544 00010000:00010000:0.0:1746126616.130213:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130220:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484800 00000100:00100000:0.0:1746126616.130222:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484800 00010000:00010000:0.0:1746126616.130229:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 21 pid: 17475 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130238:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7075 00000100:00100000:0.0:1746126616.130244:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721484160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130255:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130273:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 18 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130282:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 18 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130301:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5102800/0xb50e8258676138f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc4d expref: 18 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130319:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.130355:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721484160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 111us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.130361:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7075 00000100:00100000:0.0:1746126616.130374:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7076 00000100:00100000:0.0:1746126616.130379:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721484416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130384:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130391:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 33 pid: 17475 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130399:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 33 pid: 17475 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130408:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.130421:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721484416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 42us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.130426:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7076 00000100:00100000:0.0:1746126616.130457:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7077 00000100:00100000:0.0:1746126616.130461:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721484672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130468:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130479:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 16 pid: 4641 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130486:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 16 pid: 4641 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130498:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.130511:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721484672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 49us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.130516:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7077 00000100:00100000:0.0:1746126616.130525:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7078 00000100:00100000:0.0:1746126616.130529:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721484544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130535:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130542:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130549:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130558:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.130560:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.130563:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.130570:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.130583:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.130594:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721484544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.130598:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7078 00000100:00100000:0.0:1746126616.130606:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7079 00000100:00100000:0.0:1746126616.130610:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721484800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130615:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130621:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 21 pid: 17475 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130633:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 21 pid: 17475 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130642:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.130652:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721484800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 42us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.130656:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7079 00000100:00100000:0.0:1746126616.130690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.130694:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484288 00000100:00100000:1.0:1746126616.130698:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484288 00002000:00100000:1.0:1746126616.130723:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1507327) req@ffff8800a5955f80 x1830945721484288/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746126616.130725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:1.0:1746126616.130731:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5955f80 with x1830945721484288 ext(1048576->1507327) 00010000:00010000:1.0:1746126616.130736:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746126616.130744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126616.130745:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746126616.130751:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5955f80 00000100:00100000:0.0:1746126616.130759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.130766:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1770 00000100:00100000:1.0:1746126616.130771:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721484288:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126616.130790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.130842:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485056 00000100:00100000:0.0:1746126616.130845:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485056 00010000:00010000:0.0:1746126616.130856:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 17 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130866:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485312 00000100:00100000:0.0:1746126616.130867:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485312 00010000:00010000:0.0:1746126616.130874:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 10 pid: 8437 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130881:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721484928 00000100:00100000:0.0:1746126616.130883:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721484928 00010000:00010000:0.0:1746126616.130889:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130901:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485184 00000100:00100000:0.0:1746126616.130902:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485184 00010000:00010000:0.0:1746126616.130907:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.130916:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7080 00000100:00100000:0.0:1746126616.130920:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721485056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130924:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130932:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 17 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130939:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 17 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130948:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.130962:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721485056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 42us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.130966:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7080 00000100:00100000:0.0:1746126616.130973:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7081 00000100:00100000:0.0:1746126616.130977:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721485312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.130982:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.130987:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 11 pid: 8437 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.130994:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 11 pid: 8437 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.131003:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.131005:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.131007:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.131014:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.131022:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.131030:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721485312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.131034:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7081 00000100:00100000:0.0:1746126616.131041:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7082 00000100:00100000:0.0:1746126616.131044:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721484928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.131049:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.131056:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.131063:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 11 pid: 8438 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.131085:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.131096:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721484928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.131100:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7082 00000100:00100000:0.0:1746126616.131108:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7083 00000100:00100000:0.0:1746126616.131112:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721485184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.131117:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.131122:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 10 pid: 8438 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.131129:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 10 pid: 8438 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.131136:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.131144:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721485184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.131148:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7083 00010000:00010000:1.0:1746126616.131191:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8200/0xb50e825867613917 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc62 expref: 17 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746126616.131205:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721379584:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126616.131214:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721379712:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.131223:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad6a800/0xb50e82586761385a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc2a expref: 9 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746126616.131230:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721379840:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126616.131249:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.131616:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721379200:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126616.131624:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721379328:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.131635:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad6bc00/0xb50e82586761386f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc31 expref: 10 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.131651:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721379456:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.131663:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.131682:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485440 00000100:00100000:3.0:1746126616.131685:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485440 00002000:00100000:3.0:1746126616.131699:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1679360->2097151) req@ffff88012b190e00 x1830945721485440/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/0 e 0 to 0 dl 1746126627 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.131706:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b190e00 with x1830945721485440 ext(1679360->2097151) 00010000:00010000:3.0:1746126616.131710:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746126616.131718:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 17 pid: 4642 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746126616.131723:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b190e00 00000100:00100000:3.0:1746126616.131735:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1771 00000100:00100000:3.0:1746126616.131739:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721485440:12345-192.168.203.2@tcp:4:cat.0 00010000:00010000:3.0:1746126616.132147:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb56600/0xb50e825867613941 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc85 expref: 32 pid: 17475 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.132156:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721378432:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.132165:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099079200/0xb50e82586761384c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc15 expref: 9 pid: 8438 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.132172:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721378560:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126616.132185:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132192:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132197:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132211:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132217:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132224:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132230:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927e1600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126616.132233:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132239:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132249:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.132253:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927e1600/0xb50e825867613a4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132275:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5102200/0xb50e825867613909 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc46 expref: 16 pid: 4641 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.132284:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721483520:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 11194us (12107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.132290:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13575 00000100:00100000:2.0:1746126616.132292:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721378688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.132300:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb56c00/0xb50e82586761393a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc7e expref: 20 pid: 17475 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.132307:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721378816:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.132314:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613853 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc0e expref: 8 pid: 8437 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746126616.132321:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721378944:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.132332:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132338:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132343:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132355:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132360:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132369:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132373:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a45ca200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126616.132375:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132380:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132388:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.132393:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a45ca200/0xb50e825867613a59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126616.132421:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721483392:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 10111us (10240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.132427:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13578 00000100:00100000:2.0:1746126616.132455:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721379072:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.132462:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126616.132705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.132732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.132899:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485568 00000100:00100000:0.0:1746126616.132904:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485568 00010000:00010000:0.0:1746126616.132917:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 19 pid: 4641 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.132933:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485696 00000100:00100000:0.0:1746126616.132939:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485696 00010000:00010000:0.0:1746126616.132947:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746126616.132959:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7084 00000100:00100000:0.0:1746126616.132964:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721485568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.132972:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.132982:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 19 pid: 4641 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.132995:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 19 pid: 4641 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.133006:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5102400/0xb50e825867613902 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc69 expref: 19 pid: 4641 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.133015:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.133047:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721485568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.133052:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7084 00000100:00100000:0.0:1746126616.133063:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7085 00000100:00100000:0.0:1746126616.133076:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721485696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.133083:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.133091:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.133098:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.133108:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e825867613956 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dc9a expref: 20 pid: 10890 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746126616.133116:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.133117:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.133119:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.133125:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.133148:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126616.133166:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126616.133166:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721485696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 89us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.133170:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7085 00010000:00010000:1.0:1746126616.133174:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133186:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133192:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133198:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133203:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098dd4400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126616.133205:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133211:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133220:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.133230:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098dd4400/0xb50e825867613a60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126616.133263:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721483904:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 10916us (11055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.133268:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13579 00000100:00100000:2.0:1746126616.139439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.139500:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485824 00000100:00100000:3.0:1746126616.139508:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485824 00010000:00010000:3.0:1746126616.139535:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746126616.139558:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7086 00000100:00100000:3.0:1746126616.139564:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721485824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126616.139574:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126616.139590:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:3.0:1746126616.139599:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:3.0:1746126616.139617:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5102600/0xb50e82586761395d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dca1 expref: 32 pid: 8436 timeout: 838 lvb_type: 1 00010000:00010000:3.0:1746126616.139631:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.139633:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126616.139636:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139642:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139660:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126616.139673:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139678:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139693:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139699:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139704:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139709:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e665e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126616.139712:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139722:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139731:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.139736:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e665e00/0xb50e825867613a6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126616.139781:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721484032:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 17475us (17649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.139787:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13577 00000100:00100000:3.0:1746126616.139808:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721485824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 245us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.139813:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7086 00000100:00100000:1.0:1746126616.144401:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721484288:12345-192.168.203.2@tcp:4:cat.0 Request processed in 13621us (15386us total) trans 21474840362 rc 0/0 00000100:00100000:1.0:1746126616.144411:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1770 00002000:00100000:1.0:1746126616.144421:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1507327) req@ffff8800a5955f80 x1830945721484288/t21474840362(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/448 e 0 to 0 dl 1746126627 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126616.144429:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5955f80 with x1830945721484288 ext(1048576->1507327) 00010000:00010000:1.0:1746126616.144438:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.144448:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746126616.144454:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5955f80 00000100:00100000:3.0:1746126616.145738:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721485440:12345-192.168.203.2@tcp:4:cat.0 Request processed in 13995us (14944us total) trans 17179873213 rc 0/0 00000100:00100000:3.0:1746126616.145745:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1771 00002000:00100000:3.0:1746126616.145750:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1679360->2097151) req@ffff88012b190e00 x1830945721485440/t17179873213(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:377/0 lens 488/448 e 0 to 0 dl 1746126627 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126616.145756:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b190e00 with x1830945721485440 ext(1679360->2097151) 00010000:00010000:3.0:1746126616.145763:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746126616.145775:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746126616.145780:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b190e00 00000100:00100000:1.0:1746126616.149964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126616.149993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.150147:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721485952 00000100:00100000:2.0:1746126616.150154:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721485952 00010000:00010000:2.0:1746126616.150181:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.150200:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486080 00000100:00100000:2.0:1746126616.150202:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486080 00000100:00100000:0.0:1746126616.150211:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7087 00010000:00010000:2.0:1746126616.150212:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746126616.150221:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721485952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.150232:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126616.150234:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7088 00000100:00100000:2.0:1746126616.150238:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721486080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126616.150247:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.150250:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746126616.150259:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746126616.150261:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746126616.150268:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746126616.150279:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e664400/0xb50e8258676139aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcd9 expref: 18 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746126616.150279:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e665c00/0xb50e8258676139db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd0a expref: 16 pid: 4642 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746126616.150293:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.150294:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.150298:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.150304:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126616.150324:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126616.150333:0:20294:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.150340:0:20294:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126616.150355:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721485952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 137us (397us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126616.150357:0:20294:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126616.150360:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7087 00010000:00010000:1.0:1746126616.150364:0:20294:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.150369:0:20294:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.150374:0:20294:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eae9400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126616.150378:0:20294:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.150383:0:20294:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.150391:0:20294:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.150397:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eae9400/0xb50e825867613a52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150429:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.150431:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.150434:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150444:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150458:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126616.150475:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721486080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 236us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.150481:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7088 00010000:00010000:2.0:1746126616.150495:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150502:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150514:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150520:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150525:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150530:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbbe00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126616.150532:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150541:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150549:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.150553:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126616.150588:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721483648:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 28107us (28396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.150594:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13580 00000100:00100000:1.0:1746126616.150657:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1963:x1830945721483776:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 29062us (30227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.150663:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13576 00000100:00100000:0.0:1746126616.161646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.161716:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486336 00000100:00100000:2.0:1746126616.161725:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486336 00000100:00100000:2.0:1746126616.161770:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8952 00000100:00100000:2.0:1746126616.161776:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31300:x1830945721486336:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:2.0:1746126616.161813:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126616.161858:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b390e00/0xb50e825867613a44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd42 expref: 10 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.161873:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126616.161876:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126616.161899:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126616.161909:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.161916:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 223 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.161922:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.161928:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126616.161953:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.161963:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 8 pid: 20362 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.161974:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721379968:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.162878:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 223 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.162887:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 223 pid: 14547 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.162896:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721380096:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.162929:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.162936:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 223 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.162943:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721380224:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126616.162957:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126616.168405:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721379968:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126616.169278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.169368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.169444:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721380096:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126616.169453:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721380224:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126616.169472:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:1.0:1746126616.169535:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486464 00000100:00100000:1.0:1746126616.169540:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486464 00010000:00010000:1.0:1746126616.169565:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 9 pid: 20362 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.169583:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486592 00000100:00100000:1.0:1746126616.169585:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486592 00010000:00010000:1.0:1746126616.169593:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 224 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746126616.169605:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7089 00000100:00100000:1.0:1746126616.169610:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721486464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126616.169619:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126616.169623:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 9 pid: 20362 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.169631:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 9 pid: 20362 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746126616.169764:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7090 00000100:00100000:0.0:1746126616.169771:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+224:1963:x1830945721486592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126616.169777:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126616.169781:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 224 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746126616.170040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126616.172593:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c59400/0xb50e825867613995 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcc4 expref: 9 pid: 20362 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.172835:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486720 00000100:00100000:2.0:1746126616.172843:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486720 00010000:00010000:2.0:1746126616.172869:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 225 pid: 14547 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746126616.172893:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7091 00000100:00100000:2.0:1746126616.172898:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+225:1964:x1830945721486720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126616.172908:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126616.172913:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 225 pid: 14547 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746126616.173345:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 225 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746126616.173378:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126616.173383:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126616.173461:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e4abe00/0xb50e825867613987 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcb6 expref: 225 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746126616.173475:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126616.173478:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126616.173484:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126616.173526:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+224:1963:x1830945721486592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3755us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.173535:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7090 00010000:00010000:2.0:1746126616.173670:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 223 pid: 14547 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746126616.173682:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19000/0xb50e82586761398e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dcbd expref: 223 pid: 14547 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746126616.173697:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126616.173700:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126616.173704:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126616.173709:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126616.173726:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126616.173745:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+222:1964:x1830945721486720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 846us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.173750:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7091 00010000:00010000:1.0:1746126616.173785:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126616.173803:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721486464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4192us (4527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.173808:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7089 00010000:00010000:3.0:1746126616.173897:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126616.173903:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000040:00080000:3.0:1746126616.174414:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2652, 88 off225232 00000004:00080000:3.0:1746126616.174421:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088592738ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174454:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2768, 88 off235536 00000004:00080000:3.0:1746126616.174458:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088629941ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174467:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2769, 88 off235624 00000004:00080000:3.0:1746126616.174469:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088641868ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174476:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2653, 88 off225320 00000004:00080000:3.0:1746126616.174478:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088650515ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174484:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2654, 88 off225408 00000004:00080000:3.0:1746126616.174486:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088658276ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174491:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2770, 88 off235712 00000004:00080000:3.0:1746126616.174493:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088665853ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174499:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2771, 88 off235800 00000004:00080000:3.0:1746126616.174501:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088673828ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174506:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2655, 88 off225496 00000004:00080000:3.0:1746126616.174508:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088680886ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174515:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2772, 88 off235888 00000004:00080000:3.0:1746126616.174517:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088689268ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174522:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2656, 88 off225584 00000004:00080000:3.0:1746126616.174524:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088696878ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174530:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2773, 88 off235976 00000004:00080000:3.0:1746126616.174533:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088705705ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174539:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2657, 88 off225672 00000004:00080000:3.0:1746126616.174541:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088713270ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174546:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2774, 88 off236064 00000004:00080000:3.0:1746126616.174549:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088720891ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174554:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2658, 88 off225760 00000004:00080000:3.0:1746126616.174556:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088729128ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126616.174562:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2775, 88 off236152 00000004:00080000:3.0:1746126616.174564:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088736908ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174570:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2776, 88 off236240 00000004:00080000:3.0:1746126616.174572:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738088744570ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126616.174578:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2659, 88 off225848 00000004:00080000:3.0:1746126616.174580:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738088752695ns, next at 687927188999ns, rc = 0 00000004:00010000:3.0:1746126616.223982:0:15560:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b192680 reply state ffff8800924ea400 transno 8589943134 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126616.223996:0:15560:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746126616.224102:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31300:x1830945721486336:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 62322us (62461us total) trans 8589943134 rc 0/0 00000100:00100000:3.0:1746126616.224110:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8952 00000001:00080000:1.0:1746126616.224123:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943133 is committed 00000001:00080000:1.0:1746126616.224135:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943130 is committed 00000001:00080000:1.0:1746126616.224143:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943134 is committed 00000004:00080000:1.0:1746126616.224146:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2044 committed 00000004:00080000:1.0:1746126616.224150:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2158 committed 00000004:00080000:1.0:1746126616.224154:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2157 committed 00000004:00080000:1.0:1746126616.224155:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2043 committed 00000004:00080000:1.0:1746126616.224157:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2156 committed 00000004:00080000:1.0:1746126616.224158:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2042 committed 00000004:00080000:1.0:1746126616.224160:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2155 committed 00000004:00080000:1.0:1746126616.224161:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2041 committed 00000004:00080000:1.0:1746126616.224164:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2154 committed 00000004:00080000:1.0:1746126616.224166:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2040 committed 00000004:00080000:1.0:1746126616.224167:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2153 committed 00000004:00080000:1.0:1746126616.224168:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2152 committed 00000004:00080000:1.0:1746126616.224170:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746126616.224171:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746126616.224172:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2151 committed 00000004:00080000:1.0:1746126616.224174:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2150 committed 00000004:00080000:1.0:1746126616.224175:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2037 committed 00000001:00080000:1.0:1746126616.224178:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943131 is committed 00010000:00010000:1.0:1746126616.224190:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.224197:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.224203:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.224208:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbaa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126616.224212:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.224218:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.224230:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126616.224232:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126616.224235:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126616.224240:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867613a75 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126616.224314:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721380352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.224357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126616.224374:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721380480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.224394:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721380864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126616.224396:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126616.224411:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126616.224413:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721380992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.224421:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721381376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.224425:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126616.224434:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126616.224436:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721381504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.224444:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721381888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.224447:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126616.224457:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721380736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126616.224464:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721382016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.224471:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126616.224480:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721380608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.224486:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721381248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126616.224494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126616.224504:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380352 00000100:00100000:1.0:1746126616.224508:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721381120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.224509:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380352 00000100:00100000:1.0:1746126616.224520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126616.224529:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721381632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.224535:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380480 00000100:00100000:3.0:1746126616.224537:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380480 00000100:00100000:1.0:1746126616.224538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126616.224544:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380864 00000100:00100000:3.0:1746126616.224545:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380864 00000100:00100000:1.0:1746126616.224547:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721382144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.224550:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380992 00000100:00100000:3.0:1746126616.224552:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380992 00000100:00100000:3.0:1746126616.224556:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381376 00000100:00100000:3.0:1746126616.224558:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381376 00000100:00100000:1.0:1746126616.224559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126616.224566:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381504 00000100:00100000:3.0:1746126616.224567:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381504 00000100:00100000:3.0:1746126616.224573:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380736 00000100:00100000:3.0:1746126616.224574:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380736 00000100:00100000:1.0:1746126616.224574:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721380608 00000100:00100000:1.0:1746126616.224577:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721380608 00000100:00100000:3.0:1746126616.224580:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381120 00000100:00100000:3.0:1746126616.224581:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381120 00000100:00100000:3.0:1746126616.224588:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381632 00000100:00100000:3.0:1746126616.224589:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381632 00000100:00100000:1.0:1746126616.224590:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382144 00000100:00100000:1.0:1746126616.224592:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382144 00000100:00100000:3.0:1746126616.224597:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13581 00000100:00100000:3.0:1746126616.224602:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3296:x1830945721380352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.224760:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3296:x1830945721380352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (401us total) trans 21474840363 rc 0/0 00000100:00080000:0.0:1746126616.224841:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126616.224845:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126616.225218:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13582 00000100:00100000:1.0:1746126616.225226:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721380480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126616.225325:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3297:x1830945721380480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (928us total) trans 21474840364 rc 0/0 00000100:00100000:1.0:1746126616.225330:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13582 00000100:00100000:1.0:1746126616.225340:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13583 00000100:00100000:1.0:1746126616.225344:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3296:x1830945721380864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126616.225415:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830945721380864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1002us total) trans 21474840365 rc 0/0 00000100:00100000:1.0:1746126616.225420:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13583 00000100:00100000:1.0:1746126616.225428:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13584 00000100:00100000:1.0:1746126616.225432:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721380992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126616.225499:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3297:x1830945721380992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1072us total) trans 21474840366 rc 0/0 00000100:00100000:1.0:1746126616.225504:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13584 00000100:00100000:1.0:1746126616.225512:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13585 00000100:00100000:1.0:1746126616.225516:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3296:x1830945721381376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.225618:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3296:x1830945721381376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (1182us total) trans 17179873214 rc 0/0 00000100:00100000:1.0:1746126616.225623:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13585 00000100:00100000:1.0:1746126616.225632:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13586 00000100:00100000:1.0:1746126616.225636:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3297:x1830945721381504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.225710:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3297:x1830945721381504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1261us total) trans 17179873215 rc 0/0 00000100:00100000:1.0:1746126616.225715:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13586 00000100:00100000:1.0:1746126616.225724:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13587 00000100:00100000:1.0:1746126616.225729:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721380736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.225730:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13581 00000100:00100000:3.0:1746126616.225818:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13588 00000100:00100000:3.0:1746126616.225824:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721381120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126616.225889:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13589 00000100:00100000:0.0:1746126616.225896:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721380608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126616.226011:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13590 00000100:00100000:2.0:1746126616.226018:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3294:x1830945721381632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.227662:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3295:x1830945721380736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1930us (3186us total) trans 21474840367 rc 0/0 00000100:00100000:1.0:1746126616.227670:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13587 00000100:00100000:1.0:1746126616.227686:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13591 00000100:00100000:1.0:1746126616.227693:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3294:x1830945721382144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.227810:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721382144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (3250us total) trans 17179873217 rc 0/0 00000100:00100000:1.0:1746126616.227815:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13591 00000100:00100000:2.0:1746126616.227946:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3294:x1830945721381632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1928us (3405us total) trans 17179873216 rc 0/0 00000100:00100000:2.0:1746126616.227952:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13590 00000100:00100000:0.0:1746126616.227992:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3294:x1830945721380608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2098us (3497us total) trans 21474840369 rc 0/0 00000100:00100000:0.0:1746126616.227997:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13589 00000100:00100000:3.0:1746126616.228036:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721381120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2212us (3515us total) trans 21474840368 rc 0/0 00000100:00100000:3.0:1746126616.228042:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13588 00000100:00100000:2.0:1746126616.228638:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126616.228673:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721381760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126616.228696:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126616.228704:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721382272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126616.228714:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746126616.228740:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e3100/2, rc 0, transno 21474840367 00000100:00100000:2.0:1746126616.228744:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721380736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126616.228759:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381248 00000100:00100000:2.0:1746126616.228763:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381248 00000100:00100000:2.0:1746126616.228776:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381760 00000100:00100000:2.0:1746126616.228777:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381760 00000100:00100000:2.0:1746126616.228783:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382272 00000100:00100000:2.0:1746126616.228785:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382272 00000100:00100000:2.0:1746126616.228791:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13592 00000100:00100000:2.0:1746126616.228794:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721381248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126616.228907:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3295:x1830945721381248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (269us total) trans 21474840370 rc 0/0 00000100:00100000:2.0:1746126616.228912:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13592 00000100:00100000:2.0:1746126616.228920:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13593 00000100:00100000:2.0:1746126616.228924:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721381760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126616.228996:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3295:x1830945721381760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (299us total) trans 17179873218 rc 0/0 00000100:00100000:2.0:1746126616.229001:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13593 00000100:00100000:2.0:1746126616.229007:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13594 00000100:00100000:2.0:1746126616.229011:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830945721382272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126616.229077:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3295:x1830945721382272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (348us total) trans 17179873219 rc 0/0 00000100:00100000:2.0:1746126616.229082:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13594 00000004:00080000:2.0:1746126616.229099:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e1880/2, rc 0, transno 21474840370 00000100:00100000:2.0:1746126616.229102:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721381248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126616.229108:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e1180/2, rc 0, transno 17179873218 00000100:00100000:2.0:1746126616.229114:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721381760:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126616.229119:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135ed3b80/2, rc 0, transno 17179873219 00000100:00100000:2.0:1746126616.229122:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721382272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126616.229327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126616.229766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746126616.229858:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e2d80/2, rc 0, transno 21474840363 00000100:00100000:3.0:1746126616.229862:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721380352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126616.229870:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721382400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.229887:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746126616.229900:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0380/2, rc 0, transno 21474840365 00000100:00100000:3.0:1746126616.229902:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721380864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126616.229909:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e3480/2, rc 0, transno 17179873214 00000100:00100000:3.0:1746126616.229911:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721381376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.229922:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721381888 00000100:00100000:3.0:1746126616.229925:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721381888 00000100:00100000:3.0:1746126616.229937:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382400 00000100:00100000:3.0:1746126616.229938:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382400 00000100:00100000:3.0:1746126616.229946:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13595 00000100:00100000:3.0:1746126616.229950:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3296:x1830945721381888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126616.230027:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746126616.230030:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126616.230033:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746126616.230035:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126616.230037:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746126616.230055:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721381888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (290us total) trans 17179873220 rc 0/0 00000100:00100000:3.0:1746126616.230060:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13595 00000100:00100000:3.0:1746126616.230096:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13596 00000100:00100000:3.0:1746126616.230101:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3296:x1830945721382400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.230170:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721382400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (282us total) trans 17179873221 rc 0/0 00000100:00100000:3.0:1746126616.230175:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13596 00000004:00080000:3.0:1746126616.230192:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801367e9180/2, rc 0, transno 17179873221 00000100:00100000:3.0:1746126616.230195:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721382400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126616.230200:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0700/2, rc 0, transno 17179873220 00000100:00100000:3.0:1746126616.230202:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721381888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.230212:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486848 00000100:00100000:3.0:1746126616.230214:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486848 00000100:00100000:3.0:1746126616.230231:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8953 00000100:00100000:3.0:1746126616.230234:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31300:x1830945721486848:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126616.230245:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126616.230257:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd49 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.230295:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.230305:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126616.230317:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126616.230320:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126616.230322:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e665c00, rc 0) 00000100:00100000:3.0:1746126616.230348:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721486848:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 112us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126616.230352:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8953 00000004:00080000:1.0:1746126616.230494:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e1c00/2, rc 0, transno 21474840369 00000100:00100000:1.0:1746126616.230498:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721380608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126616.230505:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e3b80/2, rc 0, transno 21474840368 00000100:00100000:1.0:1746126616.230507:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721381120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126616.230514:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e3800/2, rc 0, transno 17179873216 00000100:00100000:1.0:1746126616.230516:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721381632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126616.230523:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135ed0700/2, rc 0, transno 17179873217 00000100:00100000:1.0:1746126616.230525:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721382144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.230538:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126616.230574:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0e00/2, rc 0, transno 21474840364 00000100:00100000:1.0:1746126616.230577:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721380480:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126616.230582:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e0a80/2, rc 0, transno 21474840366 00000100:00100000:1.0:1746126616.230584:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721380992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126616.230590:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e2300/2, rc 0, transno 17179873215 00000100:00100000:1.0:1746126616.230592:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721381504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.230603:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721382016 00000100:00100000:1.0:1746126616.230605:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721382016 00000100:00100000:1.0:1746126616.230619:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13597 00000100:00100000:1.0:1746126616.230623:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721382016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126616.230705:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721382016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (165us total) trans 17179873222 rc 0/0 00000100:00100000:1.0:1746126616.230709:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13597 00000004:00080000:1.0:1746126616.230725:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1e1500/2, rc 0, transno 17179873222 00000100:00100000:1.0:1746126616.230727:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721382016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126616.236319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.236637:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486976 00000100:00100000:2.0:1746126616.236646:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486976 00000100:00100000:2.0:1746126616.236680:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8954 00000100:00100000:2.0:1746126616.236687:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31300:x1830945721486976:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126616.236702:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126616.236717:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613a83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd50 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.236776:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126616.236787:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126616.236797:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126616.236818:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126616.236822:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126616.236861:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126616.236880:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613a83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.236890:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.236897:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126616.236899:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126616.236903:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb000, rc 0) 00000100:00100000:2.0:1746126616.236947:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721486976:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 260us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.236953:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8954 00000100:00100000:2.0:1746126616.251785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.254102:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487104 00000100:00100000:0.0:1746126616.254112:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487104 00000100:00100000:0.0:1746126616.254152:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13598 00000100:00100000:0.0:1746126616.254163:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1963:x1830945721487104:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126616.254177:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126616.254194:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd57 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126616.254215:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x7a1 00010000:00010000:0.0:1746126616.254229:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.254231:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126616.254238:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126616.254250:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126616.254264:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b391600, rc 0) 00000100:00100000:0.0:1746126616.254465:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721487104:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 306us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126616.254471:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13598 00000100:00100000:0.0:1746126616.255448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.255476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126616.255495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.255497:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487232 00000100:00100000:2.0:1746126616.255501:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487232 00000100:00100000:0.0:1746126616.255507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.255521:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487360 00000100:00100000:2.0:1746126616.255523:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487360 00000100:00100000:0.0:1746126616.255528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126616.255533:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487616 00000100:00100000:2.0:1746126616.255535:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487616 00000100:00100000:2.0:1746126616.255544:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487488 00000100:00100000:2.0:1746126616.255545:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487488 00000100:00100000:2.0:1746126616.255556:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487744 00000100:00100000:2.0:1746126616.255558:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487744 00000100:00100000:2.0:1746126616.255568:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13599 00000100:00100000:2.0:1746126616.255573:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721487232:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:1.0:1746126616.255578:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13600 00010000:00010000:2.0:1746126616.255582:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126616.255586:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721487360:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126616.255593:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd5e expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126616.255593:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.255602:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd65 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126616.255608:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x821 00002000:00010000:1.0:1746126616.255612:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c717, atime: 0x6813c717, ctime: 0x6813c717, blocks: 0x821 00010000:00010000:2.0:1746126616.255617:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.255619:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.255620:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.255621:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.255624:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255626:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.255635:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255636:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255643:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba0a00, rc 0) 00010000:00010000:2.0:1746126616.255647:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbbe00, rc 0) 00000100:00100000:1.0:1746126616.255669:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721487360:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.255674:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13600 00000100:00100000:2.0:1746126616.255675:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721487232:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.255680:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13599 00000100:00100000:1.0:1746126616.255686:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13601 00000100:00100000:1.0:1746126616.255690:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721487616:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:2.0:1746126616.255691:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13602 00000100:00100000:2.0:1746126616.255695:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721487488:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126616.255697:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126616.255701:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.255704:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd73 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126616.255708:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd6c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126616.255714:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c714, atime: 0x6813c715, ctime: 0x6813c714, blocks: 0x163d 00002000:00010000:2.0:1746126616.255718:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c717, atime: 0x6813c717, ctime: 0x6813c717, blocks: 0x821 00010000:00010000:1.0:1746126616.255720:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.255721:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.255724:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.255725:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.255726:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126616.255729:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255732:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126616.255737:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255738:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba0400, rc 0) 00010000:00010000:2.0:1746126616.255743:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebba400, rc 0) 00000100:00100000:1.0:1746126616.255752:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721487616:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 61us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126616.255757:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721487488:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 62us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.255760:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13601 00000100:00100000:2.0:1746126616.255762:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13602 00000100:00100000:1.0:1746126616.255769:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13603 00000100:00100000:1.0:1746126616.255773:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721487744:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126616.255779:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126616.255786:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd7a expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126616.255794:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x1029 00010000:00010000:1.0:1746126616.255802:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.255803:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126616.255806:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255813:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126616.255819:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527200, rc 0) 00000100:00100000:1.0:1746126616.255851:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721487744:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126616.255856:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13603 00010000:00010000:0.0:1746126616.837426:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746126617.199633:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873202 is committed 00000001:00080000:0.0:1746126617.199645:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873192 is committed 00000001:00080000:0.0:1746126617.199651:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873190 is committed 00000001:00080000:0.0:1746126617.199662:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873222 is committed 00000001:00080000:0.0:1746126617.199670:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873212 is committed 00000001:00080000:0.0:1746126617.199720:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873213 is committed 00000100:00100000:2.0:1746126617.271881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.272242:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488000 00000100:00100000:3.0:1746126617.272249:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488000 00000100:00100000:3.0:1746126617.272300:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7754 00000100:00100000:3.0:1746126617.272307:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721488000:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:3.0:1746126617.272332:0:21462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.272348:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.272350:0:21462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.272354:0:21462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.272366:0:21462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746126617.273895:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1746126617.283262:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840369 is committed 00000001:00080000:3.0:1746126617.283278:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840343 is committed 00000001:00080000:3.0:1746126617.283285:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840339 is committed 00000001:00080000:3.0:1746126617.283297:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840362 is committed 00000001:00080000:3.0:1746126617.283334:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840370 is committed 00000001:00080000:3.0:1746126617.283347:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840361 is committed 00000100:00100000:2.0:1746126617.292034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.292534:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488384 00000100:00100000:1.0:1746126617.292541:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488384 00000100:00080000:2.0:1746126617.294015:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746126617.294068:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7755 00000100:00100000:1.0:1746126617.294078:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721488384:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:1.0:1746126617.294108:0:21461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.294120:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.294122:0:21461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.294125:0:21461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.294138:0:21461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126617.295689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.296317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.298259:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488896 00000100:00100000:3.0:1746126617.298267:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488896 00000100:00100000:0.0:1746126617.298284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.298299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.298304:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488256 00000100:00100000:3.0:1746126617.298306:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488256 00000100:00100000:0.0:1746126617.298312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.298363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.298526:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488768 00000100:00100000:3.0:1746126617.298529:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488768 00000100:00100000:3.0:1746126617.298547:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721489152 00000100:00100000:3.0:1746126617.298549:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721489152 00000100:00100000:3.0:1746126617.298559:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721489280 00000100:00100000:3.0:1746126617.298560:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721489280 00000100:00100000:3.0:1746126617.298571:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7756 00000100:00100000:3.0:1746126617.298578:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721488896:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:3.0:1746126617.298607:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.298618:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.298619:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.298623:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.298632:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.299080:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7757 00000100:00100000:2.0:1746126617.299087:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721488256:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:2.0:1746126617.299102:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.299109:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.299110:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.299112:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.299119:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126617.300212:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721489536 00000100:00100000:0.0:1746126617.300217:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721489536 00000100:00100000:0.0:1746126617.300240:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7758 00000100:00100000:0.0:1746126617.300246:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721488768:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126617.300262:0:21198:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.300269:0:21198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.300270:0:21198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.300273:0:21198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.300281:0:21198:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126617.300775:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7759 00000100:00100000:3.0:1746126617.300782:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7760 00000100:00100000:1.0:1746126617.300783:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721489152:12345-192.168.203.2@tcp:3:mirror_io.0 00000100:00100000:3.0:1746126617.300787:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721489280:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:3.0:1746126617.300798:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.300798:0:15641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.300805:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.300806:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.300809:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.300816:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126617.300872:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7761 00000100:00100000:3.0:1746126617.300878:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721489536:12345-192.168.203.2@tcp:3:mirror_io.0 00010000:00010000:3.0:1746126617.300890:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.300897:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.300898:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.300901:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.300908:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.301476:0:15641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.301478:0:15641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.301481:0:15641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.301490:0:15641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.304988:0:21462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.304999:0:21462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.305005:0:21462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.305011:0:21462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d8e1e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126617.305013:0:21462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.305019:0:21462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.305032:0:21462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.305042:0:21462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d8e1e00/0xb50e825867613abb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126617.306146:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721488000:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 33836us (34266us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126617.306155:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7754 00010000:00010000:2.0:1746126617.306815:0:21461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.306823:0:21461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.306851:0:21461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.306856:0:21461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a9e600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126617.306858:0:21461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.306863:0:21461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.306875:0:21461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.306880:0:21461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a9e600/0xb50e825867613ac2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.306910:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721488384:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 12835us (14883us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.306915:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7755 00010000:00010000:3.0:1746126617.322756:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.322770:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.322777:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.322786:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbae00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126617.322789:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.322795:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.322809:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.322814:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613aec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126617.322896:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721489536:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 22013us (24527us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.322905:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7761 00010000:00010000:1.0:1746126617.332294:0:21198:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.332311:0:21198:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.332318:0:21198:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.332324:0:21198:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a592dc00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126617.332328:0:21198:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.332333:0:21198:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.332348:0:21198:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.332354:0:21198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a592dc00/0xb50e825867613ad7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126617.332432:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721488768:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 32182us (34144us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126617.332440:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7758 00010000:00010000:2.0:1746126617.339407:0:15641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.339423:0:15641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.339430:0:15641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.339436:0:15641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a9ee00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126617.339440:0:15641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.339446:0:15641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.339462:0:15641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.339472:0:15641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a9ee00/0xb50e825867613ade lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.339553:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721489152:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 38767us (41249us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.339562:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7759 00010000:00010000:1.0:1746126617.346844:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.346858:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.346866:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.346871:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbba00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126617.346875:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.346883:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.346897:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.346902:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbba00/0xb50e825867613ae5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126617.346967:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721489280:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 46174us (48648us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126617.346975:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7760 00010000:00010000:2.0:1746126617.353672:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.353686:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.353694:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.353699:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e324c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126617.353703:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.353708:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.353722:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.353727:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e324c00/0xb50e825867613ad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.354277:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721488256:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 55186us (57956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.354285:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7757 00010000:00010000:0.0:1746126617.359736:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.359751:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.359758:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.359764:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a454ce00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126617.359767:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.359774:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.359789:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.359795:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a454ce00/0xb50e825867613ac9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126617.361789:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721488896:12345-192.168.203.2@tcp:3:mirror_io.0 Request processed in 63206us (66097us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126617.361799:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7756 00000100:00100000:0.0:1746126617.368928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.370038:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721489792 00000100:00100000:1.0:1746126617.370047:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721489792 00000100:00100000:1.0:1746126617.370136:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 703 00000100:00100000:1.0:1746126617.370144:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721489792:12345-192.168.203.2@tcp:103:mirror_io.0 00010000:00010000:1.0:1746126617.370155:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126617.370175:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b391800/0xb50e825867613a36 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd3b expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.370616:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126617.370620:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126617.370753:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31300:x1830945721489792:12345-192.168.203.2@tcp:103:mirror_io.0 Request processed in 609us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.370758:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 703 00000100:00100000:0.0:1746126617.373006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.373074:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721490048 00000100:00100000:3.0:1746126617.373081:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721490048 00000100:00100000:3.0:1746126617.373111:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3788 00000100:00100000:3.0:1746126617.373117:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31300:x1830945721490048:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:3.0:1746126617.373314:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721490048:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 197us (312us total) trans 8589943135 rc 0/0 00000100:00100000:3.0:1746126617.373320:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3788 00000100:00100000:0.0:1746126617.375205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.376171:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721490304 00000100:00100000:3.0:1746126617.376179:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721490304 00000100:00100000:3.0:1746126617.376209:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3789 00000100:00100000:3.0:1746126617.376337:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31300:x1830945721490304:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:3.0:1746126617.376746:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31300:x1830945721490304:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 410us (1544us total) trans 8589943136 rc 0/0 00000100:00100000:3.0:1746126617.376752:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3789 00000100:00100000:0.0:1746126617.403654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.403898:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721490560 00000100:00100000:3.0:1746126617.403905:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721490560 00000100:00100000:3.0:1746126617.403952:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8955 00000100:00100000:3.0:1746126617.403959:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31310:x1830945721490560:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126617.403979:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.403994:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130a00/0xb50e825867613af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd81 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.404144:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404155:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404164:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404175:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404180:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404185:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404352:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404360:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404366:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126617.404374:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126617.404437:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404443:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404447:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404451:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f130000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126617.404454:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.404459:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126617.407071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.407234:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721490816 00000100:00100000:2.0:1746126617.407241:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721490816 00000100:00100000:2.0:1746126617.407271:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8956 00000100:00100000:2.0:1746126617.407277:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+221:31313:x1830945721490816:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.407293:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.407304:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867613b16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd88 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.407368:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126617.407736:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126617.407740:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126617.407746:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.407752:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130000/0xb50e825867613afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411101:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411112:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411118:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411123:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800937c9a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126617.411126:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411131:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411144:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009333d800) 00010000:00010000:3.0:1746126617.411146:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126617.411148:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.411153:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867613b01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126617.411605:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411615:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411631:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411637:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411641:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411754:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411762:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411767:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126617.411774:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126617.411858:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411864:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411868:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411872:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e39bc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126617.411874:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411879:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411886:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126617.411888:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126617.411890:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411894:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39bc00/0xb50e825867613b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411925:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411933:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411937:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411940:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e39a800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126617.411942:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411947:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411952:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009eb53600) 00010000:00010000:2.0:1746126617.411954:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126617.411956:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411960:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a800/0xb50e825867613b24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126617.411990:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867613b16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.411999:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.412005:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126617.412006:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126617.412008:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39ac00, rc 0) 00000100:00100000:2.0:1746126617.412067:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31313:x1830945721490816:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4781us (5001us total) trans 8589943138 rc 0/0 00000100:00100000:2.0:1746126617.412075:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8956 00010000:00010000:3.0:1746126617.412792:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f130a00/0xb50e825867613af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 10 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.412805:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.412811:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126617.412813:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126617.412815:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f3fe00, rc 0) 00000100:00100000:3.0:1746126617.412846:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31310:x1830945721490560:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8887us (9199us total) trans 8589943137 rc 0/0 00000100:00100000:3.0:1746126617.412851:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8955 00000100:00100000:0.0:1746126617.415630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.415706:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491072 00000100:00100000:3.0:1746126617.415713:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491072 00000100:00100000:3.0:1746126617.415756:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3790 00000100:00100000:3.0:1746126617.415764:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:31313:x1830945721491072:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126617.415934:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31313:x1830945721491072:12345-192.168.203.2@tcp:35:cat.0 Request processed in 170us (309us total) trans 8589943139 rc 0/0 00000100:00100000:3.0:1746126617.415939:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3790 00000100:00100000:0.0:1746126617.417692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.417768:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491328 00000100:00100000:3.0:1746126617.417773:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491328 00000100:00100000:3.0:1746126617.417811:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8957 00000100:00100000:3.0:1746126617.417817:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:31308:x1830945721491328:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126617.417862:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.417877:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3f600/0xb50e825867613b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd8f expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.417943:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.417954:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.417959:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.417968:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.417972:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126617.417996:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.418006:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 225 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746126617.418016:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721382528:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.418098:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.418105:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 8 pid: 15560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746126617.418111:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721382656:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.418134:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.418140:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 9 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746126617.418146:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721382784:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126617.418160:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126617.418701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.418728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.418770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.418786:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491584 00000100:00100000:0.0:1746126617.418790:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491584 00000100:00100000:0.0:1746126617.418806:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491712 00000100:00100000:0.0:1746126617.418807:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491712 00000100:00100000:0.0:1746126617.418816:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491840 00000100:00100000:0.0:1746126617.418817:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491840 00000100:00100000:0.0:1746126617.418844:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13604 00000100:00100000:0.0:1746126617.418850:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+5:1965:x1830945721491584:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126617.418858:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126617.418866:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd9d expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.418879:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.418881:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.418888:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.418898:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.418905:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a592c200, rc 0) 00000100:00100000:0.0:1746126617.418926:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1965:x1830945721491584:12345-192.168.203.2@tcp:101:cat.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126617.418932:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13604 00000100:00100000:0.0:1746126617.418943:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13605 00000100:00100000:0.0:1746126617.418948:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1965:x1830945721491712:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126617.418953:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126617.418962:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dda4 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.418972:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.418973:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.418976:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.418984:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.418990:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a592ce00, rc 0) 00000100:00100000:0.0:1746126617.419004:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721491712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 57us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126617.419013:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13605 00000100:00100000:0.0:1746126617.419021:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13606 00000100:00100000:0.0:1746126617.419025:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1965:x1830945721491840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126617.419030:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126617.419035:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddab expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.419043:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.419045:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.419048:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.419066:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.419073:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a592da00, rc 0) 00000100:00100000:0.0:1746126617.419088:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721491840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 63us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126617.419092:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13606 00000100:00100000:0.0:1746126617.423217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.423351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.423776:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.423893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.423922:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491968 00000100:00100000:3.0:1746126617.423929:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491968 00000100:00100000:3.0:1746126617.423960:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492096 00000100:00100000:3.0:1746126617.423961:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492096 00000100:00100000:2.0:1746126617.423970:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492224 00000100:00100000:2.0:1746126617.423973:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492224 00000100:00100000:2.0:1746126617.423993:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13607 00000100:00100000:2.0:1746126617.423999:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1965:x1830945721491968:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126617.424027:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13608 00000100:00100000:3.0:1746126617.424030:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721492224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.424039:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.424051:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddc0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.424076:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.424078:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.424085:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 8 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.424096:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 8 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.424103:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac3400, rc 0) 00000100:00100000:3.0:1746126617.424136:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721492224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.424141:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13608 00000100:00100000:3.0:1746126617.424153:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13609 00000100:00100000:3.0:1746126617.424156:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1965:x1830945721492096:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:1.0:1746126617.424403:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491456 00000100:00100000:1.0:1746126617.424407:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491456 00000100:00100000:1.0:1746126617.424430:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13610 00000100:00100000:1.0:1746126617.424435:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+11:1963:x1830945721491456:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126617.424442:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.424451:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dd96 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.424462:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.424463:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.424465:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.424468:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.424473:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddb2 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.424477:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.424482:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.424483:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9ec00, rc 0) 00010000:00010000:2.0:1746126617.424484:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.424488:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.424495:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.424501:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a800, rc 0) 00000100:00100000:1.0:1746126617.424501:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+12:1963:x1830945721491456:12345-192.168.203.2@tcp:101:cat.0 Request processed in 66us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.424506:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13610 00000100:00100000:2.0:1746126617.424516:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721491968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 518us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.424521:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13607 00010000:00010000:2.0:1746126617.424533:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.424544:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddb9 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.424551:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.424552:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.424555:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 8 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.424562:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 8 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.424567:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39bc00, rc 0) 00000100:00100000:2.0:1746126617.424577:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721492096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 420us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.424580:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13609 00000100:00100000:0.0:1746126617.458494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.458579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.458605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.458644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.458897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.458930:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492480 00000100:00100000:2.0:1746126617.458937:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492480 00000100:00100000:2.0:1746126617.458980:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492736 00000100:00100000:2.0:1746126617.458983:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492736 00000100:00100000:2.0:1746126617.458995:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492352 00000100:00100000:2.0:1746126617.458996:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492352 00000100:00100000:2.0:1746126617.459004:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492608 00000100:00100000:2.0:1746126617.459005:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492608 00000100:00100000:2.0:1746126617.459017:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13611 00000100:00100000:2.0:1746126617.459023:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721492480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.459037:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.459051:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddce expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.459079:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459081:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459089:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459102:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459112:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39ba00, rc 0) 00000100:00100000:2.0:1746126617.459152:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721492480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 130us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.459157:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13611 00000100:00100000:2.0:1746126617.459172:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13612 00000100:00100000:2.0:1746126617.459177:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+13:1963:x1830945721492736:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.459183:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.459191:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dddc expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.459200:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459201:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459205:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 14 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459213:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 14 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459219:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b600, rc 0) 00000100:00100000:2.0:1746126617.459233:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721492736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 56us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.459238:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13612 00000100:00100000:2.0:1746126617.459246:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13613 00000100:00100000:2.0:1746126617.459251:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721492352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.459258:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.459264:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddc7 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.459272:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459273:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459277:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459284:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459289:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b000, rc 0) 00000100:00100000:2.0:1746126617.459301:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721492352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.459306:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13613 00000100:00100000:2.0:1746126617.459314:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13614 00000100:00100000:2.0:1746126617.459318:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+13:1963:x1830945721492608:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.459322:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.459327:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddd5 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.459334:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459335:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.459338:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 14 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459345:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 14 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.459350:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a600, rc 0) 00000100:00100000:2.0:1746126617.459363:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721492608:12345-192.168.203.2@tcp:101:cat.0 Request processed in 44us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.459366:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13614 00000100:00100000:2.0:1746126617.459500:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721382528:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126617.460102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.460123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.460139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.460152:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492992 00000100:00100000:0.0:1746126617.460156:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492992 00010000:00010000:0.0:1746126617.460175:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 226 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.460190:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493248 00000100:00100000:0.0:1746126617.460192:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493248 00010000:00010000:0.0:1746126617.460200:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 10 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.460209:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493120 00000100:00100000:0.0:1746126617.460211:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493120 00010000:00010000:0.0:1746126617.460219:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.460231:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7092 00000100:00100000:0.0:1746126617.460235:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+226:1963:x1830945721492992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126617.460244:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126617.460249:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 226 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460257:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 226 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460272:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e825867613b2b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd88 expref: 226 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460285:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126617.460290:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460296:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460300:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126617.460318:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+225:1963:x1830945721492992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126617.460323:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7092 00000100:00100000:0.0:1746126617.460333:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7093 00000100:00100000:0.0:1746126617.460337:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721493248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126617.460343:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126617.460346:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 10 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460351:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 10 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460360:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126617.460362:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460367:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460370:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126617.460382:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721493248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126617.460386:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7093 00000100:00100000:0.0:1746126617.460393:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7094 00000100:00100000:0.0:1746126617.460397:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721493120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126617.460401:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126617.460404:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460411:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.460419:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126617.460422:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460428:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460433:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126617.460445:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126617.460455:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721493120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126617.460460:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7094 00000100:00100000:0.0:1746126617.460499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.460627:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493376 00000100:00100000:1.0:1746126617.460631:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493376 00000100:00100000:1.0:1746126617.460651:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8958 00000100:00100000:1.0:1746126617.460655:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31314:x1830945721493376:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126617.460668:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.460675:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddea expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.460726:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.460735:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.460746:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126617.460748:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126617.460750:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9f600, rc 0) 00000100:00100000:1.0:1746126617.460769:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31314:x1830945721493376:12345-192.168.203.2@tcp:101:cat.0 Request processed in 113us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.460773:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8958 00000100:00100000:3.0:1746126617.461106:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492864 00000100:00100000:3.0:1746126617.461110:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492864 00000100:00100000:3.0:1746126617.461130:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13615 00000100:00100000:3.0:1746126617.461135:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721492864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.461141:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.461149:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dde3 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.461159:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.461161:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.461166:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 20 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.461174:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 20 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.461181:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eac2000, rc 0) 00000100:00100000:3.0:1746126617.462048:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721492864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 910us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.462054:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13615 00010000:00010000:2.0:1746126617.462321:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3fe00/0xb50e825867613b08 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd81 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126617.462347:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721382656:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.462359:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613a8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd50 expref: 9 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126617.462367:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721382784:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.462387:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126617.462393:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126617.462397:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126617.462411:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126617.462509:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f3f600/0xb50e825867613b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 226 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.462519:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 225 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.462526:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126617.462527:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126617.462529:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f131400, rc 0) 00000100:00100000:2.0:1746126617.462562:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:31308:x1830945721491328:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 44745us (44873us total) trans 8589943140 rc 0/0 00000100:00100000:2.0:1746126617.462567:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8957 00000100:00100000:0.0:1746126617.471337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.471437:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493504 00000100:00100000:2.0:1746126617.471445:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493504 00000100:00100000:2.0:1746126617.471491:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8959 00000100:00100000:2.0:1746126617.471498:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:31313:x1830945721493504:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.471514:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.471529:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867613ba9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddf1 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.471578:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867613ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf1 expref: 226 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.471590:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867613ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf1 expref: 226 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.471604:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126617.471607:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126617.471609:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39aa00, rc 0) 00000100:00100000:2.0:1746126617.471658:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+226:31313:x1830945721493504:12345-192.168.203.2@tcp:101:cat.0 Request processed in 160us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.471664:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8959 00000100:00100000:0.0:1746126617.480533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.480669:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493632 00000100:00100000:1.0:1746126617.480676:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493632 00000100:00100000:1.0:1746126617.480785:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 228 00000100:00100000:1.0:1746126617.480792:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1966:x1830945721493632:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1746126617.480952:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1966:x1830945721493632:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 160us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.480957:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 228 00000100:00100000:0.0:1746126617.492575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.492608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.492628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.492655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.492717:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721494144 00000100:00100000:2.0:1746126617.492724:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721494144 00002000:00100000:2.0:1746126617.492758:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093494700 x1830945721494144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.492766:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494700 with x1830945721494144 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.492771:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093494700 00000100:00100000:2.0:1746126617.492782:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721494016 00000100:00100000:2.0:1746126617.492784:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721494016 00002000:00100000:2.0:1746126617.492790:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093494e00 x1830945721494016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.492796:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494e00 with x1830945721494016 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.492798:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093494e00 00000100:00100000:2.0:1746126617.492804:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721494400 00000100:00100000:2.0:1746126617.492806:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721494400 00002000:00100000:2.0:1746126617.492822:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093497480 x1830945721494400/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.492846:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497480 with x1830945721494400 ext(0->1048575) 00002000:00010000:2.0:1746126617.492849:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093497480 00000100:00100000:2.0:1746126617.492856:0:15641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721494528 00000100:00100000:2.0:1746126617.492857:0:15641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721494528 00002000:00100000:2.0:1746126617.492866:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093497b80 x1830945721494528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.492872:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497b80 with x1830945721494528 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.492874:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093497b80 00000100:00100000:2.0:1746126617.492882:0:15641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7762 00000100:00100000:2.0:1746126617.492886:0:15641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721494144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126617.495564:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7763 00000100:00100000:2.0:1746126617.495573:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721494016:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126617.496109:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7764 00000100:00100000:1.0:1746126617.496118:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721494400:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126617.498794:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7765 00000100:00100000:1.0:1746126617.498804:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721494528:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126617.503386:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.507847:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721494912 00000100:00100000:0.0:1746126617.507858:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721494912 00000100:00100000:0.0:1746126617.507912:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8960 00000100:00100000:0.0:1746126617.507919:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:31308:x1830945721494912:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126617.507938:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126617.507941:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746126617.507964:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867613ba9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf1 expref: 226 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.507984:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126617.507988:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126617.507996:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d400/0xb50e825867613bb0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddf8 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.508034:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126617.508043:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.508049:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.508053:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126617.508087:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.508097:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 8 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.508108:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721382912:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126617.508192:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.508199:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 8 pid: 15560 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.508205:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721383040:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126617.508220:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126617.510084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.510148:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721495424 00000100:00100000:2.0:1746126617.510154:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721495424 00002000:00100000:2.0:1746126617.510180:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093495880 x1830945721495424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.510189:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495880 with x1830945721495424 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.510193:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093495880 00000100:00100000:2.0:1746126617.512147:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7766 00000100:00100000:2.0:1746126617.512159:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721495424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126617.517895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.517947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.517958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.520391:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721382912:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126617.520405:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721383040:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126617.520427:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746126617.520467:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721495296 00000100:00100000:1.0:1746126617.520473:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721495296 00002000:00100000:1.0:1746126617.520504:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093495500 x1830945721495296/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.520512:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495500 with x1830945721495296 ext(1048576->2097151) 00002000:00010000:1.0:1746126617.520517:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093495500 00000100:00100000:1.0:1746126617.520532:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721495808 00000100:00100000:1.0:1746126617.520534:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721495808 00002000:00100000:1.0:1746126617.520546:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093495f80 x1830945721495808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.520552:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495f80 with x1830945721495808 ext(1048576->2097151) 00002000:00010000:1.0:1746126617.520555:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093495f80 00000100:00100000:1.0:1746126617.520563:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721495680 00000100:00100000:1.0:1746126617.520565:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721495680 00002000:00100000:1.0:1746126617.520574:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093496300 x1830945721495680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.520580:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093496300 with x1830945721495680 ext(0->1048575) 00002000:00010000:1.0:1746126617.520583:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093496300 00000100:00100000:1.0:1746126617.520594:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7767 00000100:00100000:1.0:1746126617.520600:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721495296:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126617.521645:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7768 00000100:00100000:1.0:1746126617.521651:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721495808:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.521814:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7769 00000100:00100000:3.0:1746126617.521821:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721495680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.522972:0:15641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721494144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30082us (30401us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.522979:0:15641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7762 00002000:00100000:3.0:1746126617.522986:0:15641:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093494700 x1830945721494144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.522994:0:15641:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494700 with x1830945721494144 ext(1048576->2097151) 00002000:00010000:3.0:1746126617.522999:0:15641:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093494700 00000100:00100000:2.0:1746126617.532556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.532597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.532704:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496064 00000100:00100000:3.0:1746126617.532712:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496064 00010000:00010000:3.0:1746126617.532739:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 9 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746126617.532762:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496192 00000100:00100000:3.0:1746126617.532764:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496192 00010000:00010000:3.0:1746126617.532771:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746126617.532797:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7095 00000100:00100000:3.0:1746126617.532803:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721496064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126617.532822:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126617.532852:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 9 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.532862:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 9 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.532879:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9f600/0xb50e825867613b94 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddea expref: 9 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.532893:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126617.532898:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.532904:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.532911:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126617.532946:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721496064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 142us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.532951:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7095 00000100:00100000:3.0:1746126617.532963:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7096 00000100:00100000:3.0:1746126617.532967:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721496192:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126617.532972:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126617.532975:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.532983:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.532991:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613a7c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd49 expref: 9 pid: 15560 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.532998:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126617.533000:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.533005:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.533010:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.533023:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126617.533038:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721496192:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.533043:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7096 00010000:00010000:3.0:1746126617.533159:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.533165:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:3.0:1746126617.533722:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2660, 88 off225936 00000004:00080000:3.0:1746126617.533729:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739447901024ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533767:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2777, 88 off236328 00000004:00080000:3.0:1746126617.533772:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739447944764ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533783:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2778, 88 off236416 00000004:00080000:3.0:1746126617.533786:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739447958515ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533792:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2661, 88 off226024 00000004:00080000:3.0:1746126617.533795:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739447967031ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533800:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2662, 88 off226112 00000004:00080000:3.0:1746126617.533802:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739447974962ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533808:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2779, 88 off236504 00000004:00080000:3.0:1746126617.533811:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739447983135ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533816:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2780, 88 off236592 00000004:00080000:3.0:1746126617.533819:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739447991466ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533824:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2663, 88 off226200 00000004:00080000:3.0:1746126617.533850:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739448022162ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533859:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2781, 88 off236680 00000004:00080000:3.0:1746126617.533861:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739448033791ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533867:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2664, 88 off226288 00000004:00080000:3.0:1746126617.533870:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739448042446ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533876:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2782, 88 off236768 00000004:00080000:3.0:1746126617.533879:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739448051365ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533884:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2665, 88 off226376 00000004:00080000:3.0:1746126617.533887:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739448059356ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533892:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2783, 88 off236856 00000004:00080000:3.0:1746126617.533895:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739448067317ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533901:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2666, 88 off226464 00000004:00080000:3.0:1746126617.533903:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739448075442ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126617.533909:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2784, 88 off236944 00000004:00080000:3.0:1746126617.533911:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739448083871ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533916:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2785, 88 off237032 00000004:00080000:3.0:1746126617.533919:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739448091405ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126617.533925:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2667, 88 off226552 00000004:00080000:3.0:1746126617.533927:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739448099406ns, next at 687927188999ns, rc = 0 00000100:00100000:0.0:1746126617.536784:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721494400:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40660us (44146us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126617.536795:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7764 00002000:00100000:0.0:1746126617.536805:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093497480 x1830945721494400/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126617.536814:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497480 with x1830945721494400 ext(0->1048575) 00002000:00010000:0.0:1746126617.536819:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093497480 00000100:00100000:0.0:1746126617.574377:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721494016:12345-192.168.203.2@tcp:3:cat.0 Request processed in 78796us (81758us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126617.574390:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7763 00002000:00100000:0.0:1746126617.574399:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093494e00 x1830945721494016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126617.574407:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494e00 with x1830945721494016 ext(1048576->2097151) 00002000:00010000:0.0:1746126617.574412:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093494e00 00000100:00100000:1.0:1746126617.584583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.585457:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721494528:12345-192.168.203.2@tcp:3:cat.0 Request processed in 86653us (92798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126617.585467:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7765 00002000:00100000:1.0:1746126617.585475:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093497b80 x1830945721494528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.585483:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497b80 with x1830945721494528 ext(1048576->2097151) 00002000:00010000:1.0:1746126617.585488:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093497b80 00000100:00100000:3.0:1746126617.585599:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496320 00000100:00100000:3.0:1746126617.585606:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496320 00000100:00100000:3.0:1746126617.585632:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8961 00000100:00100000:3.0:1746126617.585638:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+228:31313:x1830945721496320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.585650:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.585665:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ddff expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.585705:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.585713:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.585731:0:15560:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126617.585740:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.585749:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126617.585752:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126617.585755:0:15560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.585761:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973a3000, rc 0) 00000100:00100000:3.0:1746126617.585781:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:31313:x1830945721496320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 143us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.585785:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8961 00000100:00100000:0.0:1746126617.592119:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721495296:12345-192.168.203.2@tcp:3:cat.0 Request processed in 71514us (74226us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126617.592128:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7767 00002000:00100000:0.0:1746126617.592137:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093495500 x1830945721495296/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126617.592146:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495500 with x1830945721495296 ext(1048576->2097151) 00002000:00010000:0.0:1746126617.592151:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093495500 00000100:00100000:2.0:1746126617.592433:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721495424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 79376us (81451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.592441:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7766 00002000:00100000:2.0:1746126617.592447:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093495880 x1830945721495424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.592456:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495880 with x1830945721495424 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.592459:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093495880 00010000:00010000:3.0:1746126617.594623:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 229 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.594635:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126617.594638:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746126617.594641:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.594649:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.594654:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.594680:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126617.594691:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721383168:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126617.594762:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177780 going to sleep for 11 seconds 00000001:00080000:0.0:1746126617.595072:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943140 is committed 00000001:00080000:0.0:1746126617.595082:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943141 is committed 00000004:00080000:0.0:1746126617.595086:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2052 committed 00000004:00080000:0.0:1746126617.595091:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2167 committed 00000004:00080000:0.0:1746126617.595096:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2166 committed 00000004:00080000:0.0:1746126617.595097:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2051 committed 00000004:00080000:0.0:1746126617.595099:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2165 committed 00000004:00080000:0.0:1746126617.595100:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2050 committed 00000004:00080000:0.0:1746126617.595101:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2164 committed 00000004:00080000:0.0:1746126617.595103:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2049 committed 00000004:00080000:0.0:1746126617.595104:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2163 committed 00000004:00080000:0.0:1746126617.595106:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2048 committed 00000004:00080000:0.0:1746126617.595107:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2162 committed 00000004:00080000:0.0:1746126617.595108:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2161 committed 00000004:00080000:0.0:1746126617.595110:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2047 committed 00000004:00080000:0.0:1746126617.595112:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2046 committed 00000004:00080000:0.0:1746126617.595113:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2160 committed 00000004:00080000:0.0:1746126617.595114:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2159 committed 00000004:00080000:0.0:1746126617.595116:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2045 committed 00000001:00080000:0.0:1746126617.595122:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943137 is committed 00000001:00080000:0.0:1746126617.595124:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943136 is committed 00000100:00100000:1.0:1746126617.595283:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721383424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126617.595315:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126617.595331:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721383936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126617.595343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126617.595357:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126617.595360:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721383552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126617.595371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126617.595378:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721384064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126617.595387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126617.595403:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383424 00000100:00100000:1.0:1746126617.595408:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383424 00000100:00100000:1.0:1746126617.595430:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383936 00000100:00100000:1.0:1746126617.595431:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383936 00000100:00100000:1.0:1746126617.595439:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383552 00000100:00100000:1.0:1746126617.595440:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383552 00000100:00100000:1.0:1746126617.595447:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384064 00000100:00100000:1.0:1746126617.595449:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384064 00000100:00100000:1.0:1746126617.595458:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13616 00000100:00100000:1.0:1746126617.595463:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3294:x1830945721383424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126617.595657:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126617.595660:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126615 -> 1746126615 00002000:00010000:1.0:1746126617.595662:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126615 -> 1746126615 00002000:00010000:1.0:1746126617.595663:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126615 -> 1746126615 00002000:00010000:1.0:1746126617.595665:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2077 00000100:00100000:1.0:1746126617.595687:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1830945721383424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (371us total) trans 21474840371 rc 0/0 00000100:00100000:1.0:1746126617.595692:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13616 00000100:00100000:1.0:1746126617.595704:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13617 00000100:00100000:1.0:1746126617.595708:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3294:x1830945721383936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126617.595780:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1830945721383936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (435us total) trans 21474840372 rc 0/0 00000100:00100000:1.0:1746126617.595784:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13617 00000100:00100000:1.0:1746126617.595793:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13618 00000100:00100000:1.0:1746126617.595796:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3294:x1830945721383552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126617.595898:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126617.595900:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126612 -> 1746126612 00002000:00010000:1.0:1746126617.595902:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:1.0:1746126617.595904:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126612 -> 1746126612 00002000:00010000:1.0:1746126617.595905:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:1.0:1746126617.595923:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1830945721383552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (551us total) trans 21474840373 rc 0/0 00000100:00100000:1.0:1746126617.595928:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13618 00000100:00100000:1.0:1746126617.595936:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13619 00000100:00100000:1.0:1746126617.595940:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3294:x1830945721384064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126617.596023:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1830945721384064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (634us total) trans 21474840374 rc 0/0 00000100:00100000:1.0:1746126617.596028:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13619 00000100:00100000:1.0:1746126617.596066:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840370 gen 2 00000004:00080000:1.0:1746126617.596070:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad1c00, transno 21474840345 00000004:00080000:1.0:1746126617.596075:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcce00, transno 21474840346 00000004:00080000:1.0:1746126617.596077:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad1f80, transno 21474840347 00000004:00080000:1.0:1746126617.596079:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8c000, transno 21474840348 00000004:00080000:1.0:1746126617.596081:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3a5880, transno 21474840349 00000004:00080000:1.0:1746126617.596083:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8c380, transno 21474840350 00000004:00080000:1.0:1746126617.596085:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad0000, transno 21474840351 00000004:00080000:1.0:1746126617.596087:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcd880, transno 21474840352 00000004:00080000:1.0:1746126617.596089:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4a80, transno 21474840353 00000004:00080000:1.0:1746126617.596090:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5880, transno 21474840354 00000004:00080000:1.0:1746126617.596092:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5500, transno 21474840355 00000004:00080000:1.0:1746126617.596094:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7480, transno 21474840356 00000004:00080000:1.0:1746126617.596095:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7100, transno 21474840357 00000004:00080000:1.0:1746126617.596097:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5f80, transno 21474840358 00000004:00080000:1.0:1746126617.596099:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7800, transno 21474840359 00000004:00080000:1.0:1746126617.596100:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4e00, transno 21474840360 00000004:00080000:1.0:1746126617.596102:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2d80, transno 21474840363 00000004:00080000:1.0:1746126617.596105:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0e00, transno 21474840364 00000004:00080000:1.0:1746126617.596107:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0380, transno 21474840365 00000004:00080000:1.0:1746126617.596109:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0a80, transno 21474840366 00000004:00080000:1.0:1746126617.596111:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e3100, transno 21474840367 00000004:00080000:1.0:1746126617.596113:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e3b80, transno 21474840368 00000004:00080000:1.0:1746126617.596116:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1c00, transno 21474840369 00000004:00080000:1.0:1746126617.596118:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1880, transno 21474840370 00000100:00100000:1.0:1746126617.596123:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a4c8ea00 x1830945721383552/t21474840373(21474840373) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126633 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746126617.596131:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8ea00/2, rc 0, transno 21474840373 00000100:00100000:1.0:1746126617.596134:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721383552:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126617.596141:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134c3c000/2, rc 0, transno 21474840374 00000100:00100000:1.0:1746126617.596144:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721384064:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126617.596149:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8f100/2, rc 0, transno 21474840371 00000100:00100000:1.0:1746126617.596151:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721383424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126617.596156:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134c3ca80/2, rc 0, transno 21474840372 00000100:00100000:1.0:1746126617.596158:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721383936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126617.596337:0:14592:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 24 done 00000100:00100000:2.0:1746126617.596498:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721384576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126617.596520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126617.596531:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721385088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126617.596543:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126617.596551:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746126617.596554:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721384448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126617.596566:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126617.596573:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721384960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126617.596582:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126617.596596:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384576 00000100:00100000:2.0:1746126617.596599:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384576 00000100:00100000:2.0:1746126617.596612:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385088 00000100:00100000:2.0:1746126617.596614:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385088 00000100:00100000:2.0:1746126617.596620:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384448 00000100:00100000:2.0:1746126617.596622:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384448 00000100:00100000:2.0:1746126617.596628:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384960 00000100:00100000:2.0:1746126617.596630:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384960 00000100:00100000:2.0:1746126617.596636:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13620 00000100:00100000:2.0:1746126617.596640:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1830945721384576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126617.596781:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746126617.596784:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:2.0:1746126617.596786:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:2.0:1746126617.596788:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:2.0:1746126617.596790:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4139 00000100:00100000:2.0:1746126617.596808:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1830945721384576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (288us total) trans 17179873223 rc 0/0 00000100:00100000:2.0:1746126617.596813:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13620 00000100:00100000:2.0:1746126617.596823:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13621 00000100:00100000:2.0:1746126617.596845:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1830945721385088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126617.596910:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1830945721385088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (365us total) trans 17179873224 rc 0/0 00000100:00100000:2.0:1746126617.596915:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13621 00000100:00100000:2.0:1746126617.596997:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13622 00000100:00100000:2.0:1746126617.597001:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1830945721384448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126617.597107:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126617.597109:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126615 -> 1746126615 00002000:00010000:2.0:1746126617.597111:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126615 -> 1746126615 00002000:00010000:2.0:1746126617.597112:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126615 -> 1746126615 00002000:00010000:2.0:1746126617.597114:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746126617.597132:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1830945721384448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (565us total) trans 17179873225 rc 0/0 00000100:00100000:2.0:1746126617.597136:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13622 00000100:00100000:2.0:1746126617.597146:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13623 00000100:00100000:2.0:1746126617.597150:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1830945721384960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126617.597219:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1830945721384960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (635us total) trans 17179873226 rc 0/0 00000100:00100000:2.0:1746126617.597223:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13623 00000100:00100000:2.0:1746126617.597252:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873222 gen 2 00000004:00080000:2.0:1746126617.597255:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d7800, transno 17179873194 00000004:00080000:2.0:1746126617.597260:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d6680, transno 17179873195 00000004:00080000:2.0:1746126617.597262:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8d500, transno 17179873196 00000004:00080000:2.0:1746126617.597264:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d5c00, transno 17179873197 00000004:00080000:2.0:1746126617.597266:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009204f100, transno 17179873198 00000004:00080000:2.0:1746126617.597268:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8cb800, transno 17179873199 00000004:00080000:2.0:1746126617.597269:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d5880, transno 17179873200 00000004:00080000:2.0:1746126617.597271:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d4380, transno 17179873201 00000004:00080000:2.0:1746126617.597274:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009204d500, transno 17179873202 00000004:00080000:2.0:1746126617.597275:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7b80, transno 17179873203 00000004:00080000:2.0:1746126617.597277:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6a00, transno 17179873204 00000004:00080000:2.0:1746126617.597279:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5c00, transno 17179873205 00000004:00080000:2.0:1746126617.597281:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5180, transno 17179873206 00000004:00080000:2.0:1746126617.597282:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4700, transno 17179873207 00000004:00080000:2.0:1746126617.597284:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4380, transno 17179873208 00000004:00080000:2.0:1746126617.597285:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6300, transno 17179873209 00000004:00080000:2.0:1746126617.597287:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6680, transno 17179873210 00000004:00080000:2.0:1746126617.597289:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0000, transno 17179873211 00000004:00080000:2.0:1746126617.597291:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e3480, transno 17179873214 00000004:00080000:2.0:1746126617.597293:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e2300, transno 17179873215 00000004:00080000:2.0:1746126617.597295:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e3800, transno 17179873216 00000004:00080000:2.0:1746126617.597297:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135ed0700, transno 17179873217 00000004:00080000:2.0:1746126617.597300:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1180, transno 17179873218 00000004:00080000:2.0:1746126617.597302:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135ed3b80, transno 17179873219 00000004:00080000:2.0:1746126617.597303:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e0700, transno 17179873220 00000004:00080000:2.0:1746126617.597305:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801367e9180, transno 17179873221 00000004:00080000:2.0:1746126617.597308:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1e1500, transno 17179873222 00000100:00100000:2.0:1746126617.597311:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801367e9f80 x1830945721384448/t17179873225(17179873225) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126633 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746126617.597318:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801367e9f80/2, rc 0, transno 17179873225 00000100:00100000:2.0:1746126617.597322:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721384448:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126617.597330:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15ce00/2, rc 0, transno 17179873226 00000100:00100000:2.0:1746126617.597333:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721384960:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126617.597338:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15e300/2, rc 0, transno 17179873223 00000100:00100000:2.0:1746126617.597341:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721384576:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126617.597346:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15c000/2, rc 0, transno 17179873224 00000100:00100000:2.0:1746126617.597349:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721385088:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126617.597515:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 27 done 00000100:00100000:0.0:1746126617.598153:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721383296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.598179:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598194:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721383808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.598206:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598214:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.598224:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598233:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.598244:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598251:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721385344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.598260:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598270:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746126617.598275:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721383680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.598284:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598290:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.598299:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598305:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.598313:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598318:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721385216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.598328:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126617.598342:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383296 00000100:00100000:0.0:1746126617.598346:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383296 00000100:00100000:0.0:1746126617.598359:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383808 00000100:00100000:0.0:1746126617.598361:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383808 00000100:00100000:0.0:1746126617.598366:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384320 00000100:00100000:0.0:1746126617.598367:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384320 00000100:00100000:0.0:1746126617.598372:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384832 00000100:00100000:0.0:1746126617.598374:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384832 00000100:00100000:0.0:1746126617.598378:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385344 00000100:00100000:0.0:1746126617.598379:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385344 00000100:00100000:0.0:1746126617.598384:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721383680 00000100:00100000:0.0:1746126617.598385:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721383680 00000100:00100000:0.0:1746126617.598391:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384192 00000100:00100000:0.0:1746126617.598392:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384192 00000100:00100000:0.0:1746126617.598396:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721384704 00000100:00100000:0.0:1746126617.598398:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721384704 00000100:00100000:0.0:1746126617.598403:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721385216 00000100:00100000:0.0:1746126617.598405:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721385216 00000100:00100000:0.0:1746126617.598414:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13624 00000100:00100000:0.0:1746126617.598417:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721383296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126617.598530:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746126617.598532:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:0.0:1746126617.598534:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:0.0:1746126617.598536:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:0.0:1746126617.598538:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1953 -> 1951 00000100:00100000:0.0:1746126617.598559:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721383296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (379us total) trans 21474840375 rc 0/0 00000100:00100000:0.0:1746126617.598563:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13624 00000100:00100000:0.0:1746126617.598573:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13625 00000100:00100000:0.0:1746126617.598577:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721383808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.598644:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721383808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (436us total) trans 21474840376 rc 0/0 00000100:00100000:0.0:1746126617.598649:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13625 00000100:00100000:0.0:1746126617.598656:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13626 00000100:00100000:0.0:1746126617.598660:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721384320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126617.598738:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126617.598741:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126613 -> 1746126613 00002000:00010000:0.0:1746126617.598743:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126613 -> 1746126613 00002000:00010000:0.0:1746126617.598745:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126613 -> 1746126613 00002000:00010000:0.0:1746126617.598747:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2079 00000100:00100000:0.0:1746126617.598763:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721384320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (538us total) trans 17179873227 rc 0/0 00000100:00100000:0.0:1746126617.598766:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13626 00000100:00100000:0.0:1746126617.598775:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13627 00000100:00100000:0.0:1746126617.598779:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721384832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126617.598886:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126617.598889:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126617.598890:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126617.598892:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126617.598893:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126617.598910:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721384832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (665us total) trans 17179873228 rc 0/0 00000100:00100000:0.0:1746126617.598915:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13627 00000100:00100000:0.0:1746126617.598923:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13628 00000100:00100000:0.0:1746126617.598927:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721385344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.599005:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721385344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (743us total) trans 17179873229 rc 0/0 00000100:00100000:0.0:1746126617.599010:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13628 00000100:00100000:0.0:1746126617.599018:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13629 00000100:00100000:0.0:1746126617.599022:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721383680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.599123:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721383680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (837us total) trans 21474840377 rc 0/0 00000100:00100000:0.0:1746126617.599128:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13629 00000100:00100000:0.0:1746126617.599137:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13630 00000100:00100000:0.0:1746126617.599141:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721384192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126617.599211:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721384192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (910us total) trans 21474840378 rc 0/0 00000100:00100000:0.0:1746126617.599216:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13630 00000100:00100000:0.0:1746126617.599225:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13631 00000100:00100000:0.0:1746126617.599229:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721384704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.599327:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721384704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (1011us total) trans 17179873230 rc 0/0 00000100:00100000:0.0:1746126617.599332:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13631 00000100:00100000:0.0:1746126617.599341:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13632 00000100:00100000:0.0:1746126617.599345:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721385216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126617.599417:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721385216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1088us total) trans 17179873231 rc 0/0 00000100:00100000:0.0:1746126617.599422:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13632 00000004:00080000:0.0:1746126617.599448:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8f480/2, rc 0, transno 21474840377 00000100:00100000:0.0:1746126617.599452:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721383680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126617.599457:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134c3df80/2, rc 0, transno 21474840378 00000100:00100000:0.0:1746126617.599461:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126617.599466:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15c700/2, rc 0, transno 17179873230 00000100:00100000:0.0:1746126617.599468:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126617.599473:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15fb80/2, rc 0, transno 17179873231 00000100:00100000:0.0:1746126617.599475:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721385216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126617.599480:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8ed80/2, rc 0, transno 21474840375 00000100:00100000:0.0:1746126617.599482:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721383296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126617.599487:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8e680/2, rc 0, transno 21474840376 00000100:00100000:0.0:1746126617.599489:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721383808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126617.599494:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801367eaa00/2, rc 0, transno 17179873227 00000100:00100000:0.0:1746126617.599496:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126617.599501:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15d180/2, rc 0, transno 17179873228 00000100:00100000:0.0:1746126617.599503:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721384832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126617.599507:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f15d500/2, rc 0, transno 17179873229 00000100:00100000:0.0:1746126617.599509:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721385344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126617.607199:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721495680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 85369us (89229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.607209:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7769 00002000:00100000:3.0:1746126617.607219:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093496300 x1830945721495680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.607227:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093496300 with x1830945721495680 ext(0->1048575) 00002000:00010000:3.0:1746126617.607232:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093496300 00000100:00100000:3.0:1746126617.607540:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721383168:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126617.607568:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d400/0xb50e825867613bb0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 225 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746126617.607583:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.607607:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a592d800, rc 0) 00000100:00100000:3.0:1746126617.608483:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31308:x1830945721494912:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 100563us (105102us total) trans 8589943141 rc 0/0 00000100:00100000:3.0:1746126617.608490:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8960 00000100:00100000:1.0:1746126617.608808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.610030:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721495808:12345-192.168.203.2@tcp:3:cat.0 Request processed in 88375us (92078us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126617.610037:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7768 00002000:00100000:0.0:1746126617.610044:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093495f80 x1830945721495808/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126617.610070:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495f80 with x1830945721495808 ext(1048576->2097151) 00002000:00010000:0.0:1746126617.610075:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093495f80 00000100:00100000:3.0:1746126617.610274:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496448 00000100:00100000:3.0:1746126617.610281:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496448 00000100:00100000:3.0:1746126617.610321:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3791 00000100:00100000:3.0:1746126617.610327:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31313:x1830945721496448:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:3.0:1746126617.610392:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31313:x1830945721496448:12345-192.168.203.2@tcp:49:cat.0 Request processed in 65us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.610397:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3791 00000100:00100000:0.0:1746126617.622656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.622757:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496576 00000100:00100000:3.0:1746126617.622765:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496576 00000100:00100000:3.0:1746126617.623911:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8962 00000100:00100000:3.0:1746126617.623924:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31314:x1830945721496576:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.623938:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.623957:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de06 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.624006:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.624016:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.624029:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126617.624032:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126617.624034:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973a3600, rc 0) 00000100:00100000:3.0:1746126617.624091:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31314:x1830945721496576:12345-192.168.203.2@tcp:101:cat.0 Request processed in 173us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.624097:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8962 00000100:00100000:0.0:1746126617.627162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.627258:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496704 00000100:00100000:2.0:1746126617.627266:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496704 00000100:00100000:2.0:1746126617.627375:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3792 00000100:00100000:2.0:1746126617.627382:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d992050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31308:x1830945721496704:12345-192.168.203.2@tcp:49:multiop.0 00000100:00100000:2.0:1746126617.629876:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d992050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31308:x1830945721496704:12345-192.168.203.2@tcp:49:multiop.0 Request processed in 2486us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.629888:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3792 00000100:00100000:0.0:1746126617.646259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.646356:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721496960 00000100:00100000:2.0:1746126617.646364:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721496960 00002000:00100000:2.0:1746126617.646399:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9d4380 x1830945721496960/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.646408:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4380 with x1830945721496960 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.646413:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d4380 00000100:00100000:2.0:1746126617.646444:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7770 00000100:00100000:2.0:1746126617.646451:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721496960:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126617.647762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.649202:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721497088 00000100:00100000:2.0:1746126617.649209:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721497088 00000100:00100000:0.0:1746126617.650318:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13633 00000100:00100000:0.0:1746126617.650328:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:31308:x1830945721497088:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126617.650344:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126617.650358:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de0d expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.650381:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.650389:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 23 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.650396:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.650402:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.650403:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.650406:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 6/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1744896->2031615] (req 1744896->2031615) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 23 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.650433:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.650443:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 7 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.650453:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721385472:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126617.650541:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 23 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.650549:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 23 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.650556:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721385600:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126617.650573:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126617.650580:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 8 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.650587:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721385728:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126617.650598:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126617.665800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.666072:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721497344 00000100:00100000:3.0:1746126617.666081:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721497344 00002000:00100000:3.0:1746126617.666114:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9d4e00 x1830945721497344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.666124:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4e00 with x1830945721497344 ext(1048576->2097151) 00002000:00010000:3.0:1746126617.666129:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d4e00 00000100:00100000:3.0:1746126617.666163:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7771 00000100:00100000:3.0:1746126617.666169:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721497344:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126617.678599:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721496960:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 32141us (32341us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.678608:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7770 00002000:00100000:2.0:1746126617.678617:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9d4380 x1830945721496960/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.678626:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4380 with x1830945721496960 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.678632:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d4380 00000100:00100000:0.0:1746126617.679350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.679365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.679382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.679395:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721497600 00000100:00100000:3.0:1746126617.679401:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721497600 00010000:00010000:3.0:1746126617.679424:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 10 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.679440:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721497728 00000100:00100000:3.0:1746126617.679442:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721497728 00010000:00010000:3.0:1746126617.679450:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 9 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.679460:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721497472 00000100:00100000:3.0:1746126617.679461:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721497472 00010000:00010000:3.0:1746126617.679468:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 22 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.679478:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7097 00000100:00100000:3.0:1746126617.679484:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721497600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126617.679492:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126617.679506:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 10 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.679520:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 10 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.679538:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126617.679556:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721497600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.679560:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7097 00000100:00100000:3.0:1746126617.679570:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7098 00000100:00100000:3.0:1746126617.679574:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721497728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126617.679579:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126617.679585:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 9 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.679592:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 9 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.679601:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126617.679611:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721497728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 36us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.679615:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7098 00000100:00100000:3.0:1746126617.679622:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7099 00000100:00100000:3.0:1746126617.679626:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721497472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126617.679632:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126617.679637:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 22 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.679646:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 22 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.679654:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.679656:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.679661:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.679667:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.679690:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126617.679701:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721385856:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126617.679866:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a592da00/0xb50e825867613b55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddab expref: 9 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.679880:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721385472:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126617.679889:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39ba00/0xb50e825867613b78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddce expref: 22 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.679896:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721385600:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126617.680240:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1963:x1830945721497344:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14070us (14446us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126617.680247:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7771 00002000:00100000:1.0:1746126617.680253:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e9d4e00 x1830945721497344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.680261:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4e00 with x1830945721497344 ext(1048576->2097151) 00002000:00010000:1.0:1746126617.680264:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d4e00 00010000:00010000:1.0:1746126617.680287:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba0a00/0xb50e825867613a9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd65 expref: 8 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746126617.680300:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721385728:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126617.680320:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.680328:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18800, rc 0) 00000100:00100000:1.0:1746126617.680344:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:31308:x1830945721497088:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 30019us (32585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.680350:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13633 00000100:00100000:3.0:1746126617.680428:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126617.684944:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721385856:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126617.684961:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126617.685008:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721497472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5379us (5623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.685018:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7099 00000100:00100000:1.0:1746126617.685823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.686066:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721497856 00000100:00100000:2.0:1746126617.686072:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721497856 00000100:00100000:2.0:1746126617.686196:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13634 00000100:00100000:2.0:1746126617.686204:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31310:x1830945721497856:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126617.686217:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.686230:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de14 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.686252:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.686260:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 13 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.686266:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.686272:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.686274:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.686277:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.686305:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.686315:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126617.686325:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721385984:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.686377:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 13 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.686385:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 13 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126617.686393:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386112:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.686415:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126617.686421:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 7 pid: 4640 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126617.686427:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386240:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126617.686438:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126617.686473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.686509:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721498112 00000100:00100000:1.0:1746126617.686513:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721498112 00002000:00100000:1.0:1746126617.686534:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1744896->1748991) req@ffff88009e9d6a00 x1830945721498112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.686541:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6a00 with x1830945721498112 ext(1744896->1748991) 00002000:00010000:1.0:1746126617.686545:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d6a00 00000100:00100000:1.0:1746126617.686554:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7772 00000100:00100000:1.0:1746126617.686558:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721498112:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126617.686669:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721498112:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 109us (196us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126617.686674:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7772 00002000:00100000:1.0:1746126617.686679:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1744896->1748991) req@ffff88009e9d6a00 x1830945721498112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/4536 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.686685:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6a00 with x1830945721498112 ext(1744896->1748991) 00002000:00010000:1.0:1746126617.686688:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e9d6a00 00000100:00100000:0.0:1746126617.689674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.690028:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721385984:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126617.690043:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386112:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126617.690050:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386240:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.690093:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.690108:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092ba1200, rc 0) 00000100:00100000:2.0:1746126617.690150:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31310:x1830945721497856:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3947us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.690157:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13634 00000100:00100000:3.0:1746126617.690290:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721498368 00000100:00100000:3.0:1746126617.690295:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721498368 00010000:00010000:3.0:1746126617.690318:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.690348:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7100 00000100:00100000:3.0:1746126617.690354:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721498368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126617.690363:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126617.690381:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.690395:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.690413:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a600/0xb50e825867613b8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddd5 expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126617.690427:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126617.690455:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721498368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 101us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.690460:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7100 00000100:00100000:0.0:1746126617.690636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.690658:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721498240 00000100:00100000:0.0:1746126617.690660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.690662:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721498240 00000100:00100000:0.0:1746126617.690673:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721498496 00010000:00010000:1.0:1746126617.690675:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.690675:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721498496 00010000:00010000:0.0:1746126617.690687:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 8 pid: 4640 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746126617.690692:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7101 00000100:00100000:1.0:1746126617.690697:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721498240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126617.690703:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126617.690710:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126617.690712:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7102 00000100:00100000:0.0:1746126617.690716:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721498496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126617.690717:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126617.690722:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126617.690729:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867613b6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb2 expref: 9 pid: 4641 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126617.690730:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 8 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126617.690737:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 8 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746126617.690865:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126617.690886:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721498240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 188us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.690892:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7101 00010000:00010000:0.0:1746126617.691134:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613aad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd6c expref: 8 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126617.691153:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.691155:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.691161:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.691168:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.691193:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126617.691203:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721386368:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126617.691944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.692331:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746126617.692383:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721498752 00000100:00100000:3.0:1746126617.692388:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721498752 00002000:00100000:3.0:1746126617.692412:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880135ed3800 x1830945721498752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 504/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.692419:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed3800 with x1830945721498752 ext(1048576->2097151) 00002000:00010000:3.0:1746126617.692423:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ed3800 00000100:00100000:3.0:1746126617.692435:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7773 00000100:00100000:3.0:1746126617.692440:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721498752:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126617.696080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.696464:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721498880 00000100:00100000:3.0:1746126617.696471:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721498880 00000100:00100000:3.0:1746126617.696517:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13635 00000100:00100000:3.0:1746126617.696525:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31314:x1830945721498880:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.696538:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.696552:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de1b expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.696573:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.696579:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126617.696581:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126617.696584:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 8 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.696607:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.696617:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 21 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746126617.696627:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721386496:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126617.696696:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126617.702157:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721386368:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126617.702175:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126617.702212:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721498496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 11494us (11550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.702221:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7102 00000100:00100000:3.0:1746126617.702692:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721498752:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 10250us (10748us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746126617.702699:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7773 00002000:00100000:3.0:1746126617.702707:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880135ed3800 x1830945721498752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 504/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.702715:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed3800 with x1830945721498752 ext(1048576->2097151) 00010000:00010000:3.0:1746126617.702727:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 20 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.702743:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 20 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.702748:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135ed3800 00000100:00100000:0.0:1746126617.702978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.703199:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721386496:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.703215:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 8 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.703227:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973a2a00, rc 0) 00000100:00100000:2.0:1746126617.703255:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31314:x1830945721498880:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6731us (7181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.703260:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13635 00000100:00100000:3.0:1746126617.703552:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721499136 00000100:00100000:3.0:1746126617.703557:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721499136 00002000:00100000:3.0:1746126617.703581:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1986560->1990655) req@ffff88009e9d7b80 x1830945721499136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.703588:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7b80 with x1830945721499136 ext(1986560->1990655) 00002000:00010000:3.0:1746126617.703591:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d7b80 00000100:00100000:3.0:1746126617.703604:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7774 00000100:00100000:3.0:1746126617.703609:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721499136:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126617.703736:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721499136:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 126us (758us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126617.703742:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7774 00002000:00100000:3.0:1746126617.703747:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1986560->1990655) req@ffff88009e9d7b80 x1830945721499136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/4536 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.703754:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7b80 with x1830945721499136 ext(1986560->1990655) 00002000:00010000:3.0:1746126617.703756:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d7b80 00000100:00100000:0.0:1746126617.709720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.709774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.709854:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721499520 00000100:00100000:2.0:1746126617.709861:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721499520 00000100:00100000:2.0:1746126617.709893:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13636 00000100:00100000:2.0:1746126617.709900:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:31313:x1830945721499520:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.709914:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.709928:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de22 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.709954:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.709961:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126617.709962:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126617.709964:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.709987:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.709996:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 7 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126617.710006:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386624:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126617.710127:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721499392 00000100:00100000:3.0:1746126617.710131:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721499392 00002000:00100000:3.0:1746126617.710152:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1744896->2031615) req@ffff88009e9d7480 x1830945721499392/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.710165:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7480 with x1830945721499392 ext(1744896->2031615) 00010000:00010000:3.0:1746126617.710171:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 20 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.710178:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 20 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.710184:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9d7480 00000100:00100000:2.0:1746126617.710501:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126617.710703:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1772 00000100:00100000:3.0:1746126617.710711:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721499392:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126617.714222:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386624:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126617.714246:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.714260:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e21200, rc 0) 00000100:00100000:2.0:1746126617.714311:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+14:31313:x1830945721499520:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4409us (4534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.714318:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13636 00000100:00100000:0.0:1746126617.717339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.717486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.717607:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721499776 00000100:00100000:3.0:1746126617.717615:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721499776 00000100:00100000:3.0:1746126617.717649:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13637 00000100:00100000:3.0:1746126617.717656:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31310:x1830945721499776:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126617.717669:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.717683:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de29 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.717705:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 6 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.717713:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 13 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.717719:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.717725:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.717727:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.717729:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->2883583] (req 2097152->2883583) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.717754:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.717762:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 9 pid: 20294 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.717772:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386752:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.717859:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 13 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.717867:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 13 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.717875:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386880:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.717906:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 6 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.717913:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 6 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.717925:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721387008:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126617.717940:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126617.717995:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721499904 00000100:00100000:1.0:1746126617.717998:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721499904 00002000:00100000:1.0:1746126617.718020:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1986560->2097151) req@ffff88008e722300 x1830945721499904/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.718027:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722300 with x1830945721499904 ext(1986560->2097151) 00010000:00010000:1.0:1746126617.718033:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746126617.718041:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746126617.718047:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e722300 00000100:00100000:1.0:1746126617.718067:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1773 00000100:00100000:1.0:1746126617.718072:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721499904:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126617.725579:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721499392:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 14861us (15858us total) trans 17179873232 rc 0/0 00000100:00100000:3.0:1746126617.725588:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1772 00002000:00100000:3.0:1746126617.725597:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1744896->2031615) req@ffff88009e9d7480 x1830945721499392/t17179873232(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/448 e 0 to 0 dl 1746126628 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.725605:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7480 with x1830945721499392 ext(1744896->2031615) 00010000:00010000:3.0:1746126617.725614:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.725624:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.725630:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9d7480 00000100:00100000:0.0:1746126617.726270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.727309:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721499904:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 9234us (9820us total) trans 21474840379 rc 0/0 00000100:00100000:1.0:1746126617.727316:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1773 00002000:00100000:1.0:1746126617.727322:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1986560->2097151) req@ffff88008e722300 x1830945721499904/t21474840379(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/448 e 0 to 0 dl 1746126628 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.727330:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722300 with x1830945721499904 ext(1986560->2097151) 00010000:00010000:1.0:1746126617.727336:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746126617.727346:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746126617.727351:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e722300 00000100:00100000:0.0:1746126617.727441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.727501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.727581:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721500032 00000100:00100000:2.0:1746126617.727588:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721500032 00010000:00010000:2.0:1746126617.727607:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126617.727621:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721500160 00000100:00100000:2.0:1746126617.727623:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721500160 00010000:00010000:2.0:1746126617.727628:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 12 pid: 20294 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126617.727637:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721500288 00000100:00100000:2.0:1746126617.727638:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721500288 00010000:00010000:2.0:1746126617.727644:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 7 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126617.727653:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7103 00000100:00100000:2.0:1746126617.727657:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721500032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126617.727665:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126617.727676:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126617.727684:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 14 pid: 10890 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126617.727700:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126617.727716:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721500032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 59us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.727721:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7103 00000100:00100000:2.0:1746126617.727750:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7104 00000100:00100000:2.0:1746126617.727755:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721500160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126617.727759:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126617.727764:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 12 pid: 20294 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126617.727770:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 12 pid: 20294 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126617.727778:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126617.727786:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721500160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.727789:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7104 00000100:00100000:2.0:1746126617.727795:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7105 00000100:00100000:2.0:1746126617.727798:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721500288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126617.727802:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126617.727806:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 7 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126617.727813:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 7 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126617.727821:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.727822:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.727844:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.727850:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.727873:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.727883:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721387136:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126617.727917:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746126617.730104:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e825867613b71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddb9 expref: 11 pid: 20294 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.731138:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386752:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.732177:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e825867613b7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dddc expref: 13 pid: 10890 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.732192:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721386880:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.732208:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba0400/0xb50e825867613aa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd73 expref: 7 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126617.732215:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721387008:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126617.732238:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.732249:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973a2800, rc 0) 00000100:00100000:3.0:1746126617.732306:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31310:x1830945721499776:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 14649us (14972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.732313:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13637 00000100:00100000:0.0:1746126617.734679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.735305:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721387136:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126617.735321:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126617.735356:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721500288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7555us (7852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.735366:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7105 00000100:00100000:2.0:1746126617.735386:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721500416 00000100:00100000:2.0:1746126617.735391:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721500416 00010000:00010000:2.0:1746126617.735410:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.735732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.736394:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721500544 00000100:00100000:2.0:1746126617.736398:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721500544 00010000:00010000:2.0:1746126617.736414:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126617.736432:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7106 00000100:00100000:2.0:1746126617.736437:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721500416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126617.736447:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126617.736461:0:9817:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126615 -> 1746126617 00002000:00010000:2.0:1746126617.736464:0:9817:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126615 -> 1746126617 00010000:00010000:2.0:1746126617.736469:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.736480:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.736498:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18800/0xb50e825867613bcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1744896->2031615) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de0d expref: 22 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.736513:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.736515:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.736520:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.736527:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.736553:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.736565:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721387264:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126617.736610:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126617.736628:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7107 00000100:00100000:2.0:1746126617.736633:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721500544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126617.736640:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126617.736650:0:7074:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126615 -> 1746126617 00002000:00010000:2.0:1746126617.736652:0:7074:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126615 -> 1746126617 00010000:00010000:2.0:1746126617.736657:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.736664:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.736676:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba1200/0xb50e825867613bd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de14 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.736684:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.736685:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.736689:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.736695:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.736711:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126617.736718:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721387392:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126617.736736:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126617.740386:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721387264:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126617.740403:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126617.740863:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721500416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4424us (6185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.740872:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7106 00000100:00100000:0.0:1746126617.744436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.744496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.744634:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721500800 00000100:00100000:3.0:1746126617.744644:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721500800 00002000:00100000:3.0:1746126617.744681:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008e722680 x1830945721500800/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.744690:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722680 with x1830945721500800 ext(1048576->2097151) 00002000:00010000:3.0:1746126617.744694:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722680 00000100:00100000:3.0:1746126617.744713:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721501056 00000100:00100000:3.0:1746126617.744715:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721501056 00002000:00100000:3.0:1746126617.744727:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008e722d80 x1830945721501056/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.744733:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722d80 with x1830945721501056 ext(1048576->2097151) 00002000:00010000:3.0:1746126617.744735:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e722d80 00000100:00100000:2.0:1746126617.744742:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721387392:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126617.744759:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7775 00010000:00010000:2.0:1746126617.744760:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126617.744764:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721500800:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126617.744792:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721500544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8159us (9061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.744799:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7107 00000100:00100000:0.0:1746126617.744861:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7776 00000100:00100000:0.0:1746126617.744867:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721501056:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126617.752701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.754171:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721501312 00000100:00100000:1.0:1746126617.754181:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721501312 00002000:00100000:1.0:1746126617.754217:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2879488->2883583) req@ffff88008e721880 x1830945721501312/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.754226:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721880 with x1830945721501312 ext(2879488->2883583) 00002000:00010000:1.0:1746126617.754230:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e721880 00000100:00100000:1.0:1746126617.754257:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7777 00000100:00100000:1.0:1746126617.754264:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721501312:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126617.754412:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721501312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 148us (1717us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126617.754418:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7777 00002000:00100000:1.0:1746126617.754423:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2879488->2883583) req@ffff88008e721880 x1830945721501312/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/4536 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.754429:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721880 with x1830945721501312 ext(2879488->2883583) 00002000:00010000:1.0:1746126617.754432:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e721880 00000100:00100000:2.0:1746126617.758999:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721500800:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 14226us (14562us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.759010:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7775 00002000:00100000:2.0:1746126617.759018:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008e722680 x1830945721500800/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.759027:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722680 with x1830945721500800 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.759031:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722680 00000100:00100000:2.0:1746126617.760206:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721501056:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 15336us (15707us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.760214:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7776 00002000:00100000:2.0:1746126617.760219:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008e722d80 x1830945721501056/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.760227:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722d80 with x1830945721501056 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.760231:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e722d80 00000100:00100000:2.0:1746126617.767703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.767743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.767770:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721501696 00000100:00100000:2.0:1746126617.767777:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721501696 00000100:00100000:2.0:1746126617.767812:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13638 00000100:00100000:2.0:1746126617.767818:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31314:x1830945721501696:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126617.767844:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126617.767857:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de30 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.767876:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.767877:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126617.767882:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.767894:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126617.767902:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e20000, rc 0) 00000100:00100000:2.0:1746126617.767935:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31314:x1830945721501696:12345-192.168.203.2@tcp:101:cat.0 Request processed in 117us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.767940:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13638 00000100:00100000:3.0:1746126617.767995:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721501568 00000100:00100000:3.0:1746126617.767999:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721501568 00000100:00100000:3.0:1746126617.768029:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3793 00000100:00100000:3.0:1746126617.768035:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31310:x1830945721501568:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126617.768237:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31310:x1830945721501568:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 202us (541us total) trans 8589943142 rc 0/0 00000100:00100000:3.0:1746126617.768243:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3793 00000100:00100000:0.0:1746126617.772279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.773353:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721501952 00000100:00100000:2.0:1746126617.773362:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721501952 00002000:00100000:2.0:1746126617.773400:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880092208000 x1830945721501952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.773408:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208000 with x1830945721501952 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.773412:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092208000 00000100:00100000:2.0:1746126617.773435:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7778 00000100:00100000:2.0:1746126617.773442:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721501952:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126617.780011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.780111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.780911:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721502080 00000100:00100000:3.0:1746126617.780919:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721502080 00000100:00100000:3.0:1746126617.780960:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721502208 00000100:00100000:3.0:1746126617.780962:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721502208 00000100:00100000:3.0:1746126617.780988:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13639 00000100:00100000:3.0:1746126617.780994:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721502080:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.781008:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.781023:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de37 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126617.781041:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.781043:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126617.781050:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.781074:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126617.781083:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec07200, rc 0) 00000100:00100000:3.0:1746126617.781122:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721502080:12345-192.168.203.2@tcp:101:cat.0 Request processed in 129us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126617.781129:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13639 00000100:00100000:3.0:1746126617.781143:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13640 00000100:00100000:3.0:1746126617.781148:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721502208:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126617.781154:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126617.781161:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613bfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de3e expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126617.781193:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721387520:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126617.781248:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00002000:00010000:0.0:1746126617.782899:0:4640:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime: 1746126612 -> 1746126617 00002000:00010000:0.0:1746126617.782903:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126613 -> 1746126617 00002000:00010000:0.0:1746126617.782905:0:4640:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime: 1746126612 -> 1746126617 00000100:00100000:1.0:1746126617.783106:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721387520:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126617.783125:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613bfd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de3e expref: 14 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126617.783134:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de3e expref: 14 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126617.783145:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec06800, rc 0) 00000100:00100000:1.0:1746126617.783171:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721502208:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2023us (3059us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126617.783179:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13640 00000100:00100000:2.0:1746126617.783217:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721501952:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 9774us (10943us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.783227:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7778 00002000:00100000:2.0:1746126617.783233:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880092208000 x1830945721501952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.783241:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208000 with x1830945721501952 ext(1048576->2097151) 00002000:00010000:2.0:1746126617.783245:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092208000 00000100:00100000:0.0:1746126617.792092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.792173:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721502336 00000100:00100000:1.0:1746126617.792181:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721502336 00000100:00100000:1.0:1746126617.792215:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13641 00000100:00100000:1.0:1746126617.792221:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:31313:x1830945721502336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126617.792235:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.792249:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de45 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.792272:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.792279:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126617.792280:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126617.792283:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.792306:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.792316:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 9 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746126617.792327:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721387648:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126617.792535:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126617.796502:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721387648:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126617.796529:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.796542:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f82800, rc 0) 00000100:00100000:1.0:1746126617.796587:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+14:31313:x1830945721502336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4365us (4502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.796595:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13641 00000100:00100000:0.0:1746126617.797433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.797511:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721502464 00000100:00100000:2.0:1746126617.797517:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721502464 00002000:00100000:2.0:1746126617.797549:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2883583) req@ffff88009220b480 x1830945721502464/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.797557:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b480 with x1830945721502464 ext(2097152->2883583) 00010000:00010000:2.0:1746126617.797563:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.797575:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 10 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746126617.797581:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009220b480 00000100:00100000:2.0:1746126617.797595:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1774 00000100:00100000:2.0:1746126617.797601:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721502464:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126617.802652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.802993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.803026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.803046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.803132:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721502720 00000100:00100000:3.0:1746126617.803140:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721502720 00002000:00100000:3.0:1746126617.803173:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2883584->3932159) req@ffff880092209880 x1830945721502720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.803181:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209880 with x1830945721502720 ext(2883584->3932159) 00010000:00010000:3.0:1746126617.803190:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.803201:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.803207:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092209880 00000100:00100000:3.0:1746126617.803219:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721502976 00000100:00100000:3.0:1746126617.803222:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721502976 00002000:00100000:3.0:1746126617.803230:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3932160->4194303) req@ffff88009220a680 x1830945721502976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.803242:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220a680 with x1830945721502976 ext(3932160->4194303) 00010000:00010000:3.0:1746126617.803245:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.803253:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.803258:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009220a680 00000100:00100000:3.0:1746126617.803265:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721503232 00000100:00100000:3.0:1746126617.803267:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721503232 00002000:00100000:3.0:1746126617.803279:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880092208700 x1830945721503232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.803285:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208700 with x1830945721503232 ext(2097152->3145727) 00002000:00010000:3.0:1746126617.803287:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092208700 00000100:00100000:3.0:1746126617.803300:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721503488 00000100:00100000:3.0:1746126617.803302:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721503488 00002000:00100000:3.0:1746126617.803311:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880092209c00 x1830945721503488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.803317:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209c00 with x1830945721503488 ext(3145728->4194303) 00002000:00010000:3.0:1746126617.803319:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209c00 00000100:00100000:3.0:1746126617.803328:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1775 00000100:00100000:3.0:1746126617.803333:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721502720:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.805767:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1776 00000100:00100000:3.0:1746126617.805777:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721502976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.806540:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7779 00000100:00100000:3.0:1746126617.806546:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721503232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126617.807116:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7780 00000100:00100000:2.0:1746126617.807124:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721503488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.820742:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721502720:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17398us (18087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.820753:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1775 00002000:00100000:3.0:1746126617.820762:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2883584->3932159) req@ffff880092209880 x1830945721502720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.820771:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209880 with x1830945721502720 ext(2883584->3932159) 00010000:00010000:3.0:1746126617.820780:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.820793:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.820800:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092209880 00000100:00100000:2.0:1746126617.829418:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721502464:12345-192.168.203.2@tcp:4:cat.0 Request processed in 31810us (31979us total) trans 21474840380 rc 0/0 00000100:00100000:2.0:1746126617.829433:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1774 00002000:00100000:2.0:1746126617.829442:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->2883583) req@ffff88009220b480 x1830945721502464/t21474840380(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/448 e 0 to 0 dl 1746126628 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.829451:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b480 with x1830945721502464 ext(2097152->2883583) 00010000:00010000:2.0:1746126617.829460:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126617.829471:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746126617.829477:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009220b480 00000100:00100000:3.0:1746126617.830227:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721502976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24449us (27231us total) trans 0 rc 262144/262144 00000100:00100000:3.0:1746126617.830234:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1776 00002000:00100000:3.0:1746126617.830240:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3932160->4194303) req@ffff88009220a680 x1830945721502976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:H/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.830247:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220a680 with x1830945721502976 ext(3932160->4194303) 00010000:00010000:3.0:1746126617.830253:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746126617.830266:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746126617.830272:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009220a680 00000100:00100000:2.0:1746126617.836899:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721503488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29768us (33843us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126617.836909:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7780 00002000:00100000:2.0:1746126617.836918:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880092209c00 x1830945721503488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126617.836927:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209c00 with x1830945721503488 ext(3145728->4194303) 00002000:00010000:2.0:1746126617.836932:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209c00 00010000:00010000:0.0:1746126617.839496:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746126617.839578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.839916:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721503616 00000100:00100000:0.0:1746126617.839923:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721503616 00010000:00010000:0.0:1746126617.839950:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746126617.839982:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7108 00000100:00100000:0.0:1746126617.839990:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721503616:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126617.840005:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126617.840023:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.840034:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.840050:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973a2800/0xb50e825867613be8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de29 expref: 12 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746126617.840080:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.840081:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126617.840087:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.840094:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126617.840121:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126617.840132:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721387776:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126617.840211:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126617.840814:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721503232:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34266us (37784us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.840821:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7779 00002000:00100000:3.0:1746126617.842396:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880092208700 x1830945721503232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.842405:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208700 with x1830945721503232 ext(2097152->3145727) 00002000:00010000:3.0:1746126617.842409:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092208700 00000100:00100000:2.0:1746126617.849293:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092209180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721387776:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126617.849312:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126617.849378:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721503616:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9388us (9804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126617.849387:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7108 00000100:00100000:0.0:1746126617.851476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.851555:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721503744 00000100:00100000:1.0:1746126617.851563:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721503744 00000100:00100000:1.0:1746126617.851595:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13642 00000100:00100000:1.0:1746126617.851600:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31314:x1830945721503744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126617.851615:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.851629:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de4c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.851648:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.851649:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126617.851655:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.851666:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.851675:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f83800, rc 0) 00000100:00100000:1.0:1746126617.851722:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31314:x1830945721503744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 122us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126617.851728:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13642 00000100:00100000:0.0:1746126617.856602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.856734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.856771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126617.857562:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721504000 00000100:00100000:3.0:1746126617.857570:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721504000 00002000:00100000:3.0:1746126617.857611:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880092209f80 x1830945721504000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.857620:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209f80 with x1830945721504000 ext(2097152->3145727) 00002000:00010000:3.0:1746126617.857625:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092209f80 00000100:00100000:3.0:1746126617.857639:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721504256 00000100:00100000:3.0:1746126617.857641:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721504256 00002000:00100000:3.0:1746126617.857651:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880092208a80 x1830945721504256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.857657:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208a80 with x1830945721504256 ext(3145728->4194303) 00002000:00010000:3.0:1746126617.857660:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092208a80 00000100:00100000:3.0:1746126617.857671:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721504512 00000100:00100000:3.0:1746126617.857674:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721504512 00002000:00100000:3.0:1746126617.857685:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009220a300 x1830945721504512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.857691:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220a300 with x1830945721504512 ext(2097152->3145727) 00002000:00010000:3.0:1746126617.857694:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220a300 00000100:00100000:3.0:1746126617.857719:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7781 00000100:00100000:3.0:1746126617.857726:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721504000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.858711:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7782 00000100:00100000:3.0:1746126617.858717:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721504256:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126617.859856:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7783 00000100:00100000:0.0:1746126617.859865:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721504512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126617.860959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.861724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126617.862800:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721505024 00000100:00100000:0.0:1746126617.862808:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721505024 00002000:00100000:0.0:1746126617.862854:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009220aa00 x1830945721505024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126617.862862:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220aa00 with x1830945721505024 ext(3145728->4194303) 00002000:00010000:0.0:1746126617.862867:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009220aa00 00000100:00100000:0.0:1746126617.862883:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721504768 00000100:00100000:0.0:1746126617.862885:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721504768 00002000:00100000:0.0:1746126617.862898:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880092209180 x1830945721504768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126617.862904:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209180 with x1830945721504768 ext(3145728->4194303) 00002000:00010000:0.0:1746126617.862907:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209180 00000100:00100000:0.0:1746126617.862919:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7784 00000100:00100000:0.0:1746126617.862925:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721505024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126617.863954:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7785 00000100:00100000:2.0:1746126617.863963:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721504768:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126617.877343:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721504000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19607us (20738us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.877355:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7781 00002000:00100000:3.0:1746126617.877366:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880092209f80 x1830945721504000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.877375:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209f80 with x1830945721504000 ext(2097152->3145727) 00002000:00010000:3.0:1746126617.877381:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092209f80 00000100:00100000:3.0:1746126617.888177:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721504256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29451us (31433us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.888189:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7782 00002000:00100000:3.0:1746126617.888201:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880092208a80 x1830945721504256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.888210:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092208a80 with x1830945721504256 ext(3145728->4194303) 00002000:00010000:3.0:1746126617.888216:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092208a80 00000100:00100000:1.0:1746126617.891934:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721504512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 32063us (35154us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126617.891944:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7783 00002000:00100000:1.0:1746126617.891954:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009220a300 x1830945721504512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.891962:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220a300 with x1830945721504512 ext(2097152->3145727) 00002000:00010000:1.0:1746126617.891968:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220a300 00000100:00100000:0.0:1746126617.899561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.901818:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721505280 00000100:00100000:1.0:1746126617.901851:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721505280 00000100:00100000:1.0:1746126617.901939:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8963 00000100:00100000:1.0:1746126617.901947:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31318:x1830945721505280:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126617.902112:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.902129:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82400/0xb50e825867613c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de53 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126617.904456:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721504768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40489us (42727us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126617.904466:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7785 00002000:00100000:3.0:1746126617.904476:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880092209180 x1830945721504768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126617.904484:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092209180 with x1830945721504768 ext(3145728->4194303) 00002000:00010000:3.0:1746126617.904489:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092209180 00010000:00010000:1.0:1746126617.904703:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.904718:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.904728:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.904741:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.904746:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.904754:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906192:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906203:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906211:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126617.906219:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126617.906284:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906290:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906295:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906299:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d78bc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126617.906302:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906307:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906314:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126617.906316:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126617.906319:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.906326:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78bc00/0xb50e825867613c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909343:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909354:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909360:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909364:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d78ac00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126617.909367:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909372:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909385:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1600) 00010000:00010000:1.0:1746126617.909388:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126617.909390:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909394:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d78ac00/0xb50e825867613c20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.909447:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f82400/0xb50e825867613c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.909459:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.909469:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126617.909471:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126617.909473:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4aa00, rc 0) 00000100:00100000:1.0:1746126617.909533:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31318:x1830945721505280:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7586us (9979us total) trans 8589943143 rc 0/0 00000100:00100000:1.0:1746126617.909540:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8963 00000100:00100000:1.0:1746126617.910425:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721505024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 47498us (49466us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126617.910433:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7784 00002000:00100000:1.0:1746126617.910440:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009220aa00 x1830945721505024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.910449:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220aa00 with x1830945721505024 ext(3145728->4194303) 00002000:00010000:1.0:1746126617.910453:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009220aa00 00000100:00100000:0.0:1746126617.920820:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.920906:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721505536 00000100:00100000:1.0:1746126617.920913:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721505536 00002000:00100000:1.0:1746126617.920945:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e804e00 x1830945721505536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.920954:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804e00 with x1830945721505536 ext(4194304->4976639) 00002000:00010000:1.0:1746126617.920958:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804e00 00000100:00100000:1.0:1746126617.920981:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7786 00000100:00100000:1.0:1746126617.920986:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+14:1965:x1830945721505536:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126617.940817:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+14:1965:x1830945721505536:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19816us (19990us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126617.940845:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7786 00002000:00100000:1.0:1746126617.940856:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e804e00 x1830945721505536/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.940865:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804e00 with x1830945721505536 ext(4194304->4976639) 00002000:00010000:1.0:1746126617.940869:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804e00 00000100:00100000:0.0:1746126617.951862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.951929:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721505792 00000100:00100000:1.0:1746126617.951937:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721505792 00002000:00100000:1.0:1746126617.951969:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e804700 x1830945721505792/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/0 e 0 to 0 dl 1746126628 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.951977:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804700 with x1830945721505792 ext(4194304->4976639) 00002000:00010000:1.0:1746126617.951982:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804700 00000100:00100000:1.0:1746126617.952291:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7787 00000100:00100000:1.0:1746126617.952298:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721505792:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126617.973689:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721505792:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21384us (21855us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126617.973699:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7787 00002000:00100000:1.0:1746126617.973709:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e804700 x1830945721505792/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:378/0 lens 488/440 e 0 to 0 dl 1746126628 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126617.973719:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804700 with x1830945721505792 ext(4194304->4976639) 00002000:00010000:1.0:1746126617.973724:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804700 00000100:00100000:0.0:1746126617.978760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126617.978863:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506048 00000100:00100000:1.0:1746126617.978871:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506048 00000100:00100000:1.0:1746126617.979253:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8964 00000100:00100000:1.0:1746126617.979264:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31320:x1830945721506048:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126617.979285:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126617.979308:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4b400/0xb50e825867613c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de5a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.979409:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979423:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979432:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979445:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979450:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979456:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979568:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979578:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979584:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126617.979594:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126617.979681:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979692:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979697:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979702:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093417200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126617.979705:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979711:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979723:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126617.979725:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126617.979729:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979733:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979777:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979782:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979786:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979789:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093417a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126617.979791:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979798:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979804:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1f00) 00010000:00010000:1.0:1746126617.979805:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126617.979807:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979811:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417a00/0xb50e825867613c43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126617.979995:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4b400/0xb50e825867613c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.980005:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126617.980011:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126617.980013:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126617.980015:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093417600, rc 0) 00000100:00100000:1.0:1746126617.985550:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31320:x1830945721506048:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6279us (6785us total) trans 8589943144 rc 0/0 00000100:00100000:1.0:1746126617.985561:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8964 00000100:00100000:0.0:1746126617.992422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126617.992489:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506304 00000100:00100000:2.0:1746126617.992497:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506304 00000100:00100000:2.0:1746126617.993909:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3794 00000100:00100000:2.0:1746126617.993919:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31320:x1830945721506304:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126617.996360:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:31320:x1830945721506304:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 2434us (3938us total) trans 8589943145 rc 0/0 00000100:00100000:2.0:1746126617.996371:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3794 00000100:00100000:0.0:1746126618.014522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.014570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.014593:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506432 00000100:00100000:2.0:1746126618.014600:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506432 00000100:00100000:1.0:1746126618.014641:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506560 00000100:00100000:1.0:1746126618.014645:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506560 00000100:00100000:2.0:1746126618.014651:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13643 00000100:00100000:2.0:1746126618.014657:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:31320:x1830945721506432:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:1.0:1746126618.014662:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13644 00000100:00100000:1.0:1746126618.014666:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31318:x1830945721506560:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126618.014671:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.014671:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.014684:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de61 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.014684:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de68 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.014705:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.014705:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 7 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.014712:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.014712:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.014718:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.014718:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.014719:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.014722:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1597440->1847295] (req 1597440->1847295) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.014722:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.014723:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.014726:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.014745:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.014745:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.014754:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746126618.014754:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126618.014763:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721388032:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.014763:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721387904:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.014846:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1746126618.014849:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746126618.014853:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 23 pid: 23766 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746126618.014861:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721388160:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.016433:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.016444:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126618.016452:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721388288:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.016482:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00010000:00010000:1.0:1746126618.016533:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 7 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.016541:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 7 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746126618.016548:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721388416:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.016564:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.017657:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721387904:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.026166:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721388032:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.026179:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721388288:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.026211:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1597440->1847295] (req 1597440->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.026225:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d87e600, rc 0) 00000100:00100000:2.0:1746126618.026270:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:31320:x1830945721506432:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11613us (11754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.026281:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13643 00000100:00100000:1.0:1746126618.026363:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721388160:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.027778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.027894:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721388416:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.027919:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.027930:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093416800, rc 0) 00000100:00100000:1.0:1746126618.027955:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31318:x1830945721506560:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 13288us (13385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.027960:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13644 00000100:00100000:2.0:1746126618.028357:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506688 00000100:00100000:2.0:1746126618.028363:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506688 00010000:00010000:2.0:1746126618.028382:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126618.028411:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7109 00000100:00100000:2.0:1746126618.028416:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721506688:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.028519:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.028536:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126618.028544:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126618.028561:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec07200/0xb50e825867613bf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de37 expref: 23 pid: 4640 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746126618.028573:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.028592:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721506688:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 176us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.028597:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7109 00000100:00100000:2.0:1746126618.028628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.028636:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506944 00000100:00100000:2.0:1746126618.028638:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506944 00010000:00010000:2.0:1746126618.028646:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746126618.028774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.029195:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721506816 00000100:00100000:2.0:1746126618.029199:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721506816 00010000:00010000:2.0:1746126618.029211:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 22 pid: 23766 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746126618.029227:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7110 00000100:00100000:2.0:1746126618.029231:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721506944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.029237:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.029245:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.029252:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.029263:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973a2a00/0xb50e825867613bda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de1b expref: 9 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.029272:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.029273:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746126618.029374:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7111 00000100:00100000:3.0:1746126618.029381:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721506816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.029387:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.029396:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 22 pid: 23766 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126618.029402:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 22 pid: 23766 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126618.029411:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac2000/0xb50e825867613b9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dde3 expref: 22 pid: 23766 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126618.029422:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.029437:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721506816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 57us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.029441:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7111 00000100:00100000:3.0:1746126618.029495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.029504:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721507200 00000100:00100000:3.0:1746126618.029507:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721507200 00010000:00010000:3.0:1746126618.029516:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746126618.029526:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7112 00000100:00100000:3.0:1746126618.029530:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721507200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.029534:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.029540:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126618.029546:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126618.029555:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eac3400/0xb50e825867613b5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc0 expref: 9 pid: 20294 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746126618.029562:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.029572:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721507200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.029576:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7112 00010000:00010000:2.0:1746126618.030629:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.030638:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.030665:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.030676:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721388544:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.030746:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.039342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.040443:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721507072 00000100:00100000:0.0:1746126618.040451:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721507072 00010000:00010000:0.0:1746126618.040478:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 8 pid: 4642 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746126618.040741:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7113 00000100:00100000:0.0:1746126618.040749:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721507072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.040765:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.040783:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 8 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126618.040794:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 8 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126618.040813:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e825867613ab4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd7a expref: 8 pid: 4642 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746126618.040853:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.040855:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.040862:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.040869:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.040896:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 7 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.040907:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721388672:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126618.040969:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.041301:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721388544:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126618.041319:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.041338:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1964:x1830945721506944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 12106us (12709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.041345:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7110 00000100:00100000:0.0:1746126618.042551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.043098:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721507456 00000100:00100000:1.0:1746126618.043103:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721507456 00002000:00100000:1.0:1746126618.043130:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1597440->1601535) req@ffff88009e806680 x1830945721507456/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.043138:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806680 with x1830945721507456 ext(1597440->1601535) 00002000:00010000:1.0:1746126618.043142:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e806680 00000100:00100000:1.0:1746126618.043162:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7788 00000100:00100000:1.0:1746126618.043167:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721507456:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126618.043280:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721507456:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 112us (731us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126618.043284:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7788 00002000:00100000:1.0:1746126618.043289:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1597440->1601535) req@ffff88009e806680 x1830945721507456/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.043295:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806680 with x1830945721507456 ext(1597440->1601535) 00002000:00010000:1.0:1746126618.043297:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e806680 00000100:00100000:2.0:1746126618.043811:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721388672:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.043849:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.043870:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721507072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3122us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.043879:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7113 00000100:00100000:0.0:1746126618.049339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.049457:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721507712 00000100:00100000:3.0:1746126618.049467:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721507712 00002000:00100000:3.0:1746126618.049502:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2924544->2928639) req@ffff88009e806300 x1830945721507712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.049511:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806300 with x1830945721507712 ext(2924544->2928639) 00002000:00010000:3.0:1746126618.049515:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e806300 00000100:00100000:3.0:1746126618.049540:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7789 00000100:00100000:3.0:1746126618.049547:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1966:x1830945721507712:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.049683:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1966:x1830945721507712:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 136us (350us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.049689:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7789 00002000:00100000:3.0:1746126618.049694:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2924544->2928639) req@ffff88009e806300 x1830945721507712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.049701:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806300 with x1830945721507712 ext(2924544->2928639) 00002000:00010000:3.0:1746126618.049703:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e806300 00000100:00100000:0.0:1746126618.053544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.053699:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721507968 00000100:00100000:1.0:1746126618.053707:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721507968 00002000:00100000:1.0:1746126618.053738:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1843200->1847295) req@ffff88009e804380 x1830945721507968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.053746:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804380 with x1830945721507968 ext(1843200->1847295) 00002000:00010000:1.0:1746126618.053751:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e804380 00000100:00100000:1.0:1746126618.053781:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7790 00000100:00100000:1.0:1746126618.053788:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721507968:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126618.053946:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721507968:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 158us (407us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126618.053952:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7790 00002000:00100000:1.0:1746126618.053958:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1843200->1847295) req@ffff88009e804380 x1830945721507968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.053965:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804380 with x1830945721507968 ext(1843200->1847295) 00002000:00010000:1.0:1746126618.053968:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e804380 00000100:00100000:0.0:1746126618.055920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.055995:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721508096 00000100:00100000:1.0:1746126618.056002:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721508096 00000100:00100000:1.0:1746126618.056061:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13645 00000100:00100000:1.0:1746126618.056068:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31318:x1830945721508096:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126618.056080:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.056092:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de6f expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.056112:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.056118:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.056123:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.056124:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.056127:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3481599] (req 3145728->3481599) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.056149:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.056158:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746126618.056168:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721388800:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.056235:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.056242:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746126618.056249:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721388928:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.056265:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00080000:3.0:1746126618.056321:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746126618.062536:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721388800:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.062547:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721388928:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.062574:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3481599] (req 3145728->3481599) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.062589:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093416000, rc 0) 00000100:00100000:2.0:1746126618.063460:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31318:x1830945721508096:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7391us (7543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.063467:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13645 00000100:00100000:0.0:1746126618.064721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.065020:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721508224 00000100:00100000:2.0:1746126618.065027:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721508224 00010000:00010000:2.0:1746126618.065067:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126618.065388:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7114 00000100:00100000:2.0:1746126618.065395:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721508224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.065408:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.065426:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.065435:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.065451:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f83800/0xb50e825867613c0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de4c expref: 13 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.065684:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.065723:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721508224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 328us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.065728:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7114 00000100:00100000:0.0:1746126618.074116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.074172:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721508352 00000100:00100000:2.0:1746126618.074180:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721508352 00010000:00010000:2.0:1746126618.074226:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746126618.074260:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7115 00000100:00100000:2.0:1746126618.074266:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721508352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.074278:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1746126618.074406:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746126618.074504:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.074516:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.074535:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f82800/0xb50e825867613c04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de45 expref: 14 pid: 4640 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746126618.074559:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.074561:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.074567:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.074575:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.074601:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.074612:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721389056:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.075985:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.080032:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721389056:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.080059:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.080095:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721508352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5828us (5984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.080104:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7115 00000100:00100000:0.0:1746126618.085147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.085693:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721508608 00000100:00100000:3.0:1746126618.085701:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721508608 00002000:00100000:3.0:1746126618.085737:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3477504->3481599) req@ffff8800920be300 x1830945721508608/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.085746:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920be300 with x1830945721508608 ext(3477504->3481599) 00002000:00010000:3.0:1746126618.085751:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920be300 00000100:00100000:3.0:1746126618.086615:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7791 00000100:00100000:3.0:1746126618.086624:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721508608:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.087734:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721508608:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1108us (2591us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.087740:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7791 00002000:00100000:3.0:1746126618.087746:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3477504->3481599) req@ffff8800920be300 x1830945721508608/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.087752:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920be300 with x1830945721508608 ext(3477504->3481599) 00002000:00010000:3.0:1746126618.087755:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920be300 00000100:00100000:2.0:1746126618.095549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.095591:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721508864 00000100:00100000:0.0:1746126618.095598:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721508864 00000100:00100000:0.0:1746126618.095655:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3795 00000100:00100000:0.0:1746126618.095662:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31318:x1830945721508864:12345-192.168.203.2@tcp:35:multiop.0 00000100:00080000:2.0:1746126618.095797:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126618.095864:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31318:x1830945721508864:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 201us (321us total) trans 8589943146 rc 0/0 00000100:00100000:0.0:1746126618.095870:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3795 00000100:00100000:0.0:1746126618.124110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.125347:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721509120 00000100:00100000:1.0:1746126618.125355:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721509120 00000100:00100000:2.0:1746126618.125395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.125409:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721509248 00000100:00100000:2.0:1746126618.125413:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721509248 00000100:00100000:2.0:1746126618.126017:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8965 00000100:00100000:2.0:1746126618.126024:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31328:x1830945721509248:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00080000:3.0:1746126618.126032:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746126618.126043:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.126067:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87fc00/0xb50e825867613c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de7d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.126115:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126125:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126134:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126147:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126152:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126156:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126237:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126245:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.126251:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.126278:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.126288:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 227 pid: 15560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.126298:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721389184:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.126377:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.126483:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8966 00000100:00100000:1.0:1746126618.126490:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+227:31327:x1830945721509120:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.126499:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.126504:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093416600/0xb50e825867613c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de76 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.126551:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126558:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126564:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126570:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126574:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126578:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126634:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093416a00/0xb50e825867613c9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126640:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093416a00/0xb50e825867613c9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126646:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093416a00/0xb50e825867613c9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126618.126653:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126618.126717:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126723:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126727:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126731:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093417400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126618.126735:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126740:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126748:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126618.126750:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126618.126753:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126757:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417400/0xb50e825867613c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126784:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126789:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126793:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126797:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093416c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126618.126799:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126804:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126809:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009eb53b00) 00010000:00010000:1.0:1746126618.126811:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126618.126813:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126817:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093416c00/0xb50e825867613c97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126618.126936:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093416600/0xb50e825867613c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de76 expref: 230 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.126949:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093416a00/0xb50e825867613c9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de76 expref: 229 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.126954:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126618.126956:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126618.126958:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126618.126962:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126618.126966:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093416a00, rc 0) 00000100:00100000:1.0:1746126618.127108:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+229:31327:x1830945721509120:12345-192.168.203.2@tcp:101:cat.0 Request processed in 618us (3005us total) trans 8589943147 rc 0/0 00000100:00100000:1.0:1746126618.127114:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8966 00000100:00100000:0.0:1746126618.129007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.129085:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721509504 00000100:00100000:1.0:1746126618.129090:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721509504 00000100:00100000:1.0:1746126618.129121:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3796 00000100:00100000:1.0:1746126618.129126:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+229:31327:x1830945721509504:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126618.129253:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:31327:x1830945721509504:12345-192.168.203.2@tcp:35:cat.0 Request processed in 125us (249us total) trans 8589943148 rc 0/0 00000100:00100000:1.0:1746126618.129258:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3796 00000100:00100000:2.0:1746126618.129423:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721389184:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.129445:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126618.129729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.129842:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721509632 00000100:00100000:2.0:1746126618.129845:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721509632 00000100:00100000:2.0:1746126618.129869:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 704 00000100:00100000:2.0:1746126618.129873:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1963:x1830945721509632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.129881:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.129894:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093416a00/0xb50e825867613c9e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de76 expref: 230 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.130008:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.130013:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.130019:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.130024:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.130029:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.130173:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721509632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 298us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.130178:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 704 00000100:00100000:0.0:1746126618.131238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.131263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.131294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.131443:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721509760 00000100:00100000:3.0:1746126618.131447:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721509760 00000100:00100000:3.0:1746126618.131467:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721509888 00000100:00100000:3.0:1746126618.131469:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721509888 00000100:00100000:3.0:1746126618.131482:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13646 00000100:00100000:3.0:1746126618.131487:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721509760:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.131498:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.131510:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec06600/0xb50e825867613cac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de84 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.131551:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721389312:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126618.131608:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.131625:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13647 00000100:00100000:3.0:1746126618.131631:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721509888:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.131638:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.131647:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec06a00/0xb50e825867613cb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de8b expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.131671:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721389440:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126618.131692:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.131741:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721510144 00000100:00100000:1.0:1746126618.131744:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721510144 00000100:00100000:1.0:1746126618.131763:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3797 00000100:00100000:1.0:1746126618.131768:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:26822:x1830945721510144:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126618.131910:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:26822:x1830945721510144:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 141us (614us total) trans 8589943149 rc 0/0 00000100:00100000:1.0:1746126618.131916:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3797 00000100:00100000:0.0:1746126618.134163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:3.0:1746126618.134273:0:4641:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126613 -> 1746126617 00002000:00010000:3.0:1746126618.134276:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126613 -> 1746126617 00002000:00010000:3.0:1746126618.134278:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126613 -> 1746126617 00000100:00100000:3.0:1746126618.134292:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721389440:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126618.134311:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec06a00/0xb50e825867613cb3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de8b expref: 22 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.134322:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec06a00/0xb50e825867613cb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de8b expref: 22 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.134332:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec06a00, rc 0) 00000100:00100000:3.0:1746126618.134373:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721509888:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2742us (3108us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.134378:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13647 00000100:00100000:3.0:1746126618.134413:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721389312:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126618.134423:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec06600/0xb50e825867613cac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de84 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.134430:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec06600/0xb50e825867613cac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de84 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.134435:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec06600, rc 0) 00000100:00100000:3.0:1746126618.134449:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721509760:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2962us (3213us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.134456:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13646 00000100:00100000:2.0:1746126618.134508:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721510272 00000100:00100000:2.0:1746126618.134513:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721510272 00010000:00010000:2.0:1746126618.134536:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 230 pid: 15560 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.134564:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7116 00000100:00100000:2.0:1746126618.134570:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1963:x1830945721510272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.134582:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.134587:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 230 pid: 15560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.134595:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 230 pid: 15560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.134610:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f131400/0xb50e825867613b40 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd8f expref: 230 pid: 15560 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.134618:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.134622:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.134629:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.134638:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.134661:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.134736:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721510272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 149us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.134741:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7116 00010000:00010000:3.0:1746126618.134782:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.134788:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746126618.134815:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126618.134818:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126618.134960:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.134970:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.134977:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.134982:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.134988:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.134996:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d87ea00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126618.134999:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135005:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135012:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126618.135015:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126618.135018:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135022:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87ea00/0xb50e825867613c74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135031:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135035:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135039:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135043:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbca200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126618.135045:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135048:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135064:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009eb53b00) 00010000:00010000:3.0:1746126618.135066:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126618.135068:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135071:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbca200/0xb50e825867613c7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.135094:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d87fc00/0xb50e825867613c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.135102:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.135108:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126618.135109:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126618.135111:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbcac00, rc 0) 00000100:00100000:3.0:1746126618.135141:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31328:x1830945721509248:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 9118us (9748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.135146:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8965 00000100:00100000:0.0:1746126618.137662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.137696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.137723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.137757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.137853:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721510400 00000100:00100000:3.0:1746126618.137859:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721510400 00000100:00100000:3.0:1746126618.137883:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721510528 00000100:00100000:3.0:1746126618.137885:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721510528 00000100:00100000:3.0:1746126618.137894:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721510656 00000100:00100000:3.0:1746126618.137895:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721510656 00000100:00100000:3.0:1746126618.137904:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721510784 00000100:00100000:3.0:1746126618.137906:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721510784 00000100:00100000:3.0:1746126618.137916:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13648 00000100:00100000:3.0:1746126618.137922:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721510400:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126618.137936:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.137949:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867613cba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de92 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.137988:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721389568:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126618.138049:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.138075:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13649 00000100:00100000:3.0:1746126618.138080:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721510528:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126618.138086:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.138094:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4de99 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.138106:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.138108:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.138114:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 8 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.138126:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 8 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.138133:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec06800, rc 0) 00000100:00100000:3.0:1746126618.138149:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721510528:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 70us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.138155:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13649 00000100:00100000:3.0:1746126618.138167:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13650 00000100:00100000:3.0:1746126618.138171:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721510656:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126618.138175:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.138180:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec06400/0xb50e825867613cc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dea0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.138198:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721389696:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126618.138215:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.138350:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13651 00000100:00100000:2.0:1746126618.138356:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721510784:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126618.138363:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.138370:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbca600/0xb50e825867613ccf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dea7 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.138390:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721389824:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.138415:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00002000:00010000:2.0:1746126618.140586:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126615 -> 1746126617 00000100:00100000:2.0:1746126618.140605:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721389568:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.140627:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867613cba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de92 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.140636:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec07c00/0xb50e825867613cba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de92 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.140644:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec07c00, rc 0) 00000100:00100000:2.0:1746126618.140673:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721510400:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 2751us (3015us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.140680:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13648 00000100:00100000:2.0:1746126618.140720:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721389696:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.140730:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec06400/0xb50e825867613cc8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dea0 expref: 8 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.140737:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec06400/0xb50e825867613cc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dea0 expref: 8 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.140743:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec06400, rc 0) 00000100:00100000:2.0:1746126618.140755:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721510656:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 2584us (3032us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.140759:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13650 00000100:00100000:3.0:1746126618.142200:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721389824:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126618.142219:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbca600/0xb50e825867613ccf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dea7 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.142228:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbca600/0xb50e825867613ccf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dea7 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.142237:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbca600, rc 0) 00000100:00100000:3.0:1746126618.142264:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721510784:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3908us (4506us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.142270:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13651 00000100:00100000:0.0:1746126618.144014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.144751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.146092:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721511296 00000100:00100000:1.0:1746126618.146101:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721511296 00002000:00100000:1.0:1746126618.146140:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800920bd180 x1830945721511296/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 504/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.146153:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bd180 with x1830945721511296 ext(1048576->2097151) 00002000:00010000:1.0:1746126618.146158:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bd180 00000100:00100000:1.0:1746126618.146178:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721511040 00000100:00100000:1.0:1746126618.146181:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721511040 00002000:00100000:1.0:1746126618.146194:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800920bf100 x1830945721511040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.146199:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bf100 with x1830945721511040 ext(0->1048575) 00002000:00010000:1.0:1746126618.146202:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920bf100 00000100:00100000:1.0:1746126618.146225:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7792 00000100:00100000:1.0:1746126618.146231:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721511296:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.146286:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7793 00000100:00100000:2.0:1746126618.146293:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721511040:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.150016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.150042:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721511552 00000100:00100000:3.0:1746126618.150049:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721511552 00000100:00100000:3.0:1746126618.150091:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8967 00000100:00100000:3.0:1746126618.150098:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31328:x1830945721511552:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126618.150112:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.150126:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06e00/0xb50e825867613cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4deae expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.150198:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.150210:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.150217:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.150240:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.150250:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 8 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.150266:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721389952:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.150325:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.163266:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721511296:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17026us (19247us total) trans 0 rc 798720/798720 00000100:00100000:1.0:1746126618.163276:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7792 00002000:00100000:1.0:1746126618.163285:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800920bd180 x1830945721511296/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 504/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.163293:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bd180 with x1830945721511296 ext(1048576->2097151) 00002000:00010000:1.0:1746126618.163298:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bd180 00000100:00100000:3.0:1746126618.163730:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721389952:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.163748:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126618.164595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.164697:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721511680 00000100:00100000:2.0:1746126618.164702:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721511680 00010000:00010000:2.0:1746126618.164723:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 9 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.165031:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7117 00000100:00100000:2.0:1746126618.165038:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721511680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.165066:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.165072:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 9 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.165086:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 9 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.165104:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcac00/0xb50e825867613c82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de7d expref: 9 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.165125:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.165129:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.165138:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.165143:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.165705:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.165738:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721511680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 700us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.165744:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7117 00010000:00010000:2.0:1746126618.165823:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.165841:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126618.165856:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126618.165958:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec06e00/0xb50e825867613cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deae expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.165974:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deae expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.165980:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.165983:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126618.165985:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec07a00, rc 0) 00000100:00100000:2.0:1746126618.166006:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31328:x1830945721511552:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 15909us (15998us total) trans 8589943150 rc 0/0 00000100:00100000:2.0:1746126618.166012:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8967 00000100:00100000:3.0:1746126618.167231:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721511040:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20936us (22478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.167238:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7793 00002000:00100000:3.0:1746126618.167244:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800920bf100 x1830945721511040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.167251:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bf100 with x1830945721511040 ext(0->1048575) 00002000:00010000:3.0:1746126618.167255:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920bf100 00000100:00100000:0.0:1746126618.172513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.175386:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721511936 00000100:00100000:2.0:1746126618.175396:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721511936 00000100:00100000:2.0:1746126618.175478:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8968 00000100:00100000:2.0:1746126618.175486:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31328:x1830945721511936:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126618.175504:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.175507:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126618.175529:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec07a00/0xb50e825867613cdd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deae expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.175559:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.175562:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126618.175571:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcb800/0xb50e825867613ceb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4deb5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.175638:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.175649:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.175657:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126618.175665:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126618.175749:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcb800/0xb50e825867613ceb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.175761:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.175767:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.175769:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126618.175771:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbcba00, rc 0) 00000100:00100000:2.0:1746126618.175815:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31328:x1830945721511936:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 330us (3307us total) trans 8589943151 rc 0/0 00000100:00100000:2.0:1746126618.175820:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8968 00000100:00100000:0.0:1746126618.184979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.185078:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512064 00000100:00100000:1.0:1746126618.185086:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512064 00000100:00100000:1.0:1746126618.185135:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8969 00000100:00100000:1.0:1746126618.185142:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31328:x1830945721512064:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126618.185161:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.185176:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613d00 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4debc expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.185220:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613d00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4debc expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.185231:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613d00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4debc expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.185246:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126618.185249:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126618.185251:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093417200, rc 0) 00000100:00100000:1.0:1746126618.185304:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31328:x1830945721512064:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 162us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.185310:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8969 00000100:00100000:0.0:1746126618.187109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.187154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.187229:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512192 00000100:00100000:2.0:1746126618.187235:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512192 00000100:00100000:2.0:1746126618.187260:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512320 00000100:00100000:2.0:1746126618.187262:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512320 00000100:00100000:2.0:1746126618.187275:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13652 00000100:00100000:2.0:1746126618.187280:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721512192:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126618.187308:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.187321:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.187332:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.187338:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 11 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.187343:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.187345:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.187347:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.187368:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 11 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.187378:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 11 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.187389:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721390080:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.187456:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.187463:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 12 pid: 8438 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.187471:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721390208:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.187495:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.187502:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 7 pid: 8436 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.187509:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721390336:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.187523:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.187586:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13653 00000100:00100000:3.0:1746126618.187592:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721512320:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:3.0:1746126618.187609:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.187618:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.187624:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 20 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.187634:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.187639:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.187640:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.187641:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.187654:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.187660:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 6 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.187668:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721390464:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.187688:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 20 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.187694:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 20 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.187701:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721390592:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.187714:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 7 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.187724:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 7 pid: 4640 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.187729:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721390720:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.187749:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.189534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.189566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.192108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.193392:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512448 00000100:00100000:2.0:1746126618.193400:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512448 00000100:00100000:0.0:1746126618.193408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.195892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.196503:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512576 00000100:00100000:1.0:1746126618.196510:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512576 00000100:00100000:1.0:1746126618.196540:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512704 00000100:00100000:1.0:1746126618.196542:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512704 00000100:00100000:1.0:1746126618.196560:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512832 00000100:00100000:1.0:1746126618.196562:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512832 00000100:00100000:1.0:1746126618.196577:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13654 00000100:00100000:1.0:1746126618.196583:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721512448:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126618.196617:0:20294:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196631:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196636:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126618.196638:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126618.196639:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196663:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196674:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 20 pid: 8437 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.196684:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721390848:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.196739:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.196757:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13655 00000100:00100000:1.0:1746126618.196764:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721512576:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126618.196780:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196789:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196796:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 9 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.196807:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196812:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.196813:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.196815:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196842:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196849:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.196858:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721390976:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.196882:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 9 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.196889:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 9 pid: 17475 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746126618.196895:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721391104:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.196914:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.196925:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.196931:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721391232:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.196943:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.197296:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13656 00000100:00100000:2.0:1746126618.197304:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721512704:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126618.197320:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.197329:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.197334:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126618.197335:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126618.197337:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.197337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.197349:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513088 00000100:00100000:0.0:1746126618.197351:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513088 00010000:00010000:2.0:1746126618.197352:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.197358:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.197362:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721512960 00000100:00100000:0.0:1746126618.197364:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721512960 00000100:00100000:2.0:1746126618.197366:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721391360:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.197372:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13657 00000100:00100000:0.0:1746126618.197375:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721512832:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126618.197389:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.197398:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3840 going to sleep for 11 seconds 00010000:00010000:0.0:1746126618.197398:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 6 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.197403:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126618.197404:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126618.197406:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.197408:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13658 00000100:00100000:2.0:1746126618.197413:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721513088:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.197420:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126618.197422:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 6 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.197427:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f1ea400/0xb50e825867613d31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4deca expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.197429:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 6 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.197436:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721391488:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.197447:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721391616:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126618.197452:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.197461:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.197478:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13659 00000100:00100000:2.0:1746126618.197483:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+13:1966:x1830945721512960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.197489:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.197494:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1ebe00/0xb50e825867613d38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dec3 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.197513:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721391744:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.197531:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.197556:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721390080:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.197992:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721390336:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.198202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.198203:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721390208:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.198221:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.198242:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513472 00000100:00100000:2.0:1746126618.198244:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513472 00010000:00010000:2.0:1746126618.198259:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.198275:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7118 00000100:00100000:2.0:1746126618.198280:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721513472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.198287:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.198302:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.198310:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.198327:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.198357:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721513472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.198362:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7118 00000100:00100000:3.0:1746126618.198763:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721390464:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.198771:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721390592:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.198779:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867613a98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd5e expref: 9 pid: 4640 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.198800:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721390720:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.198812:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.201807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.201862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.201881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.201893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.201897:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513600 00000100:00100000:2.0:1746126618.201904:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513600 00000100:00100000:0.0:1746126618.201906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126618.201929:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 15 pid: 8438 timeout: 840 lvb_type: 1 00000100:00100000:0.0:1746126618.201944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.201949:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513344 00000100:00100000:2.0:1746126618.201951:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513344 00010000:00010000:2.0:1746126618.201959:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 10 pid: 8436 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.201967:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513216 00000100:00100000:2.0:1746126618.201969:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513216 00010000:00010000:2.0:1746126618.201976:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 12 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.201983:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513728 00000100:00100000:2.0:1746126618.201985:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513728 00010000:00010000:2.0:1746126618.201991:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 7 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.201998:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513856 00000100:00100000:0.0:1746126618.201998:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721391488:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.201999:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513856 00010000:00010000:2.0:1746126618.202006:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 23 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746126618.202013:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.202014:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7119 00000100:00100000:2.0:1746126618.202019:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721513600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.202028:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126618.202029:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721513984 00000100:00100000:0.0:1746126618.202031:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721513984 00010000:00010000:2.0:1746126618.202044:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 15 pid: 8438 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202064:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 15 pid: 8438 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202080:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a9ec00/0xb50e825867613b63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd96 expref: 15 pid: 8438 timeout: 840 lvb_type: 1 00002000:00100000:0.0:1746126618.202081:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1597440->1847295) req@ffff880099370a80 x1830945721513984/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.202089:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370a80 with x1830945721513984 ext(1597440->1847295) 00010000:00010000:0.0:1746126618.202095:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 24 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.202099:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126618.202106:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 24 pid: 8437 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746126618.202111:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099370a80 00000100:00100000:0.0:1746126618.202121:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1777 00000100:00100000:0.0:1746126618.202126:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721513984:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126618.202127:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+14:1966:x1830945721513600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.202132:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7119 00000100:00100000:2.0:1746126618.202143:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7120 00000100:00100000:2.0:1746126618.202147:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721513344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.202152:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.202158:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 10 pid: 8436 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202164:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 10 pid: 8436 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202173:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b391600/0xb50e825867613a91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd57 expref: 10 pid: 8436 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202180:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.202191:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721513344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.202196:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7120 00000100:00100000:2.0:1746126618.202204:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7121 00000100:00100000:2.0:1746126618.202208:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721513216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.202214:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.202221:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 12 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202228:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 12 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746126618.202236:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721390976:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.202238:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a592c200/0xb50e825867613b47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dd9d expref: 12 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746126618.202243:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721391104:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.202245:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.202246:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.202250:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.202250:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721391232:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.202257:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202272:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.202285:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721513216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.202289:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7121 00000100:00100000:2.0:1746126618.202299:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7122 00000100:00100000:2.0:1746126618.202303:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1963:x1830945721513728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.202308:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.202315:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 7 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202322:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 7 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202336:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a592ce00/0xb50e825867613b4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dda4 expref: 7 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202343:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.202354:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1963:x1830945721513728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 51us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.202358:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7122 00000100:00100000:2.0:1746126618.202365:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7123 00000100:00100000:2.0:1746126618.202368:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721513856:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.202373:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.202377:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 24 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202384:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 24 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202393:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e825867613b86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddc7 expref: 24 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.202400:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.202402:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.202404:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202409:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202420:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.202429:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721513856:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 61us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.202433:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7123 00010000:00010000:1.0:1746126618.202458:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.202469:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721391360:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.202480:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.202487:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721390848:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.202491:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.202495:0:20294:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202497:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202512:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202518:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202525:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202530:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbcb800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126618.202533:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202539:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202547:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.202552:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbcb800/0xb50e825867613d07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.202583:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721512192:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 15303us (15479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.202590:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13652 00000100:00100000:2.0:1746126618.202618:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721391744:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.202633:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1ebe00/0xb50e825867613d38 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dec3 expref: 13 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.202642:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1ebe00/0xb50e825867613d38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dec3 expref: 13 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.202649:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1ebe00, rc 0) 00000100:00100000:2.0:1746126618.202667:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+12:1966:x1830945721512960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5183us (5329us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.202671:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13659 00000100:00100000:2.0:1746126618.202701:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721391616:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.202715:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f1ea400/0xb50e825867613d31 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deca expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.202722:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f1ea400/0xb50e825867613d31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deca expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.202728:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1ea400, rc 0) 00000100:00100000:2.0:1746126618.202742:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721513088:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5329us (6856us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.202747:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13658 00010000:00010000:3.0:1746126618.202822:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202844:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202857:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202862:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202868:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202873:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec81c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126618.202875:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202880:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202889:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.202894:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81c00/0xb50e825867613d0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.202924:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721512320:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 15332us (15770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.202929:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13653 00000100:00100000:0.0:1746126618.207947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.207972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.208545:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514112 00000100:00100000:3.0:1746126618.208552:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514112 00010000:00010000:3.0:1746126618.208589:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.208612:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7124 00000100:00100000:3.0:1746126618.208619:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721514112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.208630:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.208647:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.208656:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.208673:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e20000/0xb50e825867613bef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de30 expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.208685:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.210616:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721514112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1992us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.210648:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514368 00000100:00100000:1.0:1746126618.210652:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514368 00002000:00100000:1.0:1746126618.210681:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3481599) req@ffff880099372d80 x1830945721514368/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.210689:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099372d80 with x1830945721514368 ext(3145728->3481599) 00010000:00010000:1.0:1746126618.210696:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.210710:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 11 pid: 4640 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746126618.210715:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099372d80 00000100:00100000:1.0:1746126618.210727:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1778 00000100:00100000:1.0:1746126618.210732:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721514368:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126618.210767:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7124 00000100:00100000:0.0:1746126618.211236:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.211262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.211277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.211338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.211383:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721513984:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9255us (9437us total) trans 17179873233 rc 0/0 00000100:00100000:2.0:1746126618.211390:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1777 00002000:00100000:2.0:1746126618.211395:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1597440->1847295) req@ffff880099370a80 x1830945721513984/t17179873233(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.211402:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370a80 with x1830945721513984 ext(1597440->1847295) 00010000:00010000:2.0:1746126618.211408:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 22 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.211416:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 22 pid: 8437 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.211422:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099370a80 00000100:00100000:2.0:1746126618.211433:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514496 00000100:00100000:2.0:1746126618.211435:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514496 00002000:00100000:2.0:1746126618.211447:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2924544->3145727) req@ffff880099371500 x1830945721514496/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.211454:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371500 with x1830945721514496 ext(2924544->3145727) 00010000:00010000:2.0:1746126618.211458:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 6 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.211465:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 6 pid: 4640 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.211470:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099371500 00000100:00100000:2.0:1746126618.211484:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1779 00000100:00100000:2.0:1746126618.211488:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+6:1964:x1830945721514496:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126618.211601:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514240 00000100:00100000:3.0:1746126618.211604:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514240 00010000:00010000:3.0:1746126618.211617:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 8 pid: 17475 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.211631:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514752 00000100:00100000:3.0:1746126618.211633:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514752 00010000:00010000:3.0:1746126618.211639:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.211650:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7125 00000100:00100000:3.0:1746126618.211655:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721514240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.211663:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.211677:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 8 pid: 17475 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.211686:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 8 pid: 17475 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.211687:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514624 00000100:00100000:2.0:1746126618.211690:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514624 00010000:00010000:3.0:1746126618.211700:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec06800/0xb50e825867613cc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de99 expref: 8 pid: 17475 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.211705:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13660 00000100:00100000:2.0:1746126618.211709:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+13:31327:x1830945721514624:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.211711:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126618.211716:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.211724:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ded1 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.211728:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721514240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 73us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.211733:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7125 00010000:00010000:2.0:1746126618.211737:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126618.211740:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.211741:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7126 00000100:00100000:3.0:1746126618.211745:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+14:1964:x1830945721514752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.211746:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126618.211749:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 14 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.211750:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.211756:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 14 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.211762:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 14 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.211765:0:4641:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.211771:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e21200/0xb50e825867613be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de22 expref: 14 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.211775:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 14 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.211777:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.211779:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.211782:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.211782:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e664a00, rc 0) 00010000:00010000:3.0:1746126618.211788:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.211794:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+13:31327:x1830945721514624:12345-192.168.203.2@tcp:101:cat.0 Request processed in 85us (516us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126618.211798:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.211798:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13660 00000100:00100000:3.0:1746126618.211809:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+12:1964:x1830945721514752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 63us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.211813:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7126 00010000:00010000:1.0:1746126618.212654:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212662:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212677:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212681:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212687:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212692:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093416e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126618.212694:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212703:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212712:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.212717:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093416e00/0xb50e825867613d1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.212781:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721512576:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 16015us (23217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.212786:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13655 00000100:00100000:2.0:1746126618.217993:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721514368:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 7252us (10011us total) trans 21474840381 rc 0/0 00000100:00100000:2.0:1746126618.218004:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1778 00002000:00100000:2.0:1746126618.218013:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3481599) req@ffff880099372d80 x1830945721514368/t21474840381(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.218021:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099372d80 with x1830945721514368 ext(3145728->3481599) 00010000:00010000:2.0:1746126618.218030:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.218041:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.218047:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099372d80 00000100:00100000:0.0:1746126618.219936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.220009:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721514880 00000100:00100000:1.0:1746126618.220016:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721514880 00010000:00010000:1.0:1746126618.220040:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 22 pid: 8437 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.220081:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7127 00000100:00100000:1.0:1746126618.220086:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721514880:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.220096:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.220113:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 22 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.220122:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 22 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.220143:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d87e600/0xb50e825867613c58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1847295) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de61 expref: 22 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.220155:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.220157:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.220160:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.220167:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.220186:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126618.220214:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721514880:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.220220:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7127 00000100:00100000:3.0:1746126618.223916:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721514496:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 12418us (12644us total) trans 17179873234 rc 0/0 00000100:00100000:3.0:1746126618.223927:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1779 00002000:00100000:3.0:1746126618.223937:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2924544->3145727) req@ffff880099371500 x1830945721514496/t17179873234(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.223945:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371500 with x1830945721514496 ext(2924544->3145727) 00010000:00010000:3.0:1746126618.223953:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 8 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.223963:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 8 pid: 4640 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.223970:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099371500 00010000:00010000:2.0:1746126618.224691:0:20294:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224700:0:20294:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224718:0:20294:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224725:0:20294:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224732:0:20294:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224738:0:20294:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093416c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126618.224741:0:20294:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224747:0:20294:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224760:0:20294:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.224765:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093416c00/0xb50e825867613d15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.226098:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721512448:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 29511us (36571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.226107:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13654 00000100:00100000:0.0:1746126618.230982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.231040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.231071:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721515264 00000100:00100000:0.0:1746126618.231078:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721515264 00010000:00010000:0.0:1746126618.231106:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.231130:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7128 00000100:00100000:0.0:1746126618.231136:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721515264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.231147:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.231164:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.231179:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.231196:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093416000/0xb50e825867613c66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de6f expref: 12 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.231211:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.231212:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.231216:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.231222:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.231241:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126618.231269:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721515264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 134us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126618.231275:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7128 00000100:00100000:3.0:1746126618.231371:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721515136 00000100:00100000:3.0:1746126618.231375:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721515136 00000100:00100000:3.0:1746126618.231399:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8970 00000100:00100000:3.0:1746126618.231403:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:31330:x1830945721515136:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126618.231419:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.231429:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff1000/0xb50e825867613d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ded8 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.231502:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231511:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231519:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231530:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231535:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231540:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231617:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231625:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.231630:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.231649:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.231660:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 9 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.231670:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721391872:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.234648:0:4640:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234661:0:4640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234686:0:4640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234692:0:4640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234698:0:4640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234704:0:4640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f1eb000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126618.234707:0:4640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234713:0:4640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234727:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.234729:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.234738:0:4640:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 11 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234750:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 11 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.234778:0:4640:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 11 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.234790:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721392000:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126618.235816:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.236797:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.237192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.237238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.237258:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721515392 00000100:00100000:3.0:1746126618.237277:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721515776 00000100:00100000:1.0:1746126618.237279:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721515392 00000100:00100000:3.0:1746126618.237280:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721515776 00010000:00010000:1.0:1746126618.237307:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 8 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.237310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.237312:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8971 00000100:00100000:3.0:1746126618.237318:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31335:x1830945721515776:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.237333:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126618.237333:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721515520 00000100:00100000:1.0:1746126618.237335:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721515520 00010000:00010000:1.0:1746126618.237344:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 10 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.237346:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc800/0xb50e825867613d62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dedf expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.237422:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126618.237459:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7129 00000100:00100000:0.0:1746126618.237466:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721515392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.237474:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.237489:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 8 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.237503:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 8 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.237518:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093416800/0xb50e825867613c5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de68 expref: 8 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.237529:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.237530:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.237533:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237539:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237558:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126618.237587:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1963:x1830945721515392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126618.237591:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7129 00000100:00100000:0.0:1746126618.237605:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7130 00000100:00100000:0.0:1746126618.237609:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721515520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.237615:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.237619:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 10 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.237627:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 10 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.237642:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126618.237646:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126618.237652:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126618.237657:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126618.237665:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126618.237682:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721515520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 72us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126618.237687:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7130 00010000:00010000:0.0:1746126618.237721:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237728:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237743:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237749:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237755:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237765:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092f82400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126618.237768:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237774:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237787:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.237793:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f82400/0xb50e825867613d2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.237861:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721512832:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 40483us (44452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126618.237867:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13657 00010000:00010000:2.0:1746126618.237919:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbcba00/0xb50e825867613cf2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deb5 expref: 9 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.237931:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721391872:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.237952:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.237958:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126618.237958:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.237967:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.237973:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126618.237973:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.237977:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126618.237978:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126618.237994:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126618.238069:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238077:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238082:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126618.238087:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126618.238098:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.238103:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.238110:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.238114:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fdc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126618.238117:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126618.238117:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.238121:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238126:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238129:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fc000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126618.238131:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126618.238134:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126618.238135:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238390:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126618.238393:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126618.238396:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238400:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e825867613d7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238415:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238420:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238423:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238426:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fde00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126618.238428:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238432:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238438:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126618.238440:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126618.238442:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238446:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fde00/0xb50e825867613d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238453:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238457:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238461:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238465:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fcc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126618.238467:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238471:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238476:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135bcba00) 00010000:00010000:3.0:1746126618.238478:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126618.238481:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238484:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fcc00/0xb50e825867613d70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126618.238510:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc800/0xb50e825867613d62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dedf expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.238516:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc800/0xb50e825867613d62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dedf expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.238522:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fc800, rc 0) 00000100:00100000:3.0:1746126618.238546:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31335:x1830945721515776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1228us (1307us total) trans 8589943153 rc 301/301 00000100:00100000:3.0:1746126618.238551:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8971 00010000:00010000:2.0:1746126618.240668:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.240673:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126618.240680:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240686:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fdc00/0xb50e825867613d5b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240707:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240712:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240717:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240721:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e665c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.240724:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240729:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240742:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126618.240744:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.240746:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240749:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e665c00/0xb50e825867613d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240755:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240759:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240763:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240766:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fda00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.240768:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240772:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240776:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135bcba00) 00010000:00010000:2.0:1746126618.240778:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.240779:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240783:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fda00/0xb50e825867613d54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.240814:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff1000/0xb50e825867613d46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded8 expref: 231 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.240821:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff1000/0xb50e825867613d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded8 expref: 231 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.240841:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eff1000, rc 0) 00000100:00100000:2.0:1746126618.240887:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:31330:x1830945721515136:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9481us (9911us total) trans 8589943152 rc 301/301 00000100:00100000:2.0:1746126618.240894:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8970 00000100:00100000:3.0:1746126618.241797:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721392000:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126618.241813:0:4640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.241820:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1eb000/0xb50e825867613d23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.241888:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1965:x1830945721512704:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 44585us (49785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.241895:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13656 00000100:00100000:1.0:1746126618.243778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.243867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.243913:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721516288 00000100:00100000:2.0:1746126618.243920:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721516288 00002000:00100000:2.0:1746126618.243952:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880134c3ea00 x1830945721516288/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.243960:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ea00 with x1830945721516288 ext(2097152->3145727) 00002000:00010000:2.0:1746126618.243965:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3ea00 00000100:00100000:2.0:1746126618.243980:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7794 00000100:00100000:2.0:1746126618.243985:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+12:1965:x1830945721516288:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126618.244438:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721516032 00000100:00100000:0.0:1746126618.244443:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721516032 00000100:00100000:0.0:1746126618.244484:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3798 00000100:00100000:0.0:1746126618.244489:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d991c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31335:x1830945721516032:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126618.244615:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d991c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31335:x1830945721516032:12345-192.168.203.2@tcp:35:cat.0 Request processed in 125us (840us total) trans 8589943154 rc 0/0 00000100:00100000:0.0:1746126618.244621:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3798 00000100:00100000:1.0:1746126618.244709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.247122:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721516416 00000100:00100000:3.0:1746126618.247131:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721516416 00000100:00100000:3.0:1746126618.247164:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13661 00000100:00100000:3.0:1746126618.247169:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+14:31330:x1830945721516416:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126618.247181:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.247195:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dee6 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126618.247212:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c719, atime: 0x6813c717, ctime: 0x6813c719, blocks: 0x81d 00010000:00010000:3.0:1746126618.247228:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.247230:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.247236:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.247248:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 15 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.247256:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fd000, rc 0) 00000100:00100000:3.0:1746126618.247308:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+15:31330:x1830945721516416:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 139us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.247313:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13661 00000100:00100000:0.0:1746126618.250813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.250852:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721516672 00000100:00100000:0.0:1746126618.250859:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721516672 00000100:00100000:1.0:1746126618.251920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.251949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.251986:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721517696 00000100:00100000:2.0:1746126618.251991:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721517696 00000100:00100000:1.0:1746126618.253344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.253359:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721516800 00000100:00100000:1.0:1746126618.253364:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721516800 00000100:00100000:1.0:1746126618.253389:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721516928 00000100:00100000:1.0:1746126618.253391:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721516928 00000100:00100000:1.0:1746126618.253404:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13662 00000100:00100000:1.0:1746126618.253415:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721516672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.253429:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.253446:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4deed expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.253454:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13663 00000100:00100000:3.0:1746126618.253461:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721516800:12345-192.168.203.2@tcp:101:cat.0 00002000:00010000:1.0:1746126618.253465:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x79f 00010000:00010000:3.0:1746126618.253468:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.253477:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4def4 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.253479:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.253481:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.253487:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 12 pid: 10890 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746126618.253490:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c715, atime: 0x6813c715, ctime: 0x6813c715, blocks: 0x81f 00010000:00010000:3.0:1746126618.253497:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.253498:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.253500:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 12 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.253501:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.253508:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7dac00, rc 0) 00010000:00010000:3.0:1746126618.253509:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.253514:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fd400, rc 0) 00000100:00100000:2.0:1746126618.253642:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13664 00000100:00100000:2.0:1746126618.253648:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721516928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.253654:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.253662:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4defb expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126618.253672:0:20294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c719, atime: 0x6813c719, ctime: 0x6813c719, blocks: 0x821 00010000:00010000:2.0:1746126618.253678:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.253679:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.253683:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 10 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.253691:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 10 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.253696:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e23fe00, rc 0) 00000100:00100000:2.0:1746126618.254121:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721516928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 471us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.254127:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13664 00000100:00100000:3.0:1746126618.254128:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721516800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 667us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.254132:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13663 00000100:00100000:2.0:1746126618.254146:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8972 00000100:00100000:2.0:1746126618.254157:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31334:x1830945721517696:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:1.0:1746126618.254157:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721516672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 705us (3309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.254162:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13662 00010000:00010000:2.0:1746126618.254167:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.254179:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e23ee00/0xb50e825867613da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df17 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.254253:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.254262:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.254270:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.254280:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.254289:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.254469:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126618.254502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.254517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.254526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126618.254551:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126618.254552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126618.254559:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.254564:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126618.254574:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:0.0:1746126618.254585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.254625:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721517056 00000100:00100000:3.0:1746126618.254629:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721517056 00000100:00100000:3.0:1746126618.254645:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721517184 00000100:00100000:3.0:1746126618.254647:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721517184 00000100:00100000:3.0:1746126618.254654:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721517312 00000100:00100000:3.0:1746126618.254655:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721517312 00000100:00100000:3.0:1746126618.254675:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13665 00000100:00100000:3.0:1746126618.254684:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721517056:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.254690:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.254698:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921fc000/0xb50e825867613dcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df02 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.254704:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13666 00000100:00100000:1.0:1746126618.254709:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721517184:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.254714:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.254719:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df09 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.254726:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.254727:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746126618.254730:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721392128:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126618.254731:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.254739:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.254745:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527200, rc 0) 00000100:00100000:1.0:1746126618.254758:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721517184:12345-192.168.203.2@tcp:101:cat.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.254763:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13666 00000100:00100000:3.0:1746126618.254772:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.254772:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13667 00000100:00100000:1.0:1746126618.254776:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721517312:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.254781:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126618.254784:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721517440 00000100:00100000:3.0:1746126618.254786:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721517440 00010000:00010000:1.0:1746126618.254789:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df10 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126618.254799:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c719, atime: 0x6813c715, ctime: 0x6813c719, blocks: 0x102b 00000100:00100000:3.0:1746126618.254802:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8973 00000100:00100000:3.0:1746126618.254805:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31328:x1830945721517440:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:1.0:1746126618.254805:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.254807:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.254810:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.254822:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.254822:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.254844:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526a00, rc 0) 00010000:00010000:3.0:1746126618.254849:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417200/0xb50e825867613d00 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4debc expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.254858:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721517312:12345-192.168.203.2@tcp:101:cat.0 Request processed in 81us (331us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126618.254861:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:1.0:1746126618.254862:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13667 00010000:00010000:3.0:1746126618.254863:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.254883:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31328:x1830945721517440:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 77us (330us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746126618.254888:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8973 00000100:00100000:2.0:1746126618.254945:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721517952 00000100:00100000:2.0:1746126618.254949:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721517952 00002000:00100000:2.0:1746126618.254967:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (2035712->2039807) req@ffff880131d54e00 x1830945721517952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.254975:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54e00 with x1830945721517952 ext(2035712->2039807) 00002000:00010000:2.0:1746126618.254978:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d54e00 00000100:00100000:2.0:1746126618.254991:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7795 00000100:00100000:2.0:1746126618.254995:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721517952:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126618.255602:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721517952:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 605us (1014us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126618.255617:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7795 00002000:00100000:2.0:1746126618.255622:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (2035712->2039807) req@ffff880131d54e00 x1830945721517952/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.255629:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54e00 with x1830945721517952 ext(2035712->2039807) 00002000:00010000:2.0:1746126618.255632:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d54e00 00010000:00010000:2.0:1746126618.255804:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.255811:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.255817:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.255821:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093d4f600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.255824:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.255855:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.255863:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.255865:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126618.255868:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256098:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867613dbd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256114:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256118:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256126:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256130:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eff0400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.256132:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256135:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256141:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126618.256143:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.256145:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256148:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eff0400/0xb50e825867613daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256153:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256157:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256161:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256164:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e08c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.256166:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256169:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256180:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec44800) 00010000:00010000:2.0:1746126618.256182:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.256184:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256187:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e825867613db6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.256213:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e23ee00/0xb50e825867613da8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df17 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.256218:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e23ee00/0xb50e825867613da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df17 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.256223:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e23ee00, rc 0) 00000100:00100000:2.0:1746126618.256252:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31334:x1830945721517696:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2100us (4334us total) trans 8589943155 rc 301/301 00000100:00100000:2.0:1746126618.256257:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8972 00000100:00100000:3.0:1746126618.256676:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721516288:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12690us (12808us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.256683:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7794 00002000:00100000:3.0:1746126618.256688:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880134c3ea00 x1830945721516288/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.256695:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3ea00 with x1830945721516288 ext(2097152->3145727) 00002000:00010000:3.0:1746126618.256698:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3ea00 00002000:00010000:3.0:1746126618.260088:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126615 -> 1746126617 00000100:00100000:3.0:1746126618.260113:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721392128:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126618.260138:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fc000/0xb50e825867613dcb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df02 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.260150:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921fc000/0xb50e825867613dcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df02 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.260159:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fc000, rc 0) 00000100:00100000:3.0:1746126618.260213:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721517056:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5531us (5709us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.260220:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13665 00000100:00100000:0.0:1746126618.260648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.264064:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721518208 00000100:00100000:3.0:1746126618.264074:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721518208 00002000:00100000:3.0:1746126618.264112:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (2064384->2068479) req@ffff880131d55500 x1830945721518208/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.264120:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55500 with x1830945721518208 ext(2064384->2068479) 00002000:00010000:3.0:1746126618.264125:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d55500 00000100:00100000:3.0:1746126618.264144:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7796 00000100:00100000:3.0:1746126618.264149:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721518208:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.264293:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+13:1964:x1830945721518208:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 142us (3644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.264299:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7796 00002000:00100000:3.0:1746126618.264304:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (2064384->2068479) req@ffff880131d55500 x1830945721518208/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.264310:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55500 with x1830945721518208 ext(2064384->2068479) 00002000:00010000:3.0:1746126618.264314:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d55500 00000100:00100000:1.0:1746126618.264793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.264857:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.264914:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721518592 00000100:00100000:3.0:1746126618.264918:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721518592 00000100:00100000:3.0:1746126618.264937:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13668 00000100:00100000:3.0:1746126618.264942:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:31327:x1830945721518592:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.264950:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.264963:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df1e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.264979:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.264981:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.264987:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.264998:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.265006:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f06200, rc 0) 00000100:00100000:3.0:1746126618.265026:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:31327:x1830945721518592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.265031:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13668 00000100:00100000:0.0:1746126618.265090:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721518464 00000100:00100000:0.0:1746126618.265093:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721518464 00000100:00100000:0.0:1746126618.265112:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3799 00000100:00100000:0.0:1746126618.265117:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31328:x1830945721518464:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:0.0:1746126618.265236:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31328:x1830945721518464:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 118us (443us total) trans 8589943156 rc 0/0 00000100:00100000:0.0:1746126618.265242:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3799 00000100:00100000:0.0:1746126618.274008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.274064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.274072:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721518848 00000100:00100000:2.0:1746126618.274080:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721518848 00000100:00100000:2.0:1746126618.274126:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3800 00000100:00100000:2.0:1746126618.274134:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:31330:x1830945721518848:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126618.274301:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+231:31330:x1830945721518848:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 168us (303us total) trans 8589943157 rc 0/0 00000100:00100000:2.0:1746126618.274307:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3800 00000100:00100000:0.0:1746126618.274671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.274719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.274720:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721519232 00000100:00100000:2.0:1746126618.274724:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721519232 00000100:00100000:2.0:1746126618.274734:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721519488 00000100:00100000:2.0:1746126618.274736:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721519488 00002000:00100000:2.0:1746126618.274759:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880131d57800 x1830945721519488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.274767:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57800 with x1830945721519488 ext(1048576->2097151) 00002000:00010000:2.0:1746126618.274771:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d57800 00000100:00100000:3.0:1746126618.274775:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721519360 00000100:00100000:3.0:1746126618.274778:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721519360 00002000:00100000:3.0:1746126618.274792:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880131d55f80 x1830945721519360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126618.274793:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7797 00000100:00100000:2.0:1746126618.274797:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721519488:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:3.0:1746126618.274798:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55f80 with x1830945721519360 ext(1048576->2097151) 00002000:00010000:3.0:1746126618.274801:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d55f80 00000100:00100000:3.0:1746126618.274815:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7798 00000100:00100000:3.0:1746126618.274820:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721519360:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:2.0:1746126618.277118:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880131d54700 x1830945721519232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.277127:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54700 with x1830945721519232 ext(0->1048575) 00002000:00010000:2.0:1746126618.277131:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d54700 00000100:00100000:2.0:1746126618.277148:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7799 00000100:00100000:2.0:1746126618.277154:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721519232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126618.277495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.277513:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721519872 00000100:00100000:0.0:1746126618.277517:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721519872 00002000:00100000:0.0:1746126618.277535:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880134c3d180 x1830945721519872/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.277542:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d180 with x1830945721519872 ext(2097152->3145727) 00002000:00010000:0.0:1746126618.277545:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3d180 00000100:00100000:0.0:1746126618.277559:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7800 00000100:00100000:0.0:1746126618.277563:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721519872:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126618.278307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.278322:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721520128 00000100:00100000:1.0:1746126618.278325:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721520128 00002000:00100000:1.0:1746126618.278341:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880134c3e300 x1830945721520128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.278348:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3e300 with x1830945721520128 ext(3145728->4194303) 00002000:00010000:1.0:1746126618.278351:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3e300 00000100:00100000:1.0:1746126618.278362:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7801 00000100:00100000:1.0:1746126618.278366:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721520128:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126618.278406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.278416:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721520384 00000100:00100000:1.0:1746126618.278419:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721520384 00002000:00100000:1.0:1746126618.278430:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880134c3e680 x1830945721520384/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.278442:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3e680 with x1830945721520384 ext(3145728->4194303) 00002000:00010000:1.0:1746126618.278445:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3e680 00000100:00100000:1.0:1746126618.278454:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7802 00000100:00100000:1.0:1746126618.278458:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721520384:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126618.278677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.278691:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721520640 00000100:00100000:1.0:1746126618.278693:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721520640 00000100:00100000:1.0:1746126618.278719:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3801 00000100:00100000:1.0:1746126618.278724:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31328:x1830945721520640:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:1.0:1746126618.278876:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31328:x1830945721520640:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 151us (199us total) trans 8589943158 rc 0/0 00000100:00100000:1.0:1746126618.278883:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3801 00000100:00100000:2.0:1746126618.293407:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721519488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18597us (18726us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126618.293418:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7797 00002000:00100000:2.0:1746126618.293429:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880131d57800 x1830945721519488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.293437:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57800 with x1830945721519488 ext(1048576->2097151) 00002000:00010000:2.0:1746126618.293443:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d57800 00000100:00100000:3.0:1746126618.303461:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721519360:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28629us (28729us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.303474:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7798 00002000:00100000:3.0:1746126618.303486:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880131d55f80 x1830945721519360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.303495:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d55f80 with x1830945721519360 ext(1048576->2097151) 00002000:00010000:3.0:1746126618.303501:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d55f80 00000100:00100000:0.0:1746126618.306843:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721519232:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29667us (32757us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126618.306853:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7799 00002000:00100000:0.0:1746126618.306862:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880131d54700 x1830945721519232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.306870:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54700 with x1830945721519232 ext(0->1048575) 00002000:00010000:0.0:1746126618.306876:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d54700 00000100:00100000:1.0:1746126618.319270:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721520128:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 40893us (40955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126618.319282:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7801 00002000:00100000:1.0:1746126618.319292:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880134c3e300 x1830945721520128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.319300:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3e300 with x1830945721520128 ext(3145728->4194303) 00002000:00010000:1.0:1746126618.319306:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3e300 00000100:00100000:1.0:1746126618.321070:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721519872:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 43484us (43554us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126618.321080:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7800 00002000:00100000:1.0:1746126618.321089:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880134c3d180 x1830945721519872/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.321097:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d180 with x1830945721519872 ext(2097152->3145727) 00002000:00010000:1.0:1746126618.321101:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134c3d180 00000100:00100000:0.0:1746126618.327546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.328718:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721520768 00000100:00100000:1.0:1746126618.328726:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721520768 00000100:00100000:1.0:1746126618.328778:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13669 00000100:00100000:1.0:1746126618.328785:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31335:x1830945721520768:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.328800:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.328814:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df25 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.328858:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.328864:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126618.328866:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126618.328869:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.328895:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 14 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.328903:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 14 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.328913:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721392256:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.333451:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.333610:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721520384:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 55146us (55198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126618.333620:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7802 00002000:00100000:2.0:1746126618.333631:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880134c3e680 x1830945721520384/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.333638:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3e680 with x1830945721520384 ext(3145728->4194303) 00002000:00010000:2.0:1746126618.333643:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3e680 00000100:00100000:0.0:1746126618.333824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.335350:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721520896 00000100:00100000:3.0:1746126618.335359:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721520896 00000100:00100000:3.0:1746126618.335411:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13670 00000100:00100000:3.0:1746126618.335418:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31334:x1830945721520896:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126618.335431:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.335449:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df2c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.335472:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 12 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.335479:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.335484:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.335485:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.335496:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.335521:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.335529:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 16 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.335539:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721392384:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.335628:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 12 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.335636:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 12 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.335643:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721392512:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.335659:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.339754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.339853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.339869:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521024 00000100:00100000:2.0:1746126618.339879:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521024 00010000:00010000:2.0:1746126618.339914:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 17 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.339943:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7131 00000100:00100000:2.0:1746126618.339951:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721521024:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746126618.339954:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721392384:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.339961:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126618.339964:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721392512:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.339981:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 17 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.339990:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.339991:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 17 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.340010:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135527200/0xb50e825867613dd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df09 expref: 17 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.340014:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f07800, rc 0) 00010000:00010000:2.0:1746126618.340039:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.340095:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721521024:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 144us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.340101:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7131 00000100:00100000:2.0:1746126618.340126:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521152 00000100:00100000:2.0:1746126618.340131:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521152 00002000:00100000:2.0:1746126618.340154:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (2035712->2068479) req@ffff880131d54a80 x1830945721521152/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.340162:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54a80 with x1830945721521152 ext(2035712->2068479) 00010000:00010000:2.0:1746126618.340168:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 13 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.340174:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721392256:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.340176:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 13 pid: 4640 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.340182:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131d54a80 00010000:00010000:1.0:1746126618.340194:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.340195:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1780 00000100:00100000:2.0:1746126618.340200:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+13:1963:x1830945721521152:12345-192.168.203.2@tcp:4:multiop.0 00010000:00010000:1.0:1746126618.340204:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65a00, rc 0) 00000100:00100000:3.0:1746126618.340577:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31334:x1830945721520896:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5157us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.340589:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13670 00000100:00100000:1.0:1746126618.341180:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31335:x1830945721520768:12345-192.168.203.2@tcp:101:cat.0 Request processed in 12392us (13636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.341188:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13669 00000100:00100000:2.0:1746126618.345567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.345603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.345615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.345645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.345657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.345685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.345714:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521408 00000100:00100000:2.0:1746126618.345721:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521408 00000100:00100000:2.0:1746126618.345749:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521664 00000100:00100000:2.0:1746126618.345751:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521664 00000100:00100000:2.0:1746126618.345760:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521280 00000100:00100000:2.0:1746126618.345762:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521280 00000100:00100000:2.0:1746126618.345769:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521536 00000100:00100000:2.0:1746126618.345771:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521536 00000100:00100000:2.0:1746126618.345778:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521792 00000100:00100000:2.0:1746126618.345780:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521792 00000100:00100000:2.0:1746126618.345792:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13671 00000100:00100000:2.0:1746126618.345799:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721521408:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.345814:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.345848:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df3a expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.345869:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.345870:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.345877:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 24 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.345890:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 24 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.345899:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c3a00, rc 0) 00000100:00100000:2.0:1746126618.345936:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721521408:12345-192.168.203.2@tcp:101:cat.0 Request processed in 137us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.345941:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13671 00000100:00100000:2.0:1746126618.345954:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13672 00000100:00100000:2.0:1746126618.345958:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721521664:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.345963:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.345970:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c2800/0xb50e825867613dfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df48 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.345991:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13673 00000100:00100000:2.0:1746126618.345997:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721392640:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126618.345999:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721521280:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.346006:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.346014:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df33 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.346024:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.346026:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.346030:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.346039:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.346045:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b733200, rc 0) 00000100:00100000:2.0:1746126618.346047:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.346074:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13674 00000100:00100000:3.0:1746126618.346075:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721521280:12345-192.168.203.2@tcp:101:cat.0 Request processed in 77us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.346079:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13673 00000100:00100000:2.0:1746126618.346079:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721521536:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.346085:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126618.346089:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13675 00010000:00010000:2.0:1746126618.346091:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df41 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.346094:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721521792:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.346098:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.346100:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.346100:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.346105:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b732800/0xb50e825867613e11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df4f expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.346105:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.346113:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.346113:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.346119:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c2600, rc 0) 00010000:00010000:3.0:1746126618.346121:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b732800/0xb50e825867613e11 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df4f expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.346128:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b732800/0xb50e825867613e11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df4f expref: 19 pid: 9686 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126618.346135:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721521536:12345-192.168.203.2@tcp:101:cat.0 Request processed in 56us (490us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126618.346139:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b732800, rc 0) 00000100:00100000:2.0:1746126618.346140:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13674 00000100:00100000:3.0:1746126618.346154:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721521792:12345-192.168.203.2@tcp:101:cat.0 Request processed in 59us (495us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.346158:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13675 00000100:00100000:2.0:1746126618.346180:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721521920 00000100:00100000:2.0:1746126618.346183:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721521920 00010000:00010000:2.0:1746126618.346201:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 18 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.346216:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7132 00000100:00100000:2.0:1746126618.346219:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721521920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.346227:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.346242:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 18 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.346250:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 18 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.346260:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e664a00/0xb50e825867613d3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ded1 expref: 18 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.346269:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.346271:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.346276:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.346282:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.346298:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.346305:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721392768:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.346323:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.347758:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721521152:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 7554us (7926us total) trans 21474840382 rc 0/0 00000100:00100000:2.0:1746126618.347766:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1780 00002000:00100000:2.0:1746126618.347773:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (2035712->2068479) req@ffff880131d54a80 x1830945721521152/t21474840382(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.347780:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d54a80 with x1830945721521152 ext(2035712->2068479) 00010000:00010000:2.0:1746126618.347787:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 18 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.347801:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 18 pid: 4640 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.347807:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131d54a80 00002000:00010000:2.0:1746126618.350439:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126617 -> 1746126618 00000100:00100000:2.0:1746126618.350462:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721392640:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.350486:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c2800/0xb50e825867613dfc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df48 expref: 17 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.350498:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2800/0xb50e825867613dfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df48 expref: 17 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.350506:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c2800, rc 0) 00000100:00100000:2.0:1746126618.350564:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721521664:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4604us (4959us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.350571:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13672 00000100:00100000:0.0:1746126618.352026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.352079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.352139:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721522304 00000100:00100000:3.0:1746126618.352148:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721522304 00010000:00010000:3.0:1746126618.352181:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 16 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.352209:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7133 00000100:00100000:3.0:1746126618.352215:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721522304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.352228:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.352249:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 16 pid: 4640 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.352261:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 16 pid: 4640 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.352266:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721522176 00000100:00100000:2.0:1746126618.352274:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721522176 00010000:00010000:3.0:1746126618.352283:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921fd000/0xb50e825867613d8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2068479) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dee6 expref: 16 pid: 4640 timeout: 840 lvb_type: 0 00002000:00100000:2.0:1746126618.352307:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2744320->2748415) req@ffff88009e804000 x1830945721522176/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746126618.352315:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746126618.352315:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804000 with x1830945721522176 ext(2744320->2748415) 00010000:00010000:3.0:1746126618.352318:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746126618.352319:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804000 00010000:00010000:3.0:1746126618.352325:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.352334:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.352349:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7803 00000100:00100000:2.0:1746126618.352356:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721522176:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:3.0:1746126618.352366:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.352377:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721392896:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126618.352449:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.352475:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721392768:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.352478:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721522176:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 122us (460us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126618.352484:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7803 00010000:00010000:3.0:1746126618.352488:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746126618.352488:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2744320->2748415) req@ffff88009e804000 x1830945721522176/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.352494:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804000 with x1830945721522176 ext(2744320->2748415) 00002000:00010000:2.0:1746126618.352497:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804000 00000100:00100000:3.0:1746126618.352507:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721521920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6287us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.352514:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7132 00000100:00100000:2.0:1746126618.356771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.356924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.356993:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721522432 00000100:00100000:0.0:1746126618.357001:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721522432 00000100:00100000:3.0:1746126618.357304:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721392896:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126618.357320:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.357359:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721522304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5144us (5280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.357367:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7133 00000100:00100000:1.0:1746126618.357658:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721522688 00000100:00100000:1.0:1746126618.357662:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721522688 00002000:00100000:1.0:1746126618.357689:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800920bfb80 x1830945721522688/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.357698:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bfb80 with x1830945721522688 ext(1048576->2097151) 00002000:00010000:1.0:1746126618.357703:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920bfb80 00000100:00100000:1.0:1746126618.357715:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7804 00000100:00100000:1.0:1746126618.357720:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721522688:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126618.359239:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13676 00000100:00100000:0.0:1746126618.359250:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+14:31327:x1830945721522432:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126618.359260:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126618.359273:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df56 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.359295:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.359302:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126618.359303:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126618.359306:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.359332:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.359341:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 14 pid: 8437 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.359349:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721393024:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.359417:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.364238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.365216:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721522816 00000100:00100000:1.0:1746126618.365224:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721522816 00000100:00100000:2.0:1746126618.369445:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721393024:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.369445:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13677 00000100:00100000:1.0:1746126618.369457:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31334:x1830945721522816:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:0.0:1746126618.369460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126618.369471:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.369471:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.369482:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df5d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.369483:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721522944 00010000:00010000:2.0:1746126618.369484:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f82a00, rc 0) 00000100:00100000:3.0:1746126618.369489:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721522944 00010000:00010000:1.0:1746126618.369502:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.369514:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746126618.369517:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2744320->3145727) req@ffff880099373b80 x1830945721522944/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746126618.369519:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+15:31327:x1830945721522432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10272us (12756us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126618.369519:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.369521:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746126618.369524:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13676 00010000:00010000:1.0:1746126618.369524:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2203647] (req 2097152->2203647) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746126618.369525:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373b80 with x1830945721522944 ext(2744320->3145727) 00010000:00010000:3.0:1746126618.369530:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.369540:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.369545:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126618.369546:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099373b80 00010000:00010000:1.0:1746126618.369553:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 23 pid: 8437 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.369563:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721393152:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.369572:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1781 00000100:00100000:3.0:1746126618.369577:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721522944:12345-192.168.203.2@tcp:4:multiop.0 00010000:00010000:1.0:1746126618.369613:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.369621:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746126618.369628:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721393280:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.369660:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.374265:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721522688:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16536us (17333us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126618.374278:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7804 00002000:00100000:1.0:1746126618.374287:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800920bfb80 x1830945721522688/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.374295:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bfb80 with x1830945721522688 ext(1048576->2097151) 00002000:00010000:1.0:1746126618.374299:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920bfb80 00000100:00100000:1.0:1746126618.374376:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721393152:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.374453:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721393280:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.374474:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2203647] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.374486:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65000, rc 0) 00000100:00100000:1.0:1746126618.374502:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31334:x1830945721522816:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5049us (10274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.374508:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13677 00000100:00100000:1.0:1746126618.374544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.375866:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721523072 00000100:00100000:3.0:1746126618.375875:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721523072 00010000:00010000:3.0:1746126618.375901:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.375938:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7134 00000100:00100000:3.0:1746126618.375944:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721523072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.375954:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.375971:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.375980:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.376002:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135526a00/0xb50e825867613dd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df10 expref: 11 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.376027:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.376063:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721523072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.376068:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7134 00000100:00100000:0.0:1746126618.381287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.381366:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721523200 00000100:00100000:2.0:1746126618.381374:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721523200 00010000:00010000:2.0:1746126618.381401:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 24 pid: 8437 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.381425:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7135 00000100:00100000:2.0:1746126618.381432:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721523200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.381443:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.381458:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 24 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.381468:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 24 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.381485:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f06200/0xb50e825867613de0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df1e expref: 24 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.381511:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.381513:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.381519:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.381526:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.381553:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.381564:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721393408:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.381634:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.382474:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721522944:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 12893us (13012us total) trans 21474840383 rc 0/0 00000100:00100000:3.0:1746126618.382482:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1781 00002000:00100000:3.0:1746126618.382490:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2744320->3145727) req@ffff880099373b80 x1830945721522944/t21474840383(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.382497:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373b80 with x1830945721522944 ext(2744320->3145727) 00010000:00010000:3.0:1746126618.382504:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.382515:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.382520:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099373b80 00000100:00100000:2.0:1746126618.383740:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721393408:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.383756:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.383780:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721523200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2348us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.383788:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7135 00000100:00100000:0.0:1746126618.386099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.386156:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721523328 00000100:00100000:2.0:1746126618.386163:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721523328 00010000:00010000:2.0:1746126618.386191:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.386226:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7136 00000100:00100000:2.0:1746126618.386232:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721523328:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.386243:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126618.386257:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126617 -> 1746126618 00002000:00010000:2.0:1746126618.386259:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126617 -> 1746126618 00010000:00010000:2.0:1746126618.386264:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.386275:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.386292:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f07800/0xb50e825867613dee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df2c expref: 16 pid: 8437 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.386303:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.386305:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.386310:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.386318:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.386344:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.386355:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721393536:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.386429:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.388434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.389671:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721523584 00000100:00100000:2.0:1746126618.389672:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721393536:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126618.389678:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721523584 00010000:00010000:2.0:1746126618.389690:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746126618.389713:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2199552->2203647) req@ffff880099373480 x1830945721523584/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.389727:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373480 with x1830945721523584 ext(2199552->2203647) 00000100:00100000:2.0:1746126618.389727:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721523328:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3494us (3634us total) trans 0 rc 0/0 00002000:00010000:3.0:1746126618.389731:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099373480 00000100:00100000:2.0:1746126618.389735:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7136 00000100:00100000:3.0:1746126618.389752:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7805 00000100:00100000:3.0:1746126618.389758:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721523584:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.389900:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721523584:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 142us (1469us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.389905:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7805 00002000:00100000:3.0:1746126618.389910:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2199552->2203647) req@ffff880099373480 x1830945721523584/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.389917:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373480 with x1830945721523584 ext(2199552->2203647) 00002000:00010000:3.0:1746126618.389920:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099373480 00000100:00100000:0.0:1746126618.391696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.391742:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721523712 00000100:00100000:1.0:1746126618.391748:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721523712 00000100:00100000:1.0:1746126618.391785:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13678 00000100:00100000:1.0:1746126618.391792:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31335:x1830945721523712:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.391802:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.391818:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df64 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.391863:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.391865:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.391872:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.391882:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.391890:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64800, rc 0) 00000100:00100000:1.0:1746126618.391923:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31335:x1830945721523712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 131us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.391927:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13678 00000100:00100000:0.0:1746126618.392772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.392816:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721523968 00000100:00100000:2.0:1746126618.392821:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721523968 00000100:00100000:2.0:1746126618.392872:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3802 00000100:00100000:2.0:1746126618.392877:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31334:x1830945721523968:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126618.393065:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31334:x1830945721523968:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 187us (293us total) trans 8589943159 rc 0/0 00000100:00100000:2.0:1746126618.393071:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3802 00000100:00100000:0.0:1746126618.393211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.393310:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721524224 00000100:00100000:1.0:1746126618.393314:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721524224 00002000:00100000:1.0:1746126618.393333:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099370e00 x1830945721524224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.393340:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370e00 with x1830945721524224 ext(4194304->4976639) 00002000:00010000:1.0:1746126618.393344:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370e00 00000100:00100000:1.0:1746126618.393364:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7806 00000100:00100000:1.0:1746126618.393369:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721524224:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.404338:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721524224:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10960us (11118us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126618.404347:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7806 00002000:00100000:2.0:1746126618.404357:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099370e00 x1830945721524224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.404366:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370e00 with x1830945721524224 ext(4194304->4976639) 00002000:00010000:2.0:1746126618.404371:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370e00 00000100:00100000:2.0:1746126618.416402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.416424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.416426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.416438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.416454:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721524480 00000100:00100000:2.0:1746126618.416460:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721524480 00000100:00100000:1.0:1746126618.416474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.416493:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8974 00000100:00100000:2.0:1746126618.416500:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+231:31340:x1830945721524480:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126618.416517:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.416531:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e3200/0xb50e825867613e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df6b expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.416550:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721524736 00000100:00100000:3.0:1746126618.416555:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721524736 00002000:00100000:3.0:1746126618.416580:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800920bd880 x1830945721524736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.416588:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bd880 with x1830945721524736 ext(2097152->3145727) 00002000:00010000:3.0:1746126618.416593:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920bd880 00000100:00100000:3.0:1746126618.416604:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721525248 00000100:00100000:3.0:1746126618.416606:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721525248 00002000:00100000:3.0:1746126618.416615:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880134c3c700 x1830945721525248/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.416621:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3c700 with x1830945721525248 ext(3145728->4194303) 00002000:00010000:3.0:1746126618.416623:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3c700 00000100:00100000:3.0:1746126618.416632:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7807 00000100:00100000:3.0:1746126618.416637:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721524736:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:2.0:1746126618.416668:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416679:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416688:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416698:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416703:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416708:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746126618.416794:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7808 00000100:00100000:1.0:1746126618.416800:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721525248:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:2.0:1746126618.416894:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416906:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416912:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126618.416919:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126618.416981:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416987:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416992:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.416998:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57e2c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.417001:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417007:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417015:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126618.417018:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.417021:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417025:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2c00/0xb50e825867613e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417043:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417064:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417068:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417072:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57e2e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.417074:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417078:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417084:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a593b800) 00010000:00010000:2.0:1746126618.417086:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.417088:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417092:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2e00/0xb50e825867613e3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.417123:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e3200/0xb50e825867613e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 234 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.417133:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.417140:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.417142:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126618.417143:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb9000, rc 0) 00000100:00100000:2.0:1746126618.417179:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+233:31340:x1830945721524480:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 680us (755us total) trans 8589943160 rc 0/0 00000100:00100000:2.0:1746126618.417186:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8974 00000100:00100000:2.0:1746126618.417205:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721524864 00000100:00100000:2.0:1746126618.417208:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721524864 00000100:00100000:2.0:1746126618.417223:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721524992 00000100:00100000:2.0:1746126618.417225:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721524992 00000100:00100000:2.0:1746126618.417237:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13679 00000100:00100000:2.0:1746126618.417241:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721524864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.417248:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.417256:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df72 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.417268:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.417270:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.417276:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.417286:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 16 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.417292:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb8200, rc 0) 00000100:00100000:2.0:1746126618.417312:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721524864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 70us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.417317:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13679 00000100:00100000:2.0:1746126618.417326:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13680 00000100:00100000:2.0:1746126618.417331:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721524992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.417337:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.417346:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eeb9a00/0xb50e825867613e57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df79 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.417375:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721393664:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.417416:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.417692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.417715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.417730:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721525504 00000100:00100000:0.0:1746126618.417733:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721525504 00002000:00100000:0.0:1746126618.417751:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2203648->3252223) req@ffff880099373800 x1830945721525504/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.417758:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373800 with x1830945721525504 ext(2203648->3252223) 00002000:00010000:0.0:1746126618.417761:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099373800 00000100:00100000:0.0:1746126618.417769:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721525760 00000100:00100000:0.0:1746126618.417772:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721525760 00002000:00100000:0.0:1746126618.417781:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3252224->4194303) req@ffff880099372a00 x1830945721525760/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.417788:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099372a00 with x1830945721525760 ext(3252224->4194303) 00002000:00010000:0.0:1746126618.417790:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099372a00 00000100:00100000:0.0:1746126618.417799:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7809 00000100:00100000:0.0:1746126618.417804:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721525504:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.418075:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7810 00000100:00100000:3.0:1746126618.418082:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721525760:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:3.0:1746126618.425240:0:20294:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126617 -> 1746126618 00002000:00010000:3.0:1746126618.425246:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126613 -> 1746126618 00002000:00010000:3.0:1746126618.425248:0:20294:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126617 -> 1746126618 00000100:00100000:3.0:1746126618.425264:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721393664:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126618.425289:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb9a00/0xb50e825867613e57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df79 expref: 24 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.425300:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb9a00/0xb50e825867613e57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df79 expref: 24 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.425313:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb9a00, rc 0) 00000100:00100000:3.0:1746126618.425350:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721524992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8017us (8911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.425356:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13680 00000100:00100000:0.0:1746126618.433233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.433541:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721525888 00000100:00100000:3.0:1746126618.433549:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721525888 00000100:00100000:3.0:1746126618.433594:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13681 00000100:00100000:3.0:1746126618.433602:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+16:31340:x1830945721525888:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126618.433614:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.433629:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df80 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.435823:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.435845:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.435851:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.435852:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.435855:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [491520->671743] (req 491520->671743) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 17 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.435882:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 17 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.435893:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 17 pid: 9686 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.435906:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721393792:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.436135:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 19 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.436147:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 19 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.436154:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721393920:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.436175:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.437006:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721525248:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20204us (20529us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126618.437014:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7808 00002000:00100000:1.0:1746126618.437022:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880134c3c700 x1830945721525248/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.437030:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3c700 with x1830945721525248 ext(3145728->4194303) 00002000:00010000:1.0:1746126618.437034:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3c700 00000100:00100000:3.0:1746126618.437284:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721524736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20646us (20859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.437290:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7807 00002000:00100000:3.0:1746126618.437295:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800920bd880 x1830945721524736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.437301:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bd880 with x1830945721524736 ext(2097152->3145727) 00002000:00010000:3.0:1746126618.437304:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920bd880 00000100:00100000:0.0:1746126618.442263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.443029:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721526016 00000100:00100000:2.0:1746126618.443038:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721526016 00000100:00100000:2.0:1746126618.443082:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13682 00000100:00100000:2.0:1746126618.443089:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721526016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.443103:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.443118:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbb000/0xb50e825867613e65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df87 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.443160:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721394048:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.443245:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.446027:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721525504:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28215us (28328us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126618.446037:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7809 00002000:00100000:0.0:1746126618.446046:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2203648->3252223) req@ffff880099373800 x1830945721525504/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.446062:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373800 with x1830945721525504 ext(2203648->3252223) 00002000:00010000:0.0:1746126618.446067:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099373800 00000100:00100000:0.0:1746126618.448209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.448248:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721393792:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.450035:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721526144 00000100:00100000:2.0:1746126618.450043:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721526144 00010000:00010000:2.0:1746126618.450085:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 18 pid: 9686 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.450123:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7137 00000100:00100000:2.0:1746126618.450130:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721526144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.450140:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.450158:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 18 pid: 9686 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.450168:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 18 pid: 9686 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.450187:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b733200/0xb50e825867613e03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df33 expref: 18 pid: 9686 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.450203:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.450253:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721526144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 122us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.450259:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7137 00000100:00100000:1.0:1746126618.450512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.451075:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721393920:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.451099:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [491520->671743] (req 491520->671743) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.451110:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb8800, rc 0) 00000100:00100000:3.0:1746126618.451134:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+16:31340:x1830945721525888:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 17533us (17907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.451140:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13681 00000100:00100000:0.0:1746126618.451591:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721525760:12345-192.168.203.2@tcp:3:cat.0 Request processed in 33508us (33873us total) trans 0 rc 942080/942080 00000100:00100000:0.0:1746126618.451599:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7810 00002000:00100000:0.0:1746126618.451607:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3252224->4194303) req@ffff880099372a00 x1830945721525760/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126618.451614:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099372a00 with x1830945721525760 ext(3252224->4194303) 00002000:00010000:0.0:1746126618.451618:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099372a00 00000100:00100000:2.0:1746126618.451682:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721526272 00000100:00100000:2.0:1746126618.451686:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721526272 00010000:00010000:2.0:1746126618.451701:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 16 pid: 10890 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.451727:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7138 00000100:00100000:2.0:1746126618.451732:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721526272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.451739:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.451751:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 16 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.451759:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 16 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.451772:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7dac00/0xb50e825867613d93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4deed expref: 16 pid: 10890 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746126618.451779:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.451782:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.451788:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.451794:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.451816:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.451851:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721394176:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.452488:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.454567:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721394048:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.454594:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbb000/0xb50e825867613e65 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df87 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.454605:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbb000/0xb50e825867613e65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df87 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.454614:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb000, rc 0) 00000100:00100000:2.0:1746126618.454660:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721526016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11571us (12404us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.454667:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13682 00000100:00100000:3.0:1746126618.455568:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721394176:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126618.455578:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.455599:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721526272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3866us (5088us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.455606:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7138 00000100:00100000:0.0:1746126618.460165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.460248:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721526528 00000100:00100000:2.0:1746126618.460256:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721526528 00002000:00100000:2.0:1746126618.460293:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (491520->495615) req@ffff880093df5f80 x1830945721526528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.460307:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5f80 with x1830945721526528 ext(491520->495615) 00002000:00010000:2.0:1746126618.460312:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df5f80 00000100:00100000:2.0:1746126618.460330:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7811 00000100:00100000:2.0:1746126618.460335:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721526528:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.460498:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721526528:12345-192.168.203.2@tcp:3:cat.0 Request processed in 161us (338us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126618.460504:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7811 00002000:00100000:2.0:1746126618.460509:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (491520->495615) req@ffff880093df5f80 x1830945721526528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.460516:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5f80 with x1830945721526528 ext(491520->495615) 00002000:00010000:2.0:1746126618.460518:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df5f80 00000100:00100000:0.0:1746126618.463962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.464046:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721526784 00000100:00100000:2.0:1746126618.464061:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721526784 00002000:00100000:2.0:1746126618.464094:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (667648->671743) req@ffff880093df5880 x1830945721526784/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.464103:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5880 with x1830945721526784 ext(667648->671743) 00002000:00010000:2.0:1746126618.464108:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df5880 00000100:00100000:2.0:1746126618.464123:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7812 00000100:00100000:2.0:1746126618.464129:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721526784:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.464269:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721526784:12345-192.168.203.2@tcp:3:cat.0 Request processed in 140us (312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126618.464275:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7812 00002000:00100000:2.0:1746126618.464281:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (667648->671743) req@ffff880093df5880 x1830945721526784/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.464288:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5880 with x1830945721526784 ext(667648->671743) 00002000:00010000:2.0:1746126618.464291:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df5880 00000100:00100000:0.0:1746126618.467159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.467245:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721527040 00000100:00100000:2.0:1746126618.467252:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721527040 00000100:00100000:2.0:1746126618.467296:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3803 00000100:00100000:2.0:1746126618.467302:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:31340:x1830945721527040:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126618.467565:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+234:31340:x1830945721527040:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 262us (411us total) trans 8589943161 rc 0/0 00000100:00100000:2.0:1746126618.467571:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3803 00000100:00100000:0.0:1746126618.468037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.470418:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721527168 00000100:00100000:2.0:1746126618.470426:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721527168 00000100:00100000:2.0:1746126618.471446:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13683 00000100:00100000:2.0:1746126618.471455:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721527168:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.471468:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.471482:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613e6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df8e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.471521:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394304:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.471593:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3300 going to sleep for 11 seconds 00002000:00010000:2.0:1746126618.474615:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126613 -> 1746126618 00002000:00010000:2.0:1746126618.474622:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126613 -> 1746126618 00002000:00010000:2.0:1746126618.474624:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126613 -> 1746126618 00000100:00100000:2.0:1746126618.474643:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394304:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.474669:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613e6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df8e expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.474681:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebba400/0xb50e825867613e6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df8e expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.474690:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebba400, rc 0) 00000100:00100000:2.0:1746126618.475288:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721527168:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3833us (7249us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.475296:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13683 00000100:00100000:0.0:1746126618.483225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.485046:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721527424 00000100:00100000:2.0:1746126618.485064:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721527424 00002000:00100000:2.0:1746126618.485103:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093df4000 x1830945721527424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.485113:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4000 with x1830945721527424 ext(4194304->4976639) 00002000:00010000:2.0:1746126618.485118:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df4000 00000100:00100000:2.0:1746126618.485149:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7813 00000100:00100000:2.0:1746126618.485156:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721527424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.505008:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721527424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19844us (21782us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126618.505023:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7813 00002000:00100000:3.0:1746126618.505033:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093df4000 x1830945721527424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.505042:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df4000 with x1830945721527424 ext(4194304->4976639) 00002000:00010000:3.0:1746126618.505047:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df4000 00000100:00100000:0.0:1746126618.511519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.511641:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721527552 00000100:00100000:2.0:1746126618.511648:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721527552 00000100:00100000:2.0:1746126618.511687:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13684 00000100:00100000:2.0:1746126618.511693:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721527552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.511708:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.511721:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebba000/0xb50e825867613e73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df95 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.511765:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394432:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.511873:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.513514:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394432:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.513533:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebba000/0xb50e825867613e73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df95 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.513542:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebba000/0xb50e825867613e73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df95 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.513560:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebba000, rc 0) 00000100:00100000:2.0:1746126618.513588:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721527552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1894us (2076us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.513595:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13684 00000100:00100000:0.0:1746126618.516956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.517151:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721527680 00000100:00100000:2.0:1746126618.517158:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721527680 00000100:00100000:2.0:1746126618.517196:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13685 00000100:00100000:2.0:1746126618.517201:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721527680:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.517214:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.517227:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613e7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4df9c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.517266:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394560:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.517330:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.523324:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394560:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.523353:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613e7a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df9c expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.523371:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbae00/0xb50e825867613e7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df9c expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.524470:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbae00, rc 0) 00000100:00100000:2.0:1746126618.524520:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721527680:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7317us (7568us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.524528:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13685 00000100:00100000:0.0:1746126618.543035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.543218:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721527936 00000100:00100000:2.0:1746126618.543225:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721527936 00000100:00100000:2.0:1746126618.543275:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8975 00000100:00100000:2.0:1746126618.543282:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31345:x1830945721527936:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126618.543302:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.543315:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbba00/0xb50e825867613e81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfa3 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.543393:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543404:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543412:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543421:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543427:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543432:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543508:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543516:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543522:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126618.543534:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126618.543604:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543610:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543615:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543620:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebba000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.543623:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543628:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543637:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126618.543639:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.543642:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543649:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e825867613e88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543676:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543682:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543686:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543690:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbb800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126618.543692:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543697:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543703:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a593b100) 00010000:00010000:2.0:1746126618.543705:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126618.543707:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543711:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e825867613e8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126618.543739:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbba00/0xb50e825867613e81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.543748:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.543759:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126618.543761:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126618.543762:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb000, rc 0) 00000100:00100000:2.0:1746126618.543809:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31345:x1830945721527936:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 528us (782us total) trans 8589943162 rc 0/0 00000100:00100000:2.0:1746126618.543814:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8975 00000100:00100000:0.0:1746126618.559823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.560525:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721528064 00000100:00100000:2.0:1746126618.560532:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721528064 00000100:00100000:2.0:1746126618.560574:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13686 00000100:00100000:2.0:1746126618.560581:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31345:x1830945721528064:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126618.560594:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.560607:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfaa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.560631:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.560639:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.560645:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.560646:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.560649:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2830336->3112959] (req 2830336->3112959) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.560671:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.560682:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.560692:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.560771:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 15 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.560778:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 15 pid: 20294 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.560785:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394816:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.560799:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.564426:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394688:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.564437:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721394816:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.564459:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2830336->3112959] (req 2830336->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.564472:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb800, rc 0) 00000100:00100000:2.0:1746126618.565347:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31345:x1830945721528064:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4763us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.565355:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13686 00000100:00100000:0.0:1746126618.570523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.570572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.571304:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721528192 00000100:00100000:1.0:1746126618.571392:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721528320 00000100:00100000:1.0:1746126618.571398:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721528320 00010000:00010000:1.0:1746126618.571427:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.571450:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7139 00000100:00100000:1.0:1746126618.571456:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721528320:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.571467:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.571484:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.571494:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.571512:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64800/0xb50e825867613e26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df64 expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.571584:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721528192 00010000:00010000:3.0:1746126618.571599:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 16 pid: 20294 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.571615:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7140 00000100:00100000:3.0:1746126618.571619:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721528192:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.571625:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.571633:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 16 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.571639:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 16 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.571648:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f82a00/0xb50e825867613e18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df56 expref: 16 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.571661:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.571663:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.571668:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.571679:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.571715:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126618.571726:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721394944:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126618.571870:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00010000:00010000:1.0:1746126618.572446:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126618.572483:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721528320:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1025us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.572488:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7139 00000100:00100000:3.0:1746126618.574126:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721394944:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126618.574141:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.574178:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721528192:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2557us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.574184:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7140 00000100:00100000:0.0:1746126618.577039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.577104:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721528576 00000100:00100000:3.0:1746126618.577111:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721528576 00002000:00100000:3.0:1746126618.577144:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2830336->2834431) req@ffff880093df6300 x1830945721528576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.577152:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df6300 with x1830945721528576 ext(2830336->2834431) 00002000:00010000:3.0:1746126618.577156:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df6300 00000100:00100000:3.0:1746126618.577185:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7814 00000100:00100000:3.0:1746126618.577191:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721528576:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.577340:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721528576:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 147us (305us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.577349:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7814 00002000:00100000:3.0:1746126618.577354:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2830336->2834431) req@ffff880093df6300 x1830945721528576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.577361:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df6300 with x1830945721528576 ext(2830336->2834431) 00002000:00010000:3.0:1746126618.577364:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df6300 00000100:00100000:0.0:1746126618.587805:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.588030:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721528832 00000100:00100000:2.0:1746126618.588037:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721528832 00002000:00100000:2.0:1746126618.588086:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3108864->3112959) req@ffff880136a83800 x1830945721528832/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.588095:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83800 with x1830945721528832 ext(3108864->3112959) 00002000:00010000:2.0:1746126618.588100:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83800 00000100:00100000:2.0:1746126618.588608:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7815 00000100:00100000:2.0:1746126618.588616:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721528832:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126618.591107:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721528832:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 2485us (3301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126618.591119:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7815 00002000:00100000:2.0:1746126618.591129:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3108864->3112959) req@ffff880136a83800 x1830945721528832/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.591137:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83800 with x1830945721528832 ext(3108864->3112959) 00002000:00010000:2.0:1746126618.591142:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83800 00000100:00100000:0.0:1746126618.597396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.597486:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529088 00000100:00100000:2.0:1746126618.597493:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529088 00000100:00100000:2.0:1746126618.597537:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3804 00000100:00100000:2.0:1746126618.597543:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973ce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31345:x1830945721529088:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126618.597725:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973ce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31345:x1830945721529088:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 181us (336us total) trans 8589943163 rc 0/0 00000100:00100000:2.0:1746126618.597731:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3804 00000100:00100000:0.0:1746126618.621559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.621646:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529344 00000100:00100000:3.0:1746126618.621654:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529344 00000100:00100000:3.0:1746126618.621700:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8976 00000100:00100000:3.0:1746126618.621706:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+234:31348:x1830945721529344:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126618.621726:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.621741:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0600/0xb50e825867613eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfb1 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.621814:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126618.621853:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 235 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.621861:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.621867:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126618.621892:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.621906:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 18 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.621916:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721395072:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.623004:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 235 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.623013:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 235 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.623021:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721395200:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.623066:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.625107:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721395072:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.625116:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721395200:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.625133:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126618.628664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.628712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.628984:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529600 00000100:00100000:1.0:1746126618.628993:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529600 00010000:00010000:1.0:1746126618.629022:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 236 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.629041:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529472 00000100:00100000:1.0:1746126618.629044:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529472 00010000:00010000:1.0:1746126618.629060:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 19 pid: 14549 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.629089:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7141 00000100:00100000:1.0:1746126618.629095:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+236:1966:x1830945721529600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.629105:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.629110:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 236 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.629119:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 236 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.629136:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb9000/0xb50e825867613e42 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df6b expref: 236 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.629152:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126618.629157:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.629164:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.629168:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126618.629209:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+235:1966:x1830945721529600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 114us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.629215:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7141 00000100:00100000:1.0:1746126618.629228:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7142 00000100:00100000:1.0:1746126618.629233:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721529472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.629238:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.629242:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 19 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.629249:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 19 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.629259:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb000/0xb50e825867613e96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfa3 expref: 19 pid: 14549 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.629267:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126618.629270:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.629276:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.629281:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.629297:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126618.629310:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721529472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.629315:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7142 00010000:00010000:1.0:1746126618.629410:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.629417:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126618.629431:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126618.629530:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0600/0xb50e825867613eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 236 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.629541:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 235 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.629547:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126618.629549:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126618.629550:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d8e0c00, rc 0) 00000100:00100000:1.0:1746126618.629570:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+235:31348:x1830945721529344:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7864us (8018us total) trans 8589943164 rc 0/0 00000100:00100000:1.0:1746126618.629575:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8976 00000100:00100000:0.0:1746126618.667003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.669628:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529728 00000100:00100000:2.0:1746126618.669639:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529728 00000100:00100000:2.0:1746126618.669686:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13687 00000100:00100000:2.0:1746126618.669693:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721529728:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.669709:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.669721:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbba00/0xb50e825867613ec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfb8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.669758:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721395328:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.669824:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.671522:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721395328:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.671546:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbba00/0xb50e825867613ec0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb8 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.671557:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbba00/0xb50e825867613ec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb8 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.671579:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbba00, rc 0) 00000100:00100000:2.0:1746126618.671620:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721529728:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1926us (4623us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.671626:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13687 00000100:00100000:2.0:1746126618.675917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.676493:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529856 00000100:00100000:0.0:1746126618.676501:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529856 00000100:00100000:0.0:1746126618.676545:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13688 00000100:00100000:0.0:1746126618.676552:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31352:x1830945721529856:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126618.676566:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126618.676579:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfbf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.676602:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.676613:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126618.676615:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126618.676618:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.676643:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 14 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.676653:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 14 pid: 20294 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.676663:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721395456:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.676739:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.684579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.684693:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721529984 00000100:00100000:3.0:1746126618.684701:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721529984 00000100:00100000:2.0:1746126618.684724:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721395456:192.168.203.2@tcp:104: 00002000:00100000:3.0:1746126618.684737:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (491520->671743) req@ffff880136a80000 x1830945721529984/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.684746:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80000 with x1830945721529984 ext(491520->671743) 00010000:00010000:2.0:1746126618.684748:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.684753:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 15 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.684760:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e200, rc 0) 00010000:00010000:3.0:1746126618.684768:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 15 pid: 20294 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.684773:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a80000 00000100:00100000:3.0:1746126618.684790:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1782 00000100:00100000:3.0:1746126618.684796:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721529984:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126618.684797:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31352:x1830945721529856:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8245us (8885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.684806:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13688 00000100:00100000:3.0:1746126618.693562:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721529984:12345-192.168.203.2@tcp:4:cat.0 Request processed in 8758us (8983us total) trans 21474840384 rc 0/0 00000100:00100000:3.0:1746126618.693572:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1782 00002000:00100000:3.0:1746126618.693582:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (491520->671743) req@ffff880136a80000 x1830945721529984/t21474840384(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.693590:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80000 with x1830945721529984 ext(491520->671743) 00010000:00010000:3.0:1746126618.693600:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 17 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.693613:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 17 pid: 20294 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.693620:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a80000 00000100:00100000:0.0:1746126618.701351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.701508:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721530112 00000100:00100000:2.0:1746126618.701515:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721530112 00000100:00100000:2.0:1746126618.701559:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13689 00000100:00100000:2.0:1746126618.701565:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721530112:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.701579:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.701593:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867613ece lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfc6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.701635:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721395584:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.702409:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.702996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.703062:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721530240 00000100:00100000:2.0:1746126618.703067:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721530240 00010000:00010000:2.0:1746126618.703087:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 19 pid: 20294 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.703115:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7143 00000100:00100000:2.0:1746126618.703121:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721530240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.703129:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.703144:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 19 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.703154:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 19 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.703172:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.703174:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.703180:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.703187:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.703208:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.703216:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721395712:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.704406:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.705276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.705315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.705401:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721530496 00000100:00100000:1.0:1746126618.705407:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721530496 00000100:00100000:1.0:1746126618.705448:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721530368 00000100:00100000:1.0:1746126618.705451:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721530368 00000100:00100000:1.0:1746126618.705466:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13690 00000100:00100000:1.0:1746126618.705472:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721530496:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.705485:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.705500:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867613ed5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfd4 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.705536:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721395840:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126618.705594:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.705617:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13691 00000100:00100000:1.0:1746126618.705623:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721530368:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126618.705629:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.705637:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae43a00/0xb50e825867613edc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfcd expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.705661:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721395968:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126618.705679:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00010000:00010000:2.0:1746126618.706750:0:8436:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff8800920bed80 x1830945721395584) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 21 pid: 20294 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.706778:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8800/0xb50e825867613e5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->671743) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df80 expref: 21 pid: 20294 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.706803:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721395584:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.706824:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867613ece lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfc6 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.706858:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867613ece lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfc6 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.706865:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb600, rc 0) 00000100:00100000:2.0:1746126618.706892:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721530112:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5327us (5548us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.706899:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13689 00000100:00100000:2.0:1746126618.706946:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721395712:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.708192:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.708220:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721530240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5097us (5224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.708228:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7143 00000100:00100000:1.0:1746126618.709484:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721395840:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126618.709504:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867613ed5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfd4 expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.709514:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867613ed5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfd4 expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126618.709542:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae42200, rc 0) 00000100:00100000:1.0:1746126618.709568:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721530496:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4096us (4296us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126618.709574:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13690 00002000:00010000:2.0:1746126618.709940:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126617 -> 1746126618 00000100:00100000:2.0:1746126618.709952:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721395968:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.709967:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae43a00/0xb50e825867613edc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfcd expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.709975:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43a00/0xb50e825867613edc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfcd expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.709981:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43a00, rc 0) 00000100:00100000:2.0:1746126618.709999:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721530368:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4377us (4684us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.710004:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13691 00000100:00100000:0.0:1746126618.714244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.714462:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721530752 00000100:00100000:2.0:1746126618.714469:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721530752 00000100:00100000:2.0:1746126618.714580:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13692 00000100:00100000:2.0:1746126618.714588:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:31355:x1830945721530752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.714603:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.714617:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfdb expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.714642:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.714643:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.714649:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.714661:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.714669:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb000, rc 0) 00000100:00100000:2.0:1746126618.714716:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:31355:x1830945721530752:12345-192.168.203.2@tcp:101:cat.0 Request processed in 128us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.714721:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13692 00000100:00100000:0.0:1746126618.715452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.715682:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721530880 00000100:00100000:3.0:1746126618.715686:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721530880 00002000:00100000:3.0:1746126618.715709:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880136a81500 x1830945721530880/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.715717:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81500 with x1830945721530880 ext(0->1048575) 00002000:00010000:3.0:1746126618.715721:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a81500 00000100:00100000:3.0:1746126618.715739:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7816 00000100:00100000:3.0:1746126618.715744:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721530880:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.729361:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721530880:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13608us (13902us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.729371:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7816 00002000:00100000:3.0:1746126618.729381:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880136a81500 x1830945721530880/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.729389:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81500 with x1830945721530880 ext(0->1048575) 00002000:00010000:3.0:1746126618.729395:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a81500 00000100:00100000:1.0:1746126618.737898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.738281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.738309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.738331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.738382:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721531264 00000100:00100000:2.0:1746126618.738389:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721531264 00002000:00100000:2.0:1746126618.738423:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880134c3f100 x1830945721531264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.738431:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3f100 with x1830945721531264 ext(0->1048575) 00002000:00010000:2.0:1746126618.738435:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3f100 00000100:00100000:2.0:1746126618.738450:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721531392 00000100:00100000:2.0:1746126618.738452:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721531392 00002000:00100000:2.0:1746126618.738460:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880136a81180 x1830945721531392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.738465:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81180 with x1830945721531392 ext(1048576->2097151) 00002000:00010000:2.0:1746126618.738468:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a81180 00000100:00100000:2.0:1746126618.738478:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721531776 00000100:00100000:2.0:1746126618.738480:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721531776 00002000:00100000:2.0:1746126618.738491:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093231180 x1830945721531776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.738497:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093231180 with x1830945721531776 ext(1048576->2097151) 00002000:00010000:2.0:1746126618.738499:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093231180 00000100:00100000:2.0:1746126618.738506:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721531648 00000100:00100000:2.0:1746126618.738508:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721531648 00002000:00100000:2.0:1746126618.738515:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093231f80 x1830945721531648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.738520:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093231f80 with x1830945721531648 ext(1048576->2097151) 00002000:00010000:2.0:1746126618.738523:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093231f80 00000100:00100000:2.0:1746126618.738534:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7817 00000100:00100000:2.0:1746126618.738539:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721531264:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.738658:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7818 00000100:00100000:3.0:1746126618.738665:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721531392:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.738924:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7819 00000100:00100000:2.0:1746126618.738929:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721531776:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126618.739607:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7820 00000100:00100000:1.0:1746126618.739613:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721531648:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.759156:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721531776:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20216us (20835us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126618.759167:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7819 00002000:00100000:2.0:1746126618.759178:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093231180 x1830945721531776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.759187:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093231180 with x1830945721531776 ext(1048576->2097151) 00002000:00010000:2.0:1746126618.759192:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093231180 00000100:00100000:2.0:1746126618.764240:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721531264:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25687us (26335us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126618.764256:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7817 00002000:00100000:2.0:1746126618.764268:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880134c3f100 x1830945721531264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.764277:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3f100 with x1830945721531264 ext(0->1048575) 00002000:00010000:2.0:1746126618.764282:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3f100 00000100:00100000:3.0:1746126618.773601:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721531392:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34929us (35312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.773611:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7818 00002000:00100000:3.0:1746126618.773620:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880136a81180 x1830945721531392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.773629:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81180 with x1830945721531392 ext(1048576->2097151) 00002000:00010000:3.0:1746126618.773634:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a81180 00000100:00100000:1.0:1746126618.780056:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721531648:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40427us (41708us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126618.780070:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7820 00002000:00100000:1.0:1746126618.780082:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093231f80 x1830945721531648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.780091:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093231f80 with x1830945721531648 ext(1048576->2097151) 00002000:00010000:1.0:1746126618.780096:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093231f80 00000100:00100000:1.0:1746126618.783508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.783580:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721532032 00000100:00100000:2.0:1746126618.783587:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721532032 00000100:00100000:2.0:1746126618.783618:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13693 00000100:00100000:2.0:1746126618.783624:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+23:31348:x1830945721532032:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126618.783638:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.783651:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfe2 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.783672:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.783679:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 24 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.783684:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.783685:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.783688:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1224704->2027519] (req 1224704->2027519) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.783710:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 24 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.783725:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 24 pid: 20294 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.783736:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396096:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.783841:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.783848:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 9 pid: 4640 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746126618.783856:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396224:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.783883:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.786974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.787008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.787142:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721532288 00000100:00100000:1.0:1746126618.787149:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721532288 00002000:00100000:1.0:1746126618.787186:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3428351) req@ffff880093233480 x1830945721532288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 504/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.787195:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233480 with x1830945721532288 ext(2097152->3428351) 00002000:00010000:1.0:1746126618.787199:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093233480 00000100:00100000:1.0:1746126618.787213:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721532416 00000100:00100000:1.0:1746126618.787215:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721532416 00002000:00100000:1.0:1746126618.787230:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3428352->4194303) req@ffff880093232300 x1830945721532416/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.787236:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232300 with x1830945721532416 ext(3428352->4194303) 00002000:00010000:1.0:1746126618.787239:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093232300 00000100:00100000:1.0:1746126618.787250:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7821 00000100:00100000:1.0:1746126618.787256:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721532288:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.788988:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7822 00000100:00100000:3.0:1746126618.788997:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721532416:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126618.789931:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396096:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126618.789942:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396224:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126618.789965:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1224704->2027519] (req 1224704->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.789977:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a44bf600, rc 0) 00000100:00100000:2.0:1746126618.790001:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:31348:x1830945721532032:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6377us (6499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.790008:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13693 00000100:00100000:0.0:1746126618.791483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.792179:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721532672 00000100:00100000:2.0:1746126618.792187:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721532672 00000100:00100000:2.0:1746126618.792222:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13694 00000100:00100000:2.0:1746126618.792228:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:31355:x1830945721532672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.792241:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.792254:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dfe9 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.792271:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.792276:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1224704->2027519] (req 1224704->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.792281:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126618.792284:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.792310:0:4641:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1224704->2027519] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.792319:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.792326:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b090a00, rc 0) 00000100:00100000:2.0:1746126618.792358:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:31355:x1830945721532672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 130us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.792363:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13694 00000100:00100000:0.0:1746126618.795364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.795411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.795787:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721532800 00000100:00100000:3.0:1746126618.795795:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721532800 00010000:00010000:3.0:1746126618.795824:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 25 pid: 20294 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.795869:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721532928 00000100:00100000:3.0:1746126618.795872:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721532928 00010000:00010000:3.0:1746126618.795881:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746126618.795908:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7144 00000100:00100000:3.0:1746126618.795914:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721532800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.795923:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.795940:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 25 pid: 20294 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.795950:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 25 pid: 20294 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.795968:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356c3a00/0xb50e825867613df5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df3a expref: 25 pid: 20294 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.795985:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.796019:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721532800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.796025:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7144 00000100:00100000:3.0:1746126618.796071:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7145 00000100:00100000:3.0:1746126618.796076:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721532928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126618.796081:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126618.796089:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.796096:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.796107:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921fd400/0xb50e825867613d9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4def4 expref: 10 pid: 4640 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746126618.796116:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.796117:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.796122:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.796129:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.796152:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 23 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.796160:0:7072:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 23 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.796169:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721396480:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126618.796215:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.798459:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721532288:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11198us (11488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126618.798469:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7821 00002000:00100000:1.0:1746126618.798477:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3428351) req@ffff880093233480 x1830945721532288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 504/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.798486:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233480 with x1830945721532288 ext(2097152->3428351) 00002000:00010000:1.0:1746126618.798490:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093233480 00000100:00100000:2.0:1746126618.799099:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721396480:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.799113:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.799146:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721532928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3068us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.799153:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7145 00000100:00100000:3.0:1746126618.799821:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721532416:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10825us (12811us total) trans 0 rc 765952/765952 00000100:00100000:3.0:1746126618.799846:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7822 00002000:00100000:3.0:1746126618.799851:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3428352->4194303) req@ffff880093232300 x1830945721532416/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.799858:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232300 with x1830945721532416 ext(3428352->4194303) 00002000:00010000:3.0:1746126618.799861:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093232300 00000100:00100000:0.0:1746126618.800203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.800630:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721533184 00000100:00100000:3.0:1746126618.800635:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721533184 00002000:00100000:3.0:1746126618.800661:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1224704->1228799) req@ffff880093230000 x1830945721533184/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.800668:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093230000 with x1830945721533184 ext(1224704->1228799) 00010000:00010000:3.0:1746126618.800674:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.800684:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.800689:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093230000 00000100:00100000:3.0:1746126618.800713:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1783 00000100:00100000:3.0:1746126618.800719:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721533184:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.801358:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721533184:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 638us (1155us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.801364:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1783 00002000:00100000:3.0:1746126618.801370:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1224704->1228799) req@ffff880093230000 x1830945721533184/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.801381:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093230000 with x1830945721533184 ext(1224704->1228799) 00010000:00010000:3.0:1746126618.801386:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.801394:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.801400:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093230000 00000100:00100000:0.0:1746126618.807376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.807480:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721533312 00000100:00100000:2.0:1746126618.807488:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721533312 00000100:00100000:2.0:1746126618.807561:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13695 00000100:00100000:2.0:1746126618.807569:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721533312:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.807584:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.807597:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613ef8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dff0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.807640:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721396608:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.807724:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746126618.810199:0:4640:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126613 -> 1746126618 00002000:00010000:2.0:1746126618.810204:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126613 -> 1746126618 00002000:00010000:2.0:1746126618.810206:0:4640:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126613 -> 1746126618 00000100:00100000:2.0:1746126618.810223:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721396608:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.810246:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613ef8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dff0 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.810257:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613ef8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dff0 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.810278:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b091800, rc 0) 00000100:00100000:2.0:1746126618.810317:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721533312:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2748us (2947us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.810322:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13695 00000100:00100000:0.0:1746126618.814343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.814515:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721533568 00000100:00100000:3.0:1746126618.814523:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721533568 00002000:00100000:3.0:1746126618.814562:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (2023424->2027519) req@ffff880093230a80 x1830945721533568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.814570:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093230a80 with x1830945721533568 ext(2023424->2027519) 00010000:00010000:3.0:1746126618.814579:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.814589:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.814594:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093230a80 00000100:00100000:3.0:1746126618.814666:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1784 00000100:00100000:3.0:1746126618.814674:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721533568:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.814814:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721533568:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 141us (477us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.814819:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1784 00002000:00100000:3.0:1746126618.814825:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (2023424->2027519) req@ffff880093230a80 x1830945721533568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.814847:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093230a80 with x1830945721533568 ext(2023424->2027519) 00010000:00010000:3.0:1746126618.814852:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.814859:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.814863:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093230a80 00000100:00100000:0.0:1746126618.817146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.818020:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721533824 00000100:00100000:1.0:1746126618.818028:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721533824 00002000:00100000:1.0:1746126618.818068:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093232680 x1830945721533824/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.818076:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232680 with x1830945721533824 ext(4194304->4976639) 00002000:00010000:1.0:1746126618.818081:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093232680 00000100:00100000:1.0:1746126618.818108:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7823 00000100:00100000:1.0:1746126618.818115:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721533824:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126618.823757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.824205:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721534080 00000100:00100000:3.0:1746126618.824219:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721534080 00002000:00100000:3.0:1746126618.824257:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1224704->2027519) req@ffff880093232a00 x1830945721534080/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.824266:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232a00 with x1830945721534080 ext(1224704->2027519) 00010000:00010000:3.0:1746126618.824275:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.824287:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 24 pid: 4641 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.824293:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093232a00 00000100:00100000:3.0:1746126618.824320:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1785 00000100:00100000:3.0:1746126618.824327:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721534080:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126618.825357:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721533824:12345-192.168.203.2@tcp:3:cat.0 Request processed in 7239us (8212us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126618.825364:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7823 00002000:00100000:1.0:1746126618.825370:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880093232680 x1830945721533824/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126618.825377:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232680 with x1830945721533824 ext(4194304->4976639) 00002000:00010000:1.0:1746126618.825382:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093232680 00000100:00100000:0.0:1746126618.829624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.830524:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721534208 00000100:00100000:2.0:1746126618.830532:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721534208 00000100:00100000:0.0:1746126618.830639:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13696 00000100:00100000:0.0:1746126618.830648:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721534208:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126618.830663:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126618.830677:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef64e00/0xb50e825867613eff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dff7 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.830719:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396736:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126618.830787:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.833620:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396736:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.834000:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef64e00/0xb50e825867613eff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dff7 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.834011:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef64e00/0xb50e825867613eff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dff7 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126618.834108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126618.834305:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64e00, rc 0) 00000100:00100000:2.0:1746126618.834344:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721534208:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3697us (4726us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.834350:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13696 00000100:00100000:1.0:1746126618.834483:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721534464 00000100:00100000:1.0:1746126618.834489:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721534464 00000100:00100000:1.0:1746126618.834522:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8977 00000100:00100000:1.0:1746126618.834528:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31357:x1830945721534464:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126618.834543:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.834555:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21c00/0xb50e825867613f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4dffe expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.834619:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.834629:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126618.834637:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126618.834644:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126618.834708:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21c00/0xb50e825867613f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 21 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.834727:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.834733:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126618.834735:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126618.834737:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e21200, rc 0) 00000100:00100000:1.0:1746126618.834769:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31357:x1830945721534464:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 240us (661us total) trans 8589943165 rc 0/0 00000100:00100000:1.0:1746126618.834774:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8977 00000100:00100000:0.0:1746126618.837275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.838435:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721534592 00000100:00100000:2.0:1746126618.838443:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721534592 00000100:00100000:2.0:1746126618.838473:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13697 00000100:00100000:2.0:1746126618.838479:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721534592:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.838491:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.838504:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b090600/0xb50e825867613f1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e005 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.838543:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396864:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126618.838614:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.839355:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721534080:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 15026us (15602us total) trans 17179873235 rc 0/0 00000100:00100000:3.0:1746126618.839366:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1785 00002000:00100000:3.0:1746126618.839374:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1224704->2027519) req@ffff880093232a00 x1830945721534080/t17179873235(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.839382:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232a00 with x1830945721534080 ext(1224704->2027519) 00010000:00010000:3.0:1746126618.839389:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.839400:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.839406:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093232a00 00010000:00010000:3.0:1746126618.840993:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746126618.841436:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721396864:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.841589:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b090600/0xb50e825867613f1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e005 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.841610:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b090600/0xb50e825867613f1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e005 expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.841621:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b090600, rc 0) 00000100:00100000:2.0:1746126618.841663:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721534592:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3183us (4391us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.841670:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13697 00000100:00100000:0.0:1746126618.841958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.842186:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721534720 00000100:00100000:2.0:1746126618.842192:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721534720 00010000:00010000:2.0:1746126618.842211:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.842248:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7146 00000100:00100000:2.0:1746126618.842255:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721534720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.842263:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.842272:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.842280:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.842293:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a44bf600/0xb50e825867613eea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->2027519) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe2 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.842302:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.842304:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.842309:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.842316:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.842337:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 25 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.842346:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721396992:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.843169:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.851566:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721396992:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.851587:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.851637:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721534720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9381us (9678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.851647:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7146 00000100:00100000:0.0:1746126618.853569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.853977:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721535104 00000100:00100000:3.0:1746126618.853984:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721535104 00002000:00100000:3.0:1746126618.854018:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009ed48000 x1830945721535104/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.854027:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed48000 with x1830945721535104 ext(1048576->2097151) 00002000:00010000:3.0:1746126618.854031:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed48000 00000100:00100000:3.0:1746126618.854045:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7824 00000100:00100000:3.0:1746126618.854059:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721535104:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126618.870230:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721535104:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16163us (16656us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126618.870241:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7824 00002000:00100000:3.0:1746126618.870249:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009ed48000 x1830945721535104/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.870258:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed48000 with x1830945721535104 ext(1048576->2097151) 00002000:00010000:3.0:1746126618.870263:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed48000 00000100:00100000:0.0:1746126618.886549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.886606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.887355:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721535232 00000100:00100000:2.0:1746126618.887365:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721535232 00000100:00100000:2.0:1746126618.887402:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721535360 00000100:00100000:2.0:1746126618.887404:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721535360 00000100:00100000:2.0:1746126618.887421:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13698 00000100:00100000:2.0:1746126618.887428:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721535232:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126618.887446:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126618.887462:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801348b1e00/0xb50e825867613f22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e00c expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.887510:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397120:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126618.887879:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13699 00000100:00100000:0.0:1746126618.887890:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721535360:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126618.887900:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126618.887911:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb18200/0xb50e825867613f29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e013 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.887943:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721397248:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126618.888434:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.888517:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.891146:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721397248:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126618.891191:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb18200/0xb50e825867613f29 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e013 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.891206:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18200/0xb50e825867613f29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e013 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126618.891223:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18200, rc 0) 00000100:00100000:2.0:1746126618.891285:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721535360:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3393us (4675us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126618.891295:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13699 00000100:00100000:3.0:1746126618.891782:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397120:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126618.891802:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801348b1e00/0xb50e825867613f22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e00c expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.891810:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1e00/0xb50e825867613f22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e00c expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126618.891850:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1e00, rc 0) 00000100:00100000:3.0:1746126618.891875:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721535232:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4446us (5337us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126618.891880:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13698 00000100:00100000:1.0:1746126618.904067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.904630:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721535488 00000100:00100000:3.0:1746126618.904640:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721535488 00000100:00100000:3.0:1746126618.904717:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13700 00000100:00100000:3.0:1746126618.904726:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:31355:x1830945721535488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.904747:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.904768:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e01a expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.904800:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.904808:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126618.904811:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126618.904815:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 18 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.904885:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.904899:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 15 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.904911:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397376:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.909812:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.916233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.916321:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721535616 00000100:00100000:2.0:1746126618.916331:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721535616 00002000:00100000:2.0:1746126618.916378:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2830336->3112959) req@ffff88009ed4ad80 x1830945721535616/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.916387:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4ad80 with x1830945721535616 ext(2830336->3112959) 00010000:00010000:2.0:1746126618.916396:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.916409:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.916416:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed4ad80 00000100:00100000:2.0:1746126618.916451:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1786 00000100:00100000:2.0:1746126618.916459:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721535616:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126618.916573:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397376:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.916595:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 18 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.916608:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fcc00, rc 0) 00000100:00100000:3.0:1746126618.916646:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:31355:x1830945721535488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11923us (12603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.916653:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13700 00000100:00100000:2.0:1746126618.924019:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721535616:12345-192.168.203.2@tcp:4:cat.0 Request processed in 7552us (7788us total) trans 21474840385 rc 0/0 00000100:00100000:2.0:1746126618.924031:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1786 00002000:00100000:2.0:1746126618.924041:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2830336->3112959) req@ffff88009ed4ad80 x1830945721535616/t21474840385(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.924060:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4ad80 with x1830945721535616 ext(2830336->3112959) 00010000:00010000:2.0:1746126618.924071:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.924085:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746126618.924091:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed4ad80 00000100:00100000:0.0:1746126618.938408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.939418:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721535744 00000100:00100000:1.0:1746126618.939428:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721535744 00010000:00010000:1.0:1746126618.939467:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.939501:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7147 00000100:00100000:1.0:1746126618.939509:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721535744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.939525:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.939548:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.939564:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.939587:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb800/0xb50e825867613ea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3112959) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfaa expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.939616:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.939619:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.939626:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.939634:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.939667:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.939680:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721397504:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126618.939766:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.944485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.944536:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536000 00000100:00100000:0.0:1746126618.944538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.944546:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536000 00002000:00100000:2.0:1746126618.944593:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ed4b800 x1830945721536000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.944603:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b800 with x1830945721536000 ext(2097152->3145727) 00002000:00010000:2.0:1746126618.944608:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4b800 00000100:00100000:2.0:1746126618.944628:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7825 00000100:00100000:2.0:1746126618.944634:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721536000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126618.944853:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536128 00000100:00100000:3.0:1746126618.944858:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536128 00000100:00100000:3.0:1746126618.944891:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13701 00000100:00100000:3.0:1746126618.944895:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31357:x1830945721536128:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126618.944904:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.944920:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e021 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.944947:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.944954:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 18 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.944958:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721397504:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126618.944960:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.944962:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126618.944965:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [626688->1048575] (req 626688->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.944977:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126618.944991:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 18 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.945003:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 18 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.945013:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397632:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.945031:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721535744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5521us (6632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.945039:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7147 00010000:00010000:3.0:1746126618.945090:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.945098:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.945110:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397760:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.945132:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126618.952060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.953632:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397632:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.953651:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721397760:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126618.953685:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [626688->1048575] (req 626688->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 18 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.953706:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fde00, rc 0) 00000100:00100000:0.0:1746126618.954924:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536256 00000100:00100000:0.0:1746126618.954934:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536256 00010000:00010000:0.0:1746126618.954976:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 20 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.955017:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7148 00000100:00100000:0.0:1746126618.955027:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721536256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.955043:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.955082:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 20 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.955093:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 20 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.955117:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb000/0xb50e825867613ee3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfdb expref: 20 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.955140:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126618.955387:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31357:x1830945721536128:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10485us (10842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126618.955397:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13701 00000100:00100000:1.0:1746126618.955738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.955876:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721536256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 848us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126618.955884:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7148 00000100:00100000:0.0:1746126618.955917:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536384 00000100:00100000:0.0:1746126618.955922:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536384 00010000:00010000:0.0:1746126618.955938:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.955961:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7149 00000100:00100000:0.0:1746126618.955968:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721536384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.955976:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.955989:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.955998:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.956013:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e200/0xb50e825867613ec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfbf expref: 18 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.956023:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.956025:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.956033:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.956041:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.956085:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 17 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.956096:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed4bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721397888:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126618.956149:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126618.966037:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721536000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21390us (21551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126618.966059:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7825 00002000:00100000:2.0:1746126618.966073:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ed4b800 x1830945721536000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:379/0 lens 488/440 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.966083:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b800 with x1830945721536000 ext(2097152->3145727) 00002000:00010000:2.0:1746126618.966089:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4b800 00000100:00100000:1.0:1746126618.966334:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed4bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721397888:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126618.966360:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126618.966391:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721536384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10424us (10656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.966400:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7149 00000100:00100000:0.0:1746126618.967230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.967278:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536640 00000100:00100000:2.0:1746126618.967286:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536640 00002000:00100000:2.0:1746126618.967321:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (626688->630783) req@ffff88009ed4b100 x1830945721536640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.967328:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b100 with x1830945721536640 ext(626688->630783) 00002000:00010000:2.0:1746126618.967332:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4b100 00000100:00100000:2.0:1746126618.967357:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7826 00000100:00100000:2.0:1746126618.967364:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721536640:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126618.969012:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721536640:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1640us (1776us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126618.969023:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7826 00002000:00100000:2.0:1746126618.969033:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (626688->630783) req@ffff88009ed4b100 x1830945721536640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126618.969041:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b100 with x1830945721536640 ext(626688->630783) 00002000:00010000:2.0:1746126618.969054:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed4b100 00000100:00100000:1.0:1746126618.974971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126618.975078:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536768 00000100:00100000:3.0:1746126618.975088:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536768 00000100:00100000:3.0:1746126618.975133:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13702 00000100:00100000:3.0:1746126618.975140:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:31355:x1830945721536768:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126618.975159:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126618.975176:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e028 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.975205:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.975211:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126618.975212:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126618.975215:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.975246:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126618.975256:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 8 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746126618.975267:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721398016:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126618.975349:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.978123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.978215:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721536896 00000100:00100000:1.0:1746126618.978223:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721536896 00000100:00100000:1.0:1746126618.978276:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13703 00000100:00100000:1.0:1746126618.978284:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31357:x1830945721536896:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126618.978303:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126618.978321:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e02f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.978348:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.978355:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.978356:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.978360:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.978390:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.978401:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.978411:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721398144:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.978945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.979815:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721398016:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126618.980039:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.980133:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537024 00000100:00100000:3.0:1746126618.980139:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537024 00002000:00100000:3.0:1746126618.980183:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2203647) req@ffff88009ed49880 x1830945721537024/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.980193:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49880 with x1830945721537024 ext(2097152->2203647) 00010000:00010000:3.0:1746126618.980202:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 11 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.980213:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 11 pid: 8436 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.980219:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed49880 00000100:00100000:3.0:1746126618.980245:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1787 00000100:00100000:3.0:1746126618.980253:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721537024:12345-192.168.203.2@tcp:4:multiop.0 00010000:00010000:2.0:1746126618.980518:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 26 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.980532:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fc800, rc 0) 00000100:00100000:2.0:1746126618.980563:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+26:31355:x1830945721536768:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5422us (5602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.980570:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13702 00000100:00100000:0.0:1746126618.984739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.984865:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537152 00000100:00100000:0.0:1746126618.984873:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537152 00010000:00010000:0.0:1746126618.984905:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.984928:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7150 00000100:00100000:0.0:1746126618.984933:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721537152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126618.984945:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126618.984965:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.984976:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746126618.985000:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.985002:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.985008:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.985015:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.985044:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126618.985065:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed49f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721398272:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126618.985134:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d540 going to sleep for 11 seconds 00010000:00010000:1.0:1746126618.985308:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613ef1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfe9 expref: 26 pid: 4641 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.985326:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721398144:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126618.985345:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.985353:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b091800, rc 0) 00000100:00100000:1.0:1746126618.985378:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31357:x1830945721536896:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7095us (7265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.985385:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13703 00000100:00100000:3.0:1746126618.986319:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721537024:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 6065us (7371us total) trans 17179873236 rc 0/0 00000100:00100000:3.0:1746126618.986331:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1787 00002000:00100000:3.0:1746126618.986338:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2203647) req@ffff88009ed49880 x1830945721537024/t17179873236(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/448 e 0 to 0 dl 1746126629 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.986347:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49880 with x1830945721537024 ext(2097152->2203647) 00010000:00010000:3.0:1746126618.986353:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 12 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746126618.986363:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 12 pid: 8436 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746126618.986368:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed49880 00000100:00100000:2.0:1746126618.987525:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed49f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721398272:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126618.987544:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126618.987570:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721537152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2636us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126618.987579:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7150 00000100:00100000:0.0:1746126618.993807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.995716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.995776:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537536 00000100:00100000:0.0:1746126618.995785:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537536 00000100:00100000:3.0:1746126618.996379:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537408 00000100:00100000:3.0:1746126618.996385:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537408 00002000:00100000:3.0:1746126618.996423:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1380352->1384447) req@ffff88009ed48a80 x1830945721537408/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/0 e 0 to 0 dl 1746126629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.996433:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed48a80 with x1830945721537408 ext(1380352->1384447) 00002000:00010000:3.0:1746126618.996438:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed48a80 00000100:00100000:3.0:1746126618.996467:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7827 00000100:00100000:3.0:1746126618.996474:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721537408:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126618.996639:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13704 00000100:00100000:0.0:1746126618.996646:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:31361:x1830945721537536:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:3.0:1746126618.996648:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721537408:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 175us (2850us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126618.996654:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7827 00010000:00010000:0.0:1746126618.996656:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746126618.996658:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1380352->1384447) req@ffff88009ed48a80 x1830945721537408/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:379/0 lens 488/4536 e 0 to 0 dl 1746126629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126618.996669:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed48a80 with x1830945721537408 ext(1380352->1384447) 00010000:00010000:0.0:1746126618.996670:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e036 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126618.996672:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed48a80 00010000:00010000:0.0:1746126618.996693:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.996700:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126618.996705:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.996707:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126618.996710:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1073152->1581055] (req 1073152->1581055) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.996737:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126618.996747:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 840 lvb_type: 1 00000100:00100000:0.0:1746126618.996758:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721398400:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126618.996822:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.996844:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 16 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746126618.996852:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721398528:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.996878:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746126618.997066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126618.997354:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537664 00000100:00100000:2.0:1746126618.997359:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537664 00010000:00010000:2.0:1746126618.997378:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 12 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746126618.997411:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7151 00000100:00100000:2.0:1746126618.997416:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721537664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126618.997425:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126618.997439:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 12 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.997449:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 12 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.997470:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65000/0xb50e825867613e1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df5d expref: 12 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746126618.997495:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.997497:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126618.997503:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.997509:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126618.997530:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 24 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126618.997539:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721398656:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126618.998799:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126618.999213:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721398400:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126618.999223:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721398528:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126618.999252:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1073152->1581055] (req 1073152->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126618.999264:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18c00, rc 0) 00000100:00100000:0.0:1746126618.999292:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:31361:x1830945721537536:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2646us (3583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126618.999299:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13704 00000100:00100000:0.0:1746126618.999594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126618.999625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126618.999683:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537792 00000100:00100000:1.0:1746126618.999689:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537792 00010000:00010000:1.0:1746126618.999708:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746126618.999724:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721537920 00000100:00100000:1.0:1746126618.999725:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721537920 00010000:00010000:1.0:1746126618.999734:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 17 pid: 8436 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746126618.999752:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7152 00000100:00100000:1.0:1746126618.999757:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721537792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.999767:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.999784:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746126618.999791:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746126618.999811:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eeb8200/0xb50e825867613e50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df72 expref: 18 pid: 20294 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746126618.999823:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126618.999854:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721537792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126618.999859:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7152 00000100:00100000:1.0:1746126618.999869:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7153 00000100:00100000:1.0:1746126618.999873:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721537920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126618.999879:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126618.999884:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 17 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.999892:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 17 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.999907:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65a00/0xb50e825867613de7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df25 expref: 17 pid: 8436 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746126618.999914:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.999916:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126618.999920:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.999926:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126618.999945:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126618.999952:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721398784:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126618.999984:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.001476:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721398656:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126619.001493:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.001534:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721537664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4113us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.001543:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7151 00000100:00100000:1.0:1746126619.003988:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721398784:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126619.004011:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126619.004057:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721537920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4171us (4420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.004067:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7153 00000100:00100000:0.0:1746126619.006654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.006965:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721538176 00000100:00100000:1.0:1746126619.006975:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721538176 00002000:00100000:1.0:1746126619.007020:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1073152->1077247) req@ffff88009ed49c00 x1830945721538176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.007035:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49c00 with x1830945721538176 ext(1073152->1077247) 00002000:00010000:1.0:1746126619.007040:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed49c00 00000100:00100000:1.0:1746126619.007082:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7828 00000100:00100000:1.0:1746126619.007089:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721538176:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126619.007256:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721538176:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 166us (610us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126619.007262:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7828 00002000:00100000:1.0:1746126619.007267:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1073152->1077247) req@ffff88009ed49c00 x1830945721538176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.007273:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49c00 with x1830945721538176 ext(1073152->1077247) 00002000:00010000:1.0:1746126619.007276:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed49c00 00000100:00100000:0.0:1746126619.011213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.011248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.011282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.011308:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721538432 00000100:00100000:0.0:1746126619.011316:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721538432 00002000:00100000:0.0:1746126619.011358:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ed4b480 x1830945721538432/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.011367:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b480 with x1830945721538432 ext(2097152->3145727) 00002000:00010000:0.0:1746126619.011373:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed4b480 00000100:00100000:0.0:1746126619.011403:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721538944 00000100:00100000:0.0:1746126619.011405:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721538944 00002000:00100000:0.0:1746126619.011416:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ed49180 x1830945721538944/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.011423:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49180 with x1830945721538944 ext(3145728->4194303) 00002000:00010000:0.0:1746126619.011425:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed49180 00000100:00100000:0.0:1746126619.011433:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721538560 00000100:00100000:0.0:1746126619.011435:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721538560 00002000:00100000:0.0:1746126619.011443:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880099251500 x1830945721538560/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746126619.011444:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7829 00002000:00100000:0.0:1746126619.011449:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251500 with x1830945721538560 ext(3145728->4194303) 00002000:00010000:0.0:1746126619.011451:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099251500 00000100:00100000:2.0:1746126619.011453:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721538432:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126619.011460:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7830 00000100:00100000:0.0:1746126619.011464:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721538944:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126619.011708:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7831 00000100:00100000:2.0:1746126619.011714:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721538560:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126619.023416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.023516:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721539200 00000100:00100000:1.0:1746126619.023527:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721539200 00002000:00100000:1.0:1746126619.023574:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1576960->1581055) req@ffff880099252a00 x1830945721539200/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.023586:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099252a00 with x1830945721539200 ext(1576960->1581055) 00002000:00010000:1.0:1746126619.023592:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099252a00 00000100:00100000:1.0:1746126619.023629:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7832 00000100:00100000:1.0:1746126619.023637:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721539200:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126619.023811:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721539200:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 174us (404us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126619.023818:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7832 00002000:00100000:1.0:1746126619.023846:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1576960->1581055) req@ffff880099252a00 x1830945721539200/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.023855:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099252a00 with x1830945721539200 ext(1576960->1581055) 00002000:00010000:1.0:1746126619.023858:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099252a00 00000100:00100000:1.0:1746126619.034893:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721538944:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23415us (23631us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.034906:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7830 00002000:00100000:1.0:1746126619.034918:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ed49180 x1830945721538944/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.034927:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed49180 with x1830945721538944 ext(3145728->4194303) 00002000:00010000:1.0:1746126619.034933:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed49180 00000100:00100000:0.0:1746126619.040821:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721538560:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 29092us (29522us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126619.041126:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7831 00002000:00100000:0.0:1746126619.041141:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880099251500 x1830945721538560/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.041150:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251500 with x1830945721538560 ext(3145728->4194303) 00002000:00010000:0.0:1746126619.041156:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099251500 00000100:00100000:3.0:1746126619.041667:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721538432:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 30214us (30462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.041674:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7829 00002000:00100000:3.0:1746126619.041679:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ed4b480 x1830945721538432/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.041686:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4b480 with x1830945721538432 ext(2097152->3145727) 00002000:00010000:3.0:1746126619.041689:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed4b480 00000100:00100000:0.0:1746126619.051120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.051463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.051537:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721539328 00000100:00100000:3.0:1746126619.051546:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721539328 00000100:00100000:3.0:1746126619.051588:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721539456 00000100:00100000:3.0:1746126619.051590:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721539456 00000100:00100000:3.0:1746126619.051691:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13705 00000100:00100000:3.0:1746126619.051700:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721539328:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.051720:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.051737:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098dfde00/0xb50e825867613f53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e03d expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.051788:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721398912:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126619.051809:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13706 00000100:00100000:0.0:1746126619.051816:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721539456:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126619.051823:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126619.051862:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb18a00/0xb50e825867613f5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e044 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.051916:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721399040:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.052011:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.052406:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.054004:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721398912:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.054032:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098dfde00/0xb50e825867613f53 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e03d expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.054056:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098dfde00/0xb50e825867613f53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e03d expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.054070:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098dfde00, rc 0) 00000100:00100000:1.0:1746126619.054187:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721399040:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126619.054206:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb18a00/0xb50e825867613f5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e044 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.054215:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb18a00/0xb50e825867613f5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e044 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.054228:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18a00, rc 0) 00000100:00100000:3.0:1746126619.054405:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:1966:x1830945721539328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2705us (3295us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.054414:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13705 00000100:00100000:1.0:1746126619.054549:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721539456:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2732us (3085us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126619.054555:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13706 00000100:00100000:0.0:1746126619.058565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.058720:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721539712 00000100:00100000:1.0:1746126619.058729:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721539712 00002000:00100000:1.0:1746126619.058773:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099253800 x1830945721539712/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.058784:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253800 with x1830945721539712 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.058788:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253800 00000100:00100000:1.0:1746126619.058820:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7833 00000100:00100000:1.0:1746126619.058851:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721539712:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.065304:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721539712:12345-192.168.203.2@tcp:3:cat.0 Request processed in 6467us (6737us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126619.065314:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7833 00002000:00100000:1.0:1746126619.065325:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099253800 x1830945721539712/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.065338:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253800 with x1830945721539712 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.065344:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253800 00000100:00100000:0.0:1746126619.074452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.074558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.075387:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721539840 00000100:00100000:1.0:1746126619.075398:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721539840 00000100:00100000:3.0:1746126619.075948:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721539968 00000100:00100000:3.0:1746126619.075953:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721539968 00000100:00100000:0.0:1746126619.076641:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13707 00000100:00100000:0.0:1746126619.076652:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721539840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126619.076672:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126619.076689:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbba00/0xb50e825867613f61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e04b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126619.076743:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721399168:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126619.076819:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.076991:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13708 00000100:00100000:1.0:1746126619.076998:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721539968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126619.077006:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.077016:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b091600/0xb50e825867613f68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e052 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.077042:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721399296:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.077079:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.078427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.078489:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721540096 00000100:00100000:2.0:1746126619.078495:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721540096 00000100:00100000:0.0:1746126619.078495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.078519:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721540224 00000100:00100000:2.0:1746126619.078521:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721540224 00000100:00100000:0.0:1746126619.078521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.078530:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721540352 00000100:00100000:2.0:1746126619.078533:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721540352 00000100:00100000:2.0:1746126619.078546:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13709 00000100:00100000:2.0:1746126619.078551:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721540096:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.078561:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.078572:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570e000/0xb50e825867613f6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e059 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.078599:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721399424:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126619.078640:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.078655:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13710 00000100:00100000:2.0:1746126619.078659:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721540224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.078665:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.078671:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e060 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.078683:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.078685:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.078692:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.078705:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.078713:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570f800, rc 0) 00000100:00100000:2.0:1746126619.078730:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721540224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.078735:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13710 00000100:00100000:2.0:1746126619.078748:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13711 00000100:00100000:2.0:1746126619.078752:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721540352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.078757:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.078765:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e067 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.078773:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.078774:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.078777:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.078787:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.078793:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fc00, rc 0) 00000100:00100000:2.0:1746126619.078808:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721540352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.078812:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13711 00000100:00100000:1.0:1746126619.078955:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721399168:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126619.078979:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbba00/0xb50e825867613f61 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e04b expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.078988:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbba00/0xb50e825867613f61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e04b expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.079012:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbba00, rc 0) 00000100:00100000:1.0:1746126619.079035:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721539840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2386us (4592us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126619.079040:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13707 00000100:00100000:1.0:1746126619.079265:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721399296:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126619.079282:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b091600/0xb50e825867613f68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e052 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.079291:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b091600/0xb50e825867613f68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e052 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.079298:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b091600, rc 0) 00000100:00100000:1.0:1746126619.079329:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721539968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2331us (4769us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126619.079334:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13708 00002000:00010000:2.0:1746126619.080318:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126617 -> 1746126618 00002000:00010000:2.0:1746126619.080321:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126617 -> 1746126618 00000100:00100000:2.0:1746126619.080334:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721399424:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.080348:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570e000/0xb50e825867613f6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e059 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.080356:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e000/0xb50e825867613f6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e059 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.080371:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e000, rc 0) 00000100:00100000:2.0:1746126619.080496:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721540096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1943us (2071us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.080501:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13709 00000100:00100000:0.0:1746126619.083808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.083887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.083973:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721540608 00000100:00100000:1.0:1746126619.083982:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721540608 00000100:00100000:1.0:1746126619.084037:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721540480 00000100:00100000:1.0:1746126619.084040:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721540480 00000100:00100000:1.0:1746126619.084293:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13712 00000100:00100000:1.0:1746126619.084302:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721540608:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126619.084321:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.084340:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613f84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e075 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.084395:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721399552:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.084465:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.084589:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13713 00000100:00100000:2.0:1746126619.084596:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721540480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.084603:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.084613:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e06e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.084638:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721399680:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126619.084668:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.085129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.085156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.085214:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721540992 00000100:00100000:2.0:1746126619.085218:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721540992 00002000:00100000:2.0:1746126619.085248:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1384448->2097151) req@ffff880093496a00 x1830945721540992/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.085257:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093496a00 with x1830945721540992 ext(1384448->2097151) 00002000:00010000:2.0:1746126619.085261:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093496a00 00000100:00100000:0.0:1746126619.085267:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721541120 00000100:00100000:0.0:1746126619.085270:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721541120 00000100:00100000:2.0:1746126619.085274:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7834 00000100:00100000:2.0:1746126619.085278:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721540992:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:0.0:1746126619.085286:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->626687) req@ffff880093494380 x1830945721541120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.085292:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494380 with x1830945721541120 ext(0->626687) 00002000:00010000:0.0:1746126619.085295:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093494380 00000100:00100000:0.0:1746126619.085305:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7835 00000100:00100000:0.0:1746126619.085309:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721541120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126619.089621:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721399680:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.089660:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f8b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e06e expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.089675:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e06e expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.089700:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fe00, rc 0) 00000100:00100000:3.0:1746126619.089747:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721540480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5150us (5859us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.089754:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13713 00000100:00100000:2.0:1746126619.090114:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721399552:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.090135:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613f84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e075 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.090148:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b090a00/0xb50e825867613f84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e075 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.090165:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b090a00, rc 0) 00000100:00100000:2.0:1746126619.090307:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721540608:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6005us (6508us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.090312:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13712 00000100:00100000:2.0:1746126619.092446:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721540992:12345-192.168.203.2@tcp:3:cat.0 Request processed in 7158us (7309us total) trans 0 rc 712704/712704 00000100:00100000:2.0:1746126619.092457:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7834 00002000:00100000:2.0:1746126619.092466:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1384448->2097151) req@ffff880093496a00 x1830945721540992/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 712704/712704 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.092476:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093496a00 with x1830945721540992 ext(1384448->2097151) 00002000:00010000:2.0:1746126619.092482:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093496a00 00000100:00100000:0.0:1746126619.094339:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721541120:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9022us (9175us total) trans 0 rc 626688/626688 00000100:00100000:0.0:1746126619.094349:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7835 00002000:00100000:0.0:1746126619.094357:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->626687) req@ffff880093494380 x1830945721541120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.094365:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494380 with x1830945721541120 ext(0->626687) 00002000:00010000:0.0:1746126619.094370:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093494380 00000100:00100000:0.0:1746126619.106598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.108013:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721541248 00000100:00100000:2.0:1746126619.108025:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721541248 00000100:00100000:2.0:1746126619.108200:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13714 00000100:00100000:2.0:1746126619.108208:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31366:x1830945721541248:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.108226:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.108243:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e07c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.108270:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.108282:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126619.108284:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126619.108287:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.108314:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.108324:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 16 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.108334:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721399808:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.109109:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.110582:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721399808:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.110611:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.110630:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fe00, rc 0) 00000100:00100000:2.0:1746126619.110686:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31366:x1830945721541248:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2478us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.110695:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13714 00000100:00100000:1.0:1746126619.111157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.111287:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721541376 00000100:00100000:0.0:1746126619.111294:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721541376 00002000:00100000:0.0:1746126619.111334:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1073152->1581055) req@ffff880093495c00 x1830945721541376/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.111343:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495c00 with x1830945721541376 ext(1073152->1581055) 00010000:00010000:0.0:1746126619.111350:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 17 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746126619.111363:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 17 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746126619.111370:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093495c00 00000100:00100000:0.0:1746126619.111545:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1788 00000100:00100000:0.0:1746126619.111553:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721541376:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126619.116222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.116272:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721541504 00000100:00100000:1.0:1746126619.116282:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721541504 00000100:00100000:1.0:1746126619.116327:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8978 00000100:00100000:1.0:1746126619.116334:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31368:x1830945721541504:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.116358:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.116377:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6800/0xb50e825867613f99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e083 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.116439:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.116450:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.116461:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.116475:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.116484:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.116489:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.117361:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.117375:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 234 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.117382:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 19 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.117387:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.117420:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 19 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.117432:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 19 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.117444:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721399936:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.117550:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 234 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.117558:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 234 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.117569:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721400064:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.117587:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.121942:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721399936:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.121953:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721400064:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.121974:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126619.122343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.122953:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721541760 00000100:00100000:1.0:1746126619.122960:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721541760 00000100:00100000:0.0:1746126619.122961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.122996:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542016 00000100:00100000:1.0:1746126619.122998:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542016 00000100:00100000:0.0:1746126619.123012:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3805 00000100:00100000:0.0:1746126619.123021:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:7696:x1830945721541760:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126619.123209:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3806 00000100:00100000:1.0:1746126619.123216:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+235:26823:x1830945721542016:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746126619.123224:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:7696:x1830945721541760:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 204us (881us total) trans 8589943166 rc 0/0 00000100:00100000:0.0:1746126619.123231:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3805 00000100:00100000:1.0:1746126619.123327:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+236:26823:x1830945721542016:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 112us (366us total) trans 8589943167 rc 0/0 00000100:00100000:1.0:1746126619.123333:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3806 00000100:00100000:3.0:1746126619.124476:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721541376:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12918us (13315us total) trans 21474840386 rc 0/0 00000100:00100000:3.0:1746126619.124485:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1788 00002000:00100000:3.0:1746126619.124495:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1073152->1581055) req@ffff880093495c00 x1830945721541376/t21474840386(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.124511:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495c00 with x1830945721541376 ext(1073152->1581055) 00010000:00010000:3.0:1746126619.124520:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.124532:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.124539:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093495c00 00000100:00100000:0.0:1746126619.125440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.125896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.125959:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542272 00000100:00100000:2.0:1746126619.125967:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542272 00000100:00100000:1.0:1746126619.125977:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542144 00000100:00100000:1.0:1746126619.125981:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542144 00010000:00010000:2.0:1746126619.125996:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 21 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.125997:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 236 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.126032:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7154 00000100:00100000:1.0:1746126619.126039:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:1966:x1830945721542144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126619.126061:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.126067:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 236 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.126078:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 236 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.126099:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8e0c00/0xb50e825867613eb2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dfb1 expref: 236 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.126113:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.126119:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126126:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126131:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126137:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126619.126166:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+235:1966:x1830945721542144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.126172:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7154 00000100:00100000:1.0:1746126619.126185:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7155 00000100:00100000:1.0:1746126619.126190:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721542272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126619.126203:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.126207:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 21 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.126215:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 21 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.126226:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e21200/0xb50e825867613f0d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4dffe expref: 21 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.126236:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.126239:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126245:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126252:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126271:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126619.126288:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721542272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 98us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.126293:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7155 00010000:00010000:1.0:1746126619.126312:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126317:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126619.126357:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126619.126361:0:15560:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126619.126376:0:15560:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126385:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126396:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126402:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126408:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126413:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aec6e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126619.126416:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126422:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126430:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126619.126433:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126619.126436:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126440:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6e00/0xb50e825867613fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126448:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126453:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126458:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126462:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aec7000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126619.126464:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126469:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126476:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1d00) 00010000:00010000:1.0:1746126619.126478:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126619.126480:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126484:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7000/0xb50e825867613fa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.126521:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec6800/0xb50e825867613f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.126533:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 11 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.126539:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.126541:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126619.126543:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aec7600, rc 0) 00000100:00100000:1.0:1746126619.126570:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31368:x1830945721541504:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 10236us (10356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.126575:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8978 00000100:00100000:0.0:1746126619.127030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.127296:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542400 00000100:00100000:3.0:1746126619.127300:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542400 00010000:00010000:3.0:1746126619.127319:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.127340:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7156 00000100:00100000:3.0:1746126619.127344:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721542400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.127353:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.127370:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.127379:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.127395:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18c00/0xb50e825867613f4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1581055) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e036 expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.127411:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.127414:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.127420:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.127427:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.127457:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.127467:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721400192:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126619.127529:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.129749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.129789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.129813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.129863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.129890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.129904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.130001:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542528 00000100:00100000:1.0:1746126619.130009:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542528 00000100:00100000:1.0:1746126619.130062:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542656 00000100:00100000:1.0:1746126619.130065:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542656 00000100:00100000:1.0:1746126619.130081:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542784 00000100:00100000:1.0:1746126619.130083:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542784 00000100:00100000:1.0:1746126619.130092:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721542912 00000100:00100000:1.0:1746126619.130094:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721542912 00000100:00100000:1.0:1746126619.130104:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721543040 00000100:00100000:1.0:1746126619.130105:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721543040 00000100:00100000:1.0:1746126619.130114:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721543168 00000100:00100000:1.0:1746126619.130115:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721543168 00000100:00100000:1.0:1746126619.130124:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13715 00000100:00100000:1.0:1746126619.130130:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721542528:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.130147:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.130164:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aec6000/0xb50e825867613fb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e08a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.130218:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721400320:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.130287:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.130305:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13716 00000100:00100000:1.0:1746126619.130311:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721542656:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.130319:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.130328:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae43a00/0xb50e825867613fbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e091 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.130352:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721400448:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.130372:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.130387:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13717 00000100:00100000:1.0:1746126619.130392:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721542784:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.130398:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.130404:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e098 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.130414:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130416:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130423:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130437:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130445:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f130000, rc 0) 00000100:00100000:1.0:1746126619.130467:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721542784:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 75us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.130473:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13717 00000100:00100000:1.0:1746126619.130489:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13718 00000100:00100000:1.0:1746126619.130493:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721542912:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.130498:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.130503:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e09f expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.130511:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130512:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130515:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130523:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130533:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aec7800, rc 0) 00000100:00100000:1.0:1746126619.130546:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721542912:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 53us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.130550:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13718 00000100:00100000:1.0:1746126619.130560:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13719 00000100:00100000:1.0:1746126619.130564:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721543040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.130568:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.130574:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0a6 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.130582:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130583:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130587:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130594:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130600:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aec6c00, rc 0) 00000100:00100000:1.0:1746126619.130612:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721543040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 48us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.130616:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13719 00000100:00100000:1.0:1746126619.130626:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13720 00000100:00100000:1.0:1746126619.130630:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721543168:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.130637:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.130642:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0ad expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.130650:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130651:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.130654:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130662:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.130668:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aec7a00, rc 0) 00000100:00100000:1.0:1746126619.130680:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721543168:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 50us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.130685:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13720 00000100:00100000:3.0:1746126619.130773:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721400192:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.130787:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.130805:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721542400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3460us (3776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.130848:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7156 00000100:00080000:0.0:1746126619.131131:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126619.131136:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126619.132757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.132968:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721543424 00000100:00100000:3.0:1746126619.132975:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721543424 00002000:00100000:3.0:1746126619.133018:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008f1e2300 x1830945721543424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.133028:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2300 with x1830945721543424 ext(1048576->2097151) 00002000:00010000:3.0:1746126619.133033:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e2300 00000100:00100000:3.0:1746126619.133076:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7836 00000100:00100000:3.0:1746126619.133083:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721543424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.136233:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721400320:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.136268:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aec6000/0xb50e825867613fb5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e08a expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.136281:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aec6000/0xb50e825867613fb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e08a expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.136301:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aec6000, rc 0) 00000100:00100000:2.0:1746126619.136335:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721542528:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6204us (6594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.136343:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13715 00000100:00100000:0.0:1746126619.136413:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721400448:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126619.136434:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae43a00/0xb50e825867613fbc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e091 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126619.136444:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae43a00/0xb50e825867613fbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e091 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126619.136456:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43a00, rc 0) 00000100:00100000:0.0:1746126619.136477:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721542656:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6166us (6687us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126619.136483:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13716 00000100:00100000:0.0:1746126619.142518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.142590:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721543680 00000100:00100000:1.0:1746126619.142599:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721543680 00000100:00100000:1.0:1746126619.142658:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8979 00000100:00100000:1.0:1746126619.142665:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31368:x1830945721543680:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.142686:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.142704:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65e00/0xb50e825867613fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0b4 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.142794:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.142809:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.142816:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.143884:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.143898:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 12 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.143910:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721400576:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.144006:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.148353:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721543424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15258us (15590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.148365:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7836 00002000:00100000:3.0:1746126619.148375:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008f1e2300 x1830945721543424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.148384:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2300 with x1830945721543424 ext(1048576->2097151) 00002000:00010000:3.0:1746126619.148390:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e2300 00000100:00100000:1.0:1746126619.148925:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721400576:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.148948:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126619.149132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.149193:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721543808 00000100:00100000:3.0:1746126619.149199:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721543808 00010000:00010000:3.0:1746126619.149224:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 13 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.149244:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7157 00000100:00100000:3.0:1746126619.149249:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1964:x1830945721543808:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.149260:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.149265:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 13 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.149275:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 13 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.149295:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aec7600/0xb50e825867613fae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e083 expref: 13 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.149322:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126619.149327:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126619.149336:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126619.149342:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126619.149356:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.149376:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1964:x1830945721543808:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 127us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.149381:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7157 00010000:00010000:1.0:1746126619.149450:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.149456:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126619.149475:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126619.149602:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65e00/0xb50e825867613fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.149627:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.149633:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.149636:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126619.149638:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64000, rc 0) 00000100:00100000:1.0:1746126619.149660:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721543680:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6996us (7153us total) trans 8589943168 rc 0/0 00000100:00100000:1.0:1746126619.149665:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8979 00000100:00100000:0.0:1746126619.154626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.154700:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721543936 00000100:00100000:1.0:1746126619.154710:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721543936 00000100:00100000:1.0:1746126619.154759:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8980 00000100:00100000:1.0:1746126619.154767:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721543936:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.154792:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.154810:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867613ff4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0bb expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.154929:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.154943:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.154949:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.154978:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.154988:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 13 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.155000:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721400704:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.155105:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.163125:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721400704:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126619.163135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126619.163149:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:2.0:1746126619.164166:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721544064 00000100:00100000:2.0:1746126619.164174:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721544064 00010000:00010000:2.0:1746126619.164207:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 14 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.164248:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7158 00000100:00100000:2.0:1746126619.164255:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1965:x1830945721544064:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.164271:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.164277:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 14 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.164288:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 14 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.164311:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64000/0xb50e825867613fe6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0b4 expref: 14 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.164340:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126619.164344:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126619.164355:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126619.164362:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126619.164379:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.164428:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1965:x1830945721544064:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 173us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.164435:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7158 00010000:00010000:0.0:1746126619.164526:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126619.164533:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126619.164573:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126619.164576:0:15560:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126619.164590:0:15560:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126619.165209:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867613ff4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.165243:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.165250:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126619.165253:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126619.165255:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65800, rc 0) 00000100:00100000:0.0:1746126619.165285:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721543936:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 10519us (10669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126619.165292:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8980 00000100:00100000:0.0:1746126619.169211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.169250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.169285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.169300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.169303:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721544320 00000100:00100000:0.0:1746126619.169312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.169313:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721544320 00000100:00100000:2.0:1746126619.169353:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721544192 00000100:00100000:2.0:1746126619.169356:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721544192 00000100:00100000:2.0:1746126619.169373:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13721 00000100:00100000:2.0:1746126619.169380:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721544320:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:3.0:1746126619.169398:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13722 00010000:00010000:2.0:1746126619.169400:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126619.169407:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721544192:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126619.169415:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.169419:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614002 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0c9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.169427:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aec6200/0xb50e825867614009 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0c2 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.169468:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721400960:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126619.169469:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721400832:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.169633:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721544576 00000100:00100000:1.0:1746126619.169638:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721544576 00002000:00100000:1.0:1746126619.169675:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008f1e0e00 x1830945721544576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.169684:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0e00 with x1830945721544576 ext(2097152->3145727) 00002000:00010000:1.0:1746126619.169689:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e0e00 00000100:00100000:1.0:1746126619.169703:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721544704 00000100:00100000:1.0:1746126619.169705:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721544704 00002000:00100000:1.0:1746126619.169713:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008f1e0380 x1830945721544704/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.169719:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0380 with x1830945721544704 ext(3145728->4194303) 00002000:00010000:1.0:1746126619.169722:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e0380 00000100:00100000:1.0:1746126619.169733:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721545088 00000100:00100000:1.0:1746126619.169735:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721545088 00002000:00100000:1.0:1746126619.169744:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008f1e0a80 x1830945721545088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.169750:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0a80 with x1830945721545088 ext(2097152->3145727) 00002000:00010000:1.0:1746126619.169753:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e0a80 00000100:00100000:1.0:1746126619.169763:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7837 00000100:00100000:1.0:1746126619.169767:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721544576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.170151:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.170174:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7838 00000100:00100000:2.0:1746126619.170180:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721544704:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126619.170213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.171203:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721545216 00000100:00100000:1.0:1746126619.171209:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721545216 00000100:00100000:3.0:1746126619.171354:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.171387:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7839 00000100:00100000:2.0:1746126619.171393:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721545088:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:1.0:1746126619.175091:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f1e3100 x1830945721545216/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.175101:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3100 with x1830945721545216 ext(3145728->4194303) 00002000:00010000:1.0:1746126619.175106:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e3100 00000100:00100000:1.0:1746126619.175135:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7840 00000100:00100000:1.0:1746126619.175141:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721545216:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.182057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.182202:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721400832:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.182723:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721400960:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.182755:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aec6200/0xb50e825867614009 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0c2 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.182769:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aec6200/0xb50e825867614009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0c2 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.182785:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aec6200, rc 0) 00000100:00100000:3.0:1746126619.182854:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721544192:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13422us (13577us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.182862:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13722 00000100:00100000:1.0:1746126619.183196:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721544576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13427us (13909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.183205:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7837 00002000:00100000:1.0:1746126619.183213:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008f1e0e00 x1830945721544576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.183221:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0e00 with x1830945721544576 ext(2097152->3145727) 00002000:00010000:1.0:1746126619.183225:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e0e00 00000100:00100000:1.0:1746126619.183247:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721545600 00000100:00100000:1.0:1746126619.183253:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721545600 00000100:00100000:1.0:1746126619.183286:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8981 00000100:00100000:1.0:1746126619.183291:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+235:31370:x1830945721545600:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126619.183309:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.183324:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0d0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.183408:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.183422:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 11 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.183429:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.183457:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 11 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.183467:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 11 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.183477:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721401088:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.183531:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c29c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746126619.183593:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614002 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0c9 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.183603:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614002 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0c9 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.183614:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:2.0:1746126619.183633:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721544320:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 14254us (14432us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.183639:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13721 00000100:00100000:0.0:1746126619.192348:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721544704:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22155us (23033us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126619.192361:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7838 00002000:00100000:0.0:1746126619.192373:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008f1e0380 x1830945721544704/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.192383:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0380 with x1830945721544704 ext(3145728->4194303) 00002000:00010000:0.0:1746126619.192389:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e0380 00000100:00100000:3.0:1746126619.193565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.194886:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721401088:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.194911:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:2.0:1746126619.195219:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721545728 00000100:00100000:2.0:1746126619.195227:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721545728 00010000:00010000:2.0:1746126619.195259:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 12 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.195293:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7159 00000100:00100000:2.0:1746126619.195299:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1963:x1830945721545728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.195313:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.195319:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 12 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.195333:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 12 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.195353:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867613ffb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0bb expref: 12 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.195374:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126619.195378:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126619.195387:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126619.195393:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126619.195408:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.195454:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721545728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 155us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.195460:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7159 00010000:00010000:1.0:1746126619.195661:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.195667:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126619.195685:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126619.195818:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 238 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.195849:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 237 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.195855:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.195858:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126619.195860:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64a00, rc 0) 00000100:00100000:1.0:1746126619.195882:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+237:31370:x1830945721545600:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12591us (13849us total) trans 8589943169 rc 0/0 00000100:00100000:1.0:1746126619.195887:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8981 00000100:00100000:2.0:1746126619.197155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.197599:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721545088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26205us (28284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126619.197608:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7839 00002000:00100000:2.0:1746126619.197619:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008f1e0a80 x1830945721545088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.197627:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0a80 with x1830945721545088 ext(2097152->3145727) 00002000:00010000:2.0:1746126619.197633:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e0a80 00000100:00100000:1.0:1746126619.197706:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721545856 00000100:00100000:1.0:1746126619.197712:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721545856 00000100:00100000:1.0:1746126619.197740:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8982 00000100:00100000:1.0:1746126619.197747:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31368:x1830945721545856:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126619.197761:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.197777:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65c00/0xb50e825867614025 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0d7 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.197844:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65c00/0xb50e825867614025 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d7 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.197858:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65c00/0xb50e825867614025 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d7 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.197874:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.197877:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126619.197880:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65c00, rc 0) 00000100:00100000:1.0:1746126619.197898:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721545856:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 152us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.197904:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8982 00000100:00100000:1.0:1746126619.200764:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721545216:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25613us (30543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.200776:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7840 00002000:00100000:1.0:1746126619.200788:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f1e3100 x1830945721545216/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.200797:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3100 with x1830945721545216 ext(3145728->4194303) 00002000:00010000:1.0:1746126619.200803:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e3100 00000100:00100000:2.0:1746126619.203729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.203995:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721546112 00000100:00100000:0.0:1746126619.204006:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721546112 00000100:00100000:0.0:1746126619.204067:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8983 00000100:00100000:0.0:1746126619.204076:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721546112:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126619.204094:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126619.204117:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e82586761402c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0de expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.204210:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.204224:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 236 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.204230:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.204258:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 236 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.204269:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 236 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746126619.204280:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721401216:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126619.204366:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.211893:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721401216:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.211923:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126619.213610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.213786:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721546240 00000100:00100000:2.0:1746126619.213795:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721546240 00010000:00010000:2.0:1746126619.213861:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 237 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.213887:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7160 00000100:00100000:2.0:1746126619.213894:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+237:1963:x1830945721546240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.213907:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.213913:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 237 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.213923:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 237 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.213945:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614017 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d0 expref: 237 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.214278:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126619.214284:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.214375:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.214384:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.214909:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.216160:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:1963:x1830945721546240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2258us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.216170:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7160 00010000:00010000:0.0:1746126619.217477:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217488:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217512:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217518:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217719:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217726:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbaa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126619.217730:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217736:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217752:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126619.217755:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126619.217758:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.217763:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbaa00/0xb50e825867614033 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126619.218667:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e82586761402c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0de expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.218676:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb200/0xb50e82586761402c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0de expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.218684:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb200, rc 0) 00000100:00100000:0.0:1746126619.218746:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721546112:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 14671us (15025us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126619.218754:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8983 00000100:00100000:0.0:1746126619.234485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.234821:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721546752 00000100:00100000:1.0:1746126619.234845:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721546752 00000100:00100000:1.0:1746126619.234896:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3807 00000100:00100000:1.0:1746126619.234904:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31368:x1830945721546752:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1746126619.235130:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31368:x1830945721546752:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 226us (654us total) trans 8589943170 rc 0/0 00000100:00100000:1.0:1746126619.235136:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3807 00000100:00100000:0.0:1746126619.235252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.236115:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721546496 00000100:00100000:1.0:1746126619.236121:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721546496 00002000:00100000:1.0:1746126619.236153:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f1e1f80 x1830945721546496/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.236163:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1f80 with x1830945721546496 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.236169:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e1f80 00000100:00100000:1.0:1746126619.237071:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7841 00000100:00100000:1.0:1746126619.237082:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721546496:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.251273:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721546496:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14180us (16006us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126619.251286:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7841 00002000:00100000:1.0:1746126619.251299:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f1e1f80 x1830945721546496/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.251317:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1f80 with x1830945721546496 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.251323:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e1f80 00000100:00100000:0.0:1746126619.257974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.258096:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721547008 00000100:00100000:2.0:1746126619.258106:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721547008 00000100:00100000:2.0:1746126619.258168:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8984 00000100:00100000:2.0:1746126619.258177:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31372:x1830945721547008:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126619.258209:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.258229:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43a00/0xb50e82586761403a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0e5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.258333:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.258346:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.258356:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126619.258365:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126619.258479:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43a00/0xb50e82586761403a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.258501:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.258513:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126619.258516:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126619.258518:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43200, rc 0) 00000100:00100000:2.0:1746126619.258561:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31372:x1830945721547008:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 385us (598us total) trans 8589943171 rc 0/0 00000100:00100000:2.0:1746126619.258567:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8984 00000100:00100000:0.0:1746126619.262323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.262383:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721547136 00000100:00100000:2.0:1746126619.262393:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721547136 00000100:00100000:2.0:1746126619.262443:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13723 00000100:00100000:2.0:1746126619.262451:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:31370:x1830945721547136:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126619.262470:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.262487:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0ec expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.262514:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.262523:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.262530:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.262536:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.262538:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.262541:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2195456->2633727] (req 2195456->2633727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.262572:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.262584:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 17 pid: 8437 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746126619.262596:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401344:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.262701:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.262710:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 6 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746126619.262718:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401472:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.262745:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.262752:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.262759:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401600:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.262779:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.268437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.268547:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401344:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.268559:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401472:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.268567:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401600:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.268597:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2195456->2633727] (req 2195456->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.268614:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:2.0:1746126619.268653:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+19:31370:x1830945721547136:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6203us (6339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.268661:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13723 00000100:00100000:3.0:1746126619.268742:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721547264 00000100:00100000:3.0:1746126619.268749:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721547264 00010000:00010000:3.0:1746126619.268774:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 7 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.268806:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7161 00000100:00100000:3.0:1746126619.268812:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721547264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.268854:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.268876:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 7 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.268885:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 7 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.268907:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aec6c00/0xb50e825867613fd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0a6 expref: 7 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.268921:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.268938:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721547264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 127us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.268944:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7161 00000100:00100000:0.0:1746126619.277151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.277260:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721547392 00000100:00100000:1.0:1746126619.277270:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721547392 00010000:00010000:1.0:1746126619.277301:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 18 pid: 8437 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746126619.277339:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7162 00000100:00100000:1.0:1746126619.277345:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721547392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126619.277359:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.277382:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 18 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.277394:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 18 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.277418:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570f800/0xb50e825867613f76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e060 expref: 18 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.278281:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126619.278545:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721547392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1195us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.278553:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7162 00000100:00100000:0.0:1746126619.278879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.279195:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721547520 00000100:00100000:1.0:1746126619.279202:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721547520 00010000:00010000:1.0:1746126619.279223:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.279286:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7163 00000100:00100000:1.0:1746126619.279293:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721547520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126619.279304:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.279323:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.279333:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.279350:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921fcc00/0xb50e825867613f30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e01a expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.279359:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.279361:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.279367:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.279376:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.279406:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.279417:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721401728:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126619.280330:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.283060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.283133:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721401728:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126619.283154:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126619.283195:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721547520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3902us (4316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.283206:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7163 00000100:00100000:2.0:1746126619.283528:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721547776 00000100:00100000:2.0:1746126619.283534:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721547776 00002000:00100000:2.0:1746126619.283570:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2195456->2199551) req@ffff880093af4380 x1830945721547776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.283578:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4380 with x1830945721547776 ext(2195456->2199551) 00002000:00010000:2.0:1746126619.283582:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4380 00000100:00100000:2.0:1746126619.283606:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7842 00000100:00100000:2.0:1746126619.283611:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721547776:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126619.283759:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721547776:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 147us (716us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126619.283765:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7842 00002000:00100000:2.0:1746126619.283770:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2195456->2199551) req@ffff880093af4380 x1830945721547776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.283777:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4380 with x1830945721547776 ext(2195456->2199551) 00002000:00010000:2.0:1746126619.283780:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4380 00000100:00100000:0.0:1746126619.294794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.294880:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548032 00000100:00100000:3.0:1746126619.294892:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548032 00002000:00100000:3.0:1746126619.294945:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2629632->2633727) req@ffff880093af4e00 x1830945721548032/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.294956:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4e00 with x1830945721548032 ext(2629632->2633727) 00002000:00010000:3.0:1746126619.294962:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4e00 00000100:00100000:3.0:1746126619.295007:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7843 00000100:00100000:3.0:1746126619.295017:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721548032:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126619.295232:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721548032:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 214us (446us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126619.295239:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7843 00002000:00100000:3.0:1746126619.295245:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2629632->2633727) req@ffff880093af4e00 x1830945721548032/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.295252:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4e00 with x1830945721548032 ext(2629632->2633727) 00002000:00010000:3.0:1746126619.295255:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4e00 00000100:00100000:0.0:1746126619.303458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.303570:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548288 00000100:00100000:2.0:1746126619.303579:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548288 00000100:00100000:2.0:1746126619.303635:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3808 00000100:00100000:2.0:1746126619.303644:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+236:31370:x1830945721548288:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126619.303941:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+237:31370:x1830945721548288:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 297us (492us total) trans 8589943172 rc 0/0 00000100:00100000:2.0:1746126619.303947:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3808 00000100:00100000:2.0:1746126619.307575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.307614:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548416 00000100:00100000:0.0:1746126619.307622:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548416 00000100:00100000:0.0:1746126619.307672:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13724 00000100:00100000:0.0:1746126619.307679:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31372:x1830945721548416:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126619.307698:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126619.307714:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0f3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.307743:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.307751:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 5 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126619.307757:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126619.307759:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126619.307762:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1191936->1748991] (req 1191936->1748991) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126619.307909:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 5 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126619.307921:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 5 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:0.0:1746126619.307932:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401856:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.309114:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.309126:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.309136:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401984:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.309186:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.310333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.310561:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548544 00000100:00100000:1.0:1746126619.310568:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548544 00010000:00010000:1.0:1746126619.310597:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 6 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.310695:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401856:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.310976:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7164 00000100:00100000:2.0:1746126619.310986:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721548544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.311001:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.311647:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 6 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746126619.311659:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 6 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746126619.311680:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aec7800/0xb50e825867613fca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e09f expref: 6 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746126619.311710:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.311761:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1966:x1830945721548544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 777us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.311768:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7164 00000100:00100000:1.0:1746126619.311812:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721401984:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.311866:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1191936->1748991] (req 1191936->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.311877:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbb600, rc 0) 00000100:00100000:1.0:1746126619.311899:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31372:x1830945721548416:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4221us (4336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.311905:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13724 00000100:00100000:3.0:1746126619.312058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.312203:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548672 00000100:00100000:2.0:1746126619.312207:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548672 00010000:00010000:2.0:1746126619.312222:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.312244:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7165 00000100:00100000:2.0:1746126619.312250:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721548672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.312258:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.312270:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.312279:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.312290:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570fe00/0xb50e825867613f92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e07c expref: 18 pid: 4640 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.312299:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.312300:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.312306:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.312313:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.312338:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.312347:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721402112:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126619.312407:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.314780:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.314945:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548800 00000100:00100000:1.0:1746126619.314953:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548800 00000100:00100000:1.0:1746126619.315462:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13725 00000100:00100000:1.0:1746126619.315471:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721548800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126619.315489:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.315687:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64600/0xb50e82586761405d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e0fa expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.315747:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721402240:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126619.315863:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.316003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.316023:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721549056 00000100:00100000:3.0:1746126619.316028:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721549056 00000100:00100000:3.0:1746126619.316068:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13726 00000100:00100000:3.0:1746126619.316075:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721549056:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.316085:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.316094:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c889400/0xb50e825867614064 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e108 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.316118:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721402368:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126619.316134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.316169:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.316178:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721548928 00000100:00100000:2.0:1746126619.316182:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721548928 00000100:00100000:2.0:1746126619.316203:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13727 00000100:00100000:2.0:1746126619.316208:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721548928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.316216:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.316226:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e82586761406b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e101 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.316252:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721402496:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.316610:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721402112:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.316626:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.316643:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.316649:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721548672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4399us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.316658:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7165 00000100:00100000:0.0:1746126619.316773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.316819:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721549312 00000100:00100000:3.0:1746126619.316822:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721549312 00002000:00100000:3.0:1746126619.316865:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1191936->1196031) req@ffff880093af4a80 x1830945721549312/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.316874:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4a80 with x1830945721549312 ext(1191936->1196031) 00002000:00010000:3.0:1746126619.316878:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4a80 00000100:00100000:3.0:1746126619.316890:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7844 00000100:00100000:3.0:1746126619.316896:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721549312:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126619.317143:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721549312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 246us (368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126619.317153:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7844 00002000:00100000:3.0:1746126619.317159:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1191936->1196031) req@ffff880093af4a80 x1830945721549312/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.317171:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af4a80 with x1830945721549312 ext(1191936->1196031) 00002000:00010000:3.0:1746126619.317178:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af4a80 00002000:00010000:2.0:1746126619.317392:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126618 -> 1746126619 00002000:00010000:2.0:1746126619.317396:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126618 -> 1746126619 00000100:00100000:2.0:1746126619.317408:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721402240:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.317427:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64600/0xb50e82586761405d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0fa expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.317436:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64600/0xb50e82586761405d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0fa expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.317445:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64600, rc 0) 00000100:00100000:2.0:1746126619.317466:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721548800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1997us (2695us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.317472:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13725 00002000:00010000:3.0:1746126619.318060:0:4641:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126618 -> 1746126619 00002000:00010000:3.0:1746126619.318063:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126618 -> 1746126619 00000100:00100000:3.0:1746126619.318071:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721402368:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.318087:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c889400/0xb50e825867614064 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e108 expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.318097:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c889400/0xb50e825867614064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e108 expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.318123:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c889400, rc 0) 00000100:00100000:3.0:1746126619.318154:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721549056:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2080us (2151us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.318160:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13726 00002000:00010000:2.0:1746126619.319313:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126618 -> 1746126619 00002000:00010000:2.0:1746126619.319317:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126618 -> 1746126619 00000100:00100000:2.0:1746126619.319334:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721402496:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.319354:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e82586761406b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e101 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.319364:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e82586761406b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e101 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.319373:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527200, rc 0) 00000100:00100000:2.0:1746126619.319400:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721548928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3191us (3266us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.319406:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13727 00000100:00100000:0.0:1746126619.322262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.322462:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721549568 00000100:00100000:3.0:1746126619.322594:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721549568 00002000:00100000:3.0:1746126619.322639:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1744896->1748991) req@ffff880093af7480 x1830945721549568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.322649:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7480 with x1830945721549568 ext(1744896->1748991) 00002000:00010000:3.0:1746126619.322653:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af7480 00000100:00100000:3.0:1746126619.322739:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7845 00000100:00100000:3.0:1746126619.322748:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721549568:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126619.322956:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721549568:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 209us (703us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126619.322963:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7845 00002000:00100000:3.0:1746126619.322968:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1744896->1748991) req@ffff880093af7480 x1830945721549568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.322974:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7480 with x1830945721549568 ext(1744896->1748991) 00002000:00010000:3.0:1746126619.322977:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af7480 00000100:00100000:0.0:1746126619.323156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.323205:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721549696 00000100:00100000:3.0:1746126619.323209:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721549696 00000100:00100000:3.0:1746126619.323284:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13728 00000100:00100000:3.0:1746126619.323290:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:31378:x1830945721549696:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.323299:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.323316:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e10f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.323337:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 16 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.323344:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.323345:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.323349:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.323376:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 16 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.323388:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 16 pid: 4641 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.323404:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721402624:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.323792:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.326029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.326206:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721402624:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.326387:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.326403:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c889000, rc 0) 00000100:00100000:3.0:1746126619.326441:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:31378:x1830945721549696:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3150us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.326449:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13728 00000100:00100000:3.0:1746126619.326481:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721549824 00000100:00100000:3.0:1746126619.326486:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721549824 00002000:00100000:3.0:1746126619.326965:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (626688->1048575) req@ffff880092ad1c00 x1830945721549824/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.326974:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1c00 with x1830945721549824 ext(626688->1048575) 00010000:00010000:3.0:1746126619.326981:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 17 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.326993:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 17 pid: 4641 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.326999:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1c00 00000100:00100000:3.0:1746126619.327249:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1789 00000100:00100000:3.0:1746126619.327257:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721549824:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126619.336009:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721549824:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 8742us (9978us total) trans 21474840387 rc 0/0 00000100:00100000:3.0:1746126619.336021:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1789 00002000:00100000:3.0:1746126619.336033:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (626688->1048575) req@ffff880092ad1c00 x1830945721549824/t21474840387(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.336056:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1c00 with x1830945721549824 ext(626688->1048575) 00010000:00010000:3.0:1746126619.336067:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.336081:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.336087:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1c00 00000100:00100000:0.0:1746126619.338900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.338992:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721549952 00000100:00100000:3.0:1746126619.339002:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721549952 00010000:00010000:3.0:1746126619.339035:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.339080:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7166 00000100:00100000:3.0:1746126619.339087:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721549952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.339101:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.339124:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.339134:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.339184:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921fde00/0xb50e825867613f37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e021 expref: 19 pid: 4641 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.339202:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.339204:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.339211:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.339219:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.339248:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.339258:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721402752:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126619.339747:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.342521:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721402752:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.342544:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.342765:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721549952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3676us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.342777:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7166 00000100:00100000:0.0:1746126619.344114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.344336:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721550208 00000100:00100000:3.0:1746126619.344344:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721550208 00002000:00100000:3.0:1746126619.344485:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092ad0000 x1830945721550208/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.344500:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0000 with x1830945721550208 ext(0->1048575) 00002000:00010000:3.0:1746126619.344505:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad0000 00000100:00100000:3.0:1746126619.344536:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7846 00000100:00100000:3.0:1746126619.344543:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721550208:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126619.353885:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721550208:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9331us (9771us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.353897:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7846 00002000:00100000:3.0:1746126619.353908:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880092ad0000 x1830945721550208/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.353917:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0000 with x1830945721550208 ext(0->1048575) 00002000:00010000:3.0:1746126619.353923:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad0000 00000100:00100000:0.0:1746126619.362069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.362222:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721550336 00000100:00100000:3.0:1746126619.362232:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721550336 00000100:00100000:3.0:1746126619.362284:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13729 00000100:00100000:3.0:1746126619.362292:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:31378:x1830945721550336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.362316:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.362335:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e116 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.362363:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.362370:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.362372:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.362376:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.362407:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.362418:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 11 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.362430:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721402880:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.362858:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.365196:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721402880:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.365229:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.365331:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dc5000, rc 0) 00000100:00100000:3.0:1746126619.365384:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:31378:x1830945721550336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3092us (3322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.365393:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13729 00000100:00100000:0.0:1746126619.365607:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.365647:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721550464 00000100:00100000:3.0:1746126619.365654:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721550464 00002000:00100000:3.0:1746126619.365696:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1384447) req@ffff880092ad0a80 x1830945721550464/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.365704:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0a80 with x1830945721550464 ext(1048576->1384447) 00010000:00010000:3.0:1746126619.365710:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 12 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.365727:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 12 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.365733:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad0a80 00000100:00100000:3.0:1746126619.366314:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1790 00000100:00100000:3.0:1746126619.366323:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721550464:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126619.372066:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721550464:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 5722us (6437us total) trans 17179873237 rc 0/0 00000100:00100000:3.0:1746126619.372079:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1790 00002000:00100000:3.0:1746126619.372091:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1384447) req@ffff880092ad0a80 x1830945721550464/t17179873237(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.372100:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0a80 with x1830945721550464 ext(1048576->1384447) 00010000:00010000:3.0:1746126619.372111:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 14 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.372127:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 14 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.372134:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad0a80 00000100:00100000:0.0:1746126619.374951:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.375102:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721550592 00000100:00100000:3.0:1746126619.375110:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721550592 00010000:00010000:3.0:1746126619.375146:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 14 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.375517:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7167 00000100:00100000:3.0:1746126619.375525:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721550592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.375539:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.375561:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 14 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.375572:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 14 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.375594:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b091800/0xb50e825867613f45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e02f expref: 14 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.375626:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.375628:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.375635:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.375643:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.375674:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.375686:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721403008:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126619.375767:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.379235:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721403008:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.379257:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.379305:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721550592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3779us (4361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.379316:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7167 00000100:00100000:0.0:1746126619.380151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.380289:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721550848 00000100:00100000:3.0:1746126619.380295:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721550848 00002000:00100000:3.0:1746126619.380329:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092ad3100 x1830945721550848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.380339:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3100 with x1830945721550848 ext(1048576->2097151) 00002000:00010000:3.0:1746126619.380343:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad3100 00000100:00100000:3.0:1746126619.380415:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7847 00000100:00100000:3.0:1746126619.380422:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721550848:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126619.398777:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721550848:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18343us (18615us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.398790:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7847 00002000:00100000:3.0:1746126619.398803:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092ad3100 x1830945721550848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.398812:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3100 with x1830945721550848 ext(1048576->2097151) 00002000:00010000:3.0:1746126619.398818:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad3100 00000100:00100000:0.0:1746126619.405696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.405823:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721550976 00000100:00100000:3.0:1746126619.405849:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721550976 00000100:00100000:3.0:1746126619.405898:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13730 00000100:00100000:3.0:1746126619.405906:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:31378:x1830945721550976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.405925:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.405944:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e11d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.405972:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.405978:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.405980:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.405984:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.406011:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.406023:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 17 pid: 8437 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.406035:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403136:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.406123:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.411379:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403136:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.411411:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.411429:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5aa6800, rc 0) 00000100:00100000:3.0:1746126619.411487:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:31378:x1830945721550976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5580us (5798us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.411496:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13730 00000100:00100000:0.0:1746126619.412452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.412919:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721551104 00000100:00100000:3.0:1746126619.412927:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721551104 00002000:00100000:3.0:1746126619.412978:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1191936->1748991) req@ffff880092ad1180 x1830945721551104/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.412988:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1180 with x1830945721551104 ext(1191936->1748991) 00010000:00010000:3.0:1746126619.412996:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 18 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.413008:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 18 pid: 8437 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.413014:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1180 00000100:00100000:3.0:1746126619.414053:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1791 00000100:00100000:3.0:1746126619.414063:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721551104:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126619.430640:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721551104:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 16567us (18178us total) trans 21474840388 rc 0/0 00000100:00100000:3.0:1746126619.430653:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1791 00002000:00100000:3.0:1746126619.433127:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1191936->1748991) req@ffff880092ad1180 x1830945721551104/t21474840388(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.433142:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1180 with x1830945721551104 ext(1191936->1748991) 00010000:00010000:3.0:1746126619.433156:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 20 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.433177:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 20 pid: 8437 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.433190:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1180 00000100:00100000:0.0:1746126619.442487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.442530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.446637:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721551488 00000100:00100000:3.0:1746126619.446640:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721551232 00000100:00100000:3.0:1746126619.446650:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721551232 00000100:00100000:1.0:1746126619.446650:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721551488 00010000:00010000:3.0:1746126619.446693:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 20 pid: 8437 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.446724:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8985 00000100:00100000:3.0:1746126619.446728:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7168 00000100:00100000:1.0:1746126619.446732:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+237:31381:x1830945721551488:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:3.0:1746126619.446733:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721551232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.446746:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.446755:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.446767:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 20 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.446773:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e124 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.446778:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 20 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.446798:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbb600/0xb50e825867614056 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1748991) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0f3 expref: 20 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.446815:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.446817:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.446823:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.446858:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.446890:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126619.446893:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.446903:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721403264:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126619.446903:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126619.446912:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126619.446922:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:3.0:1746126619.446990:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746126619.447035:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 240 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.447068:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 239 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.447075:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126619.447078:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126619.447080:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64800, rc 0) 00000100:00100000:1.0:1746126619.447107:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+239:31381:x1830945721551488:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 376us (4628us total) trans 8589943173 rc 0/0 00000100:00100000:1.0:1746126619.447117:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8985 00000100:00100000:0.0:1746126619.455721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.455875:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721551744 00000100:00100000:3.0:1746126619.455882:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721551744 00000100:00100000:2.0:1746126619.455883:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721403264:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126619.455904:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746126619.455927:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880092ad0380 x1830945721551744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.455936:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0380 with x1830945721551744 ext(1048576->2097151) 00002000:00010000:3.0:1746126619.455941:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad0380 00000100:00100000:2.0:1746126619.455959:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721551232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9223us (13425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.455962:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7848 00000100:00100000:3.0:1746126619.455968:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721551744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.455968:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7168 00000100:00100000:3.0:1746126619.475380:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721551744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19399us (19656us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.475392:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7848 00002000:00100000:3.0:1746126619.475404:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880092ad0380 x1830945721551744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.475413:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0380 with x1830945721551744 ext(1048576->2097151) 00002000:00010000:3.0:1746126619.475419:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad0380 00000100:00100000:0.0:1746126619.499960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.499994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.500015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.500060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.500087:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721551872 00000100:00100000:2.0:1746126619.500097:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721551872 00000100:00100000:2.0:1746126619.500137:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721552000 00000100:00100000:2.0:1746126619.500139:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721552000 00000100:00100000:2.0:1746126619.500150:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721552128 00000100:00100000:2.0:1746126619.500152:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721552128 00000100:00100000:2.0:1746126619.500166:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721552256 00000100:00100000:2.0:1746126619.500167:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721552256 00000100:00100000:2.0:1746126619.500180:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13731 00000100:00100000:2.0:1746126619.500244:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721551872:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.500263:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.500281:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e12b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.500302:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.500304:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.500312:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126619.500319:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13732 00010000:00010000:2.0:1746126619.500326:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126619.500327:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721552000:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.500337:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526a00, rc 0) 00010000:00010000:3.0:1746126619.500338:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.500354:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e132 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.500366:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.500367:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.500371:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126619.500377:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721551872:12345-192.168.203.2@tcp:101:cat.0 Request processed in 191us (428us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126619.500381:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126619.500383:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13731 00010000:00010000:3.0:1746126619.500388:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5aa6600, rc 0) 00000100:00100000:2.0:1746126619.500398:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13733 00000100:00100000:2.0:1746126619.500401:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721552128:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.500406:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126619.500407:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721552000:12345-192.168.203.2@tcp:101:cat.0 Request processed in 81us (412us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126619.500411:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e139 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.500412:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13732 00010000:00010000:2.0:1746126619.500419:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.500420:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746126619.500423:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13734 00010000:00010000:2.0:1746126619.500423:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126619.500428:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721552256:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.500431:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.500434:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.500441:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526400, rc 0) 00000100:00100000:2.0:1746126619.500452:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721552128:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (437us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126619.500453:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e580000/0xb50e8258676140b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e140 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.500456:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13733 00000100:00100000:3.0:1746126619.500489:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403392:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.500542:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.507897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.507942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.508014:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721552512 00000100:00100000:3.0:1746126619.508017:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721552640 00000100:00100000:3.0:1746126619.508023:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721552640 00000100:00100000:2.0:1746126619.508023:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721552512 00002000:00100000:3.0:1746126619.508084:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3584000->4194303) req@ffff880135bcfb80 x1830945721552640/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.508094:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcfb80 with x1830945721552640 ext(3584000->4194303) 00002000:00010000:3.0:1746126619.508100:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcfb80 00000100:00100000:3.0:1746126619.508121:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7849 00000100:00100000:3.0:1746126619.508129:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721552640:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:2.0:1746126619.509562:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3583999) req@ffff880135bcc380 x1830945721552512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 504/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.509572:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc380 with x1830945721552512 ext(2097152->3583999) 00002000:00010000:2.0:1746126619.509576:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcc380 00000100:00100000:2.0:1746126619.509601:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7850 00000100:00100000:2.0:1746126619.509608:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721552512:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:3.0:1746126619.511590:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime: 1746126618 -> 1746126619 00002000:00010000:3.0:1746126619.511596:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126618 -> 1746126619 00002000:00010000:3.0:1746126619.511598:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime: 1746126618 -> 1746126619 00000100:00100000:3.0:1746126619.511613:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403392:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.511643:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e580000/0xb50e8258676140b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e140 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.511656:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e580000/0xb50e8258676140b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e140 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.511672:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580000, rc 0) 00000100:00100000:3.0:1746126619.511721:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721552256:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11291us (11659us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.511730:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13734 00000100:00100000:3.0:1746126619.520426:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721552640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12286us (12471us total) trans 0 rc 610304/610304 00000100:00100000:3.0:1746126619.520439:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7849 00002000:00100000:3.0:1746126619.520451:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3584000->4194303) req@ffff880135bcfb80 x1830945721552640/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 610304/610304 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.520467:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcfb80 with x1830945721552640 ext(3584000->4194303) 00002000:00010000:3.0:1746126619.520473:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcfb80 00000100:00100000:0.0:1746126619.537523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.538087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.538107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.538131:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721553024 00000100:00100000:0.0:1746126619.538139:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721553024 00002000:00100000:0.0:1746126619.538182:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880135bce300 x1830945721553024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.538191:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bce300 with x1830945721553024 ext(0->1048575) 00002000:00010000:0.0:1746126619.538196:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bce300 00000100:00100000:0.0:1746126619.538213:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721553280 00000100:00100000:0.0:1746126619.538215:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721553280 00002000:00100000:0.0:1746126619.538227:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880135bcc700 x1830945721553280/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.538233:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc700 with x1830945721553280 ext(1048576->2097151) 00002000:00010000:0.0:1746126619.538236:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcc700 00000100:00100000:0.0:1746126619.538244:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721553536 00000100:00100000:0.0:1746126619.538246:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721553536 00002000:00100000:0.0:1746126619.538255:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880135bcf100 x1830945721553536/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.538260:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf100 with x1830945721553536 ext(1048576->2097151) 00002000:00010000:0.0:1746126619.538263:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcf100 00000100:00100000:0.0:1746126619.538291:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7851 00000100:00100000:0.0:1746126619.538298:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721553024:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.538638:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7852 00000100:00100000:1.0:1746126619.538647:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721553280:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.539515:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7853 00000100:00100000:2.0:1746126619.539525:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721553536:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126619.540316:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721552512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30706us (32426us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.540324:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7850 00002000:00100000:3.0:1746126619.540330:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3583999) req@ffff880135bcc380 x1830945721552512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 504/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.540338:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc380 with x1830945721552512 ext(2097152->3583999) 00002000:00010000:3.0:1746126619.540343:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcc380 00000100:00100000:0.0:1746126619.564318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.568793:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721553664 00000100:00100000:3.0:1746126619.568810:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721553664 00000100:00100000:3.0:1746126619.568898:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13735 00000100:00100000:3.0:1746126619.568907:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31383:x1830945721553664:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126619.568926:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.568945:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e147 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.568973:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.568981:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.568988:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.568990:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.568994:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1105920->1708031] (req 1105920->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.569023:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.569034:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 26 pid: 8437 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.569057:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403520:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.569159:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.569167:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 19 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.569176:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403648:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.569195:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.571802:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721553024:12345-192.168.203.2@tcp:3:cat.0 Request processed in 33492us (34278us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.571815:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7851 00002000:00100000:1.0:1746126619.571844:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880135bce300 x1830945721553024/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.571854:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bce300 with x1830945721553024 ext(0->1048575) 00002000:00010000:1.0:1746126619.571859:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bce300 00000100:00100000:2.0:1746126619.577872:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721553536:12345-192.168.203.2@tcp:3:cat.0 Request processed in 38337us (39751us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126619.577884:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7853 00002000:00100000:2.0:1746126619.577897:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880135bcf100 x1830945721553536/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.577906:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf100 with x1830945721553536 ext(1048576->2097151) 00010000:00010000:2.0:1746126619.577916:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 23 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746126619.577933:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 23 pid: 8437 timeout: 841 lvb_type: 1 00002000:00010000:2.0:1746126619.577940:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135bcf100 00000100:00100000:0.0:1746126619.588920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.588998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.589115:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403520:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.589126:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403648:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.589155:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1105920->1708031] (req 1105920->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.589172:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580400, rc 0) 00000100:00100000:3.0:1746126619.589233:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31383:x1830945721553664:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 20327us (24924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.589243:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13735 00000100:00100000:3.0:1746126619.589292:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721554048 00000100:00100000:3.0:1746126619.589297:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721554048 00010000:00010000:3.0:1746126619.589320:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 20 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.589339:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7169 00000100:00100000:3.0:1746126619.589345:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721554048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.589357:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.589379:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 20 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.589389:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 20 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.589412:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5aa6800/0xb50e825867614080 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e11d expref: 20 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.589441:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.589460:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721554048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.589465:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7169 00000100:00100000:1.0:1746126619.589859:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721553280:12345-192.168.203.2@tcp:3:cat.0 Request processed in 51212us (51770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.589868:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7852 00002000:00100000:1.0:1746126619.589877:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880135bcc700 x1830945721553280/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.589885:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc700 with x1830945721553280 ext(1048576->2097151) 00002000:00010000:1.0:1746126619.589889:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcc700 00000100:00100000:1.0:1746126619.589903:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721553920 00000100:00100000:1.0:1746126619.589906:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721553920 00002000:00100000:1.0:1746126619.590605:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880135bcca80 x1830945721553920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.590614:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcca80 with x1830945721553920 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.590618:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcca80 00000100:00100000:1.0:1746126619.590643:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7854 00000100:00100000:1.0:1746126619.590652:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721553920:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126619.596681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.599585:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721554176 00000100:00100000:3.0:1746126619.599599:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721554176 00010000:00010000:3.0:1746126619.599638:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 22 pid: 8437 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.599687:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7170 00000100:00100000:3.0:1746126619.599695:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721554176:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.599710:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.599732:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 22 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.599743:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 22 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.599767:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135526400/0xb50e8258676140aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e139 expref: 22 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.599794:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.599796:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.599803:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.599811:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.599863:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.599875:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721403776:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126619.599959:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.601568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.602423:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721554304 00000100:00100000:3.0:1746126619.602431:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721554304 00000100:00100000:3.0:1746126619.602475:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13736 00000100:00100000:3.0:1746126619.602482:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31386:x1830945721554304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.602498:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.602515:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e14e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.602539:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.602546:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.602547:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.602550:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.602575:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.602584:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.602594:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403904:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.602657:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.602931:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721403776:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126619.602945:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.602980:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721554176:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3286us (6310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.602988:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7170 00000100:00100000:1.0:1746126619.603118:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721553920:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12468us (14207us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126619.603126:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7854 00002000:00100000:1.0:1746126619.603134:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880135bcca80 x1830945721553920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.603143:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcca80 with x1830945721553920 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.603147:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcca80 00000100:00100000:0.0:1746126619.603147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.603290:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721554560 00000100:00100000:1.0:1746126619.603294:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721554560 00002000:00100000:1.0:1746126619.603313:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1105920->1110015) req@ffff880135bcf480 x1830945721554560/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.603319:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf480 with x1830945721554560 ext(1105920->1110015) 00010000:00010000:1.0:1746126619.603324:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.603334:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746126619.603340:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135bcf480 00000100:00100000:1.0:1746126619.603359:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1792 00000100:00100000:1.0:1746126619.603365:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721554560:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126619.603484:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721554560:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 119us (336us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126619.603491:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1792 00002000:00100000:1.0:1746126619.603495:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1105920->1110015) req@ffff880135bcf480 x1830945721554560/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.603502:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcf480 with x1830945721554560 ext(1105920->1110015) 00010000:00010000:1.0:1746126619.603506:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.603513:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 23 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746126619.603519:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135bcf480 00000100:00100000:3.0:1746126619.605246:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721403904:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.605271:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.605290:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580a00, rc 0) 00000100:00100000:3.0:1746126619.605331:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31386:x1830945721554304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2849us (3770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.605338:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13736 00000100:00100000:0.0:1746126619.607154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.608713:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721554688 00000100:00100000:3.0:1746126619.608725:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721554688 00000100:00100000:3.0:1746126619.608792:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13737 00000100:00100000:3.0:1746126619.608802:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721554688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.608821:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.608873:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e581000/0xb50e8258676140c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e155 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.608928:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721404032:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.609579:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00002000:00010000:3.0:1746126619.610538:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126618 -> 1746126619 00000100:00100000:3.0:1746126619.610592:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721404032:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.610618:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e581000/0xb50e8258676140c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e155 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.610630:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e581000/0xb50e8258676140c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e155 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126619.612320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126619.612400:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581000, rc 0) 00000100:00100000:2.0:1746126619.612663:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721554944 00000100:00100000:2.0:1746126619.612672:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721554944 00002000:00100000:2.0:1746126619.612714:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1703936->1708031) req@ffff880135bcc000 x1830945721554944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.612724:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc000 with x1830945721554944 ext(1703936->1708031) 00010000:00010000:2.0:1746126619.612732:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.612743:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746126619.612749:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135bcc000 00000100:00100000:2.0:1746126619.612768:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1793 00000100:00100000:2.0:1746126619.612775:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721554944:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126619.613194:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721554688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4393us (6047us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.613202:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13737 00000100:00100000:2.0:1746126619.613308:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721554944:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 532us (994us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126619.613315:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1793 00002000:00100000:2.0:1746126619.613320:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1703936->1708031) req@ffff880135bcc000 x1830945721554944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.613326:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcc000 with x1830945721554944 ext(1703936->1708031) 00010000:00010000:2.0:1746126619.613330:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.613339:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746126619.613344:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135bcc000 00000100:00100000:0.0:1746126619.617949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.618005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.618363:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721555328 00000100:00100000:3.0:1746126619.618374:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721555328 00000100:00100000:2.0:1746126619.618376:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721555200 00000100:00100000:2.0:1746126619.618381:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721555200 00002000:00100000:2.0:1746126619.618420:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1105920->1708031) req@ffff8800937b9c00 x1830945721555200/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746126619.618426:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13738 00002000:00100000:2.0:1746126619.618429:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9c00 with x1830945721555200 ext(1105920->1708031) 00000100:00100000:3.0:1746126619.618434:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721555328:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.618437:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.618448:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.618450:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746126619.618456:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937b9c00 00010000:00010000:3.0:1746126619.618463:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e8258676140cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e15c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.618479:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1794 00000100:00100000:2.0:1746126619.618485:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721555200:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126619.618511:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721404160:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.618585:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.623287:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721404160:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.623322:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e8258676140cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e15c expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.623336:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e8258676140cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e15c expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.623350:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581200, rc 0) 00000100:00100000:3.0:1746126619.623584:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721555328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5148us (5575us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.623593:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13738 00000100:00100000:2.0:1746126619.630718:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721555200:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 12221us (12769us total) trans 21474840389 rc 0/0 00000100:00100000:2.0:1746126619.630731:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1794 00002000:00100000:2.0:1746126619.630744:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1105920->1708031) req@ffff8800937b9c00 x1830945721555200/t21474840389(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.630753:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9c00 with x1830945721555200 ext(1105920->1708031) 00010000:00010000:2.0:1746126619.630763:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 24 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.630779:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 24 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746126619.630786:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937b9c00 00000100:00100000:0.0:1746126619.644066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.645176:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721555456 00000100:00100000:2.0:1746126619.645188:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721555456 00010000:00010000:2.0:1746126619.645228:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 24 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.645795:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7171 00000100:00100000:2.0:1746126619.645804:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721555456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.645819:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.645870:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 24 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.645883:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 24 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.645906:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e580400/0xb50e8258676140b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1708031) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e147 expref: 24 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.649366:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.649372:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.649392:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.649403:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.649565:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.649586:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721404288:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126619.649691:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.652539:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721404288:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.652558:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.652604:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721555456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6801us (8547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.652615:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7171 00000100:00100000:0.0:1746126619.657888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.657996:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721555840 00000100:00100000:2.0:1746126619.658006:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721555840 00002000:00100000:2.0:1746126619.658062:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800937baa00 x1830945721555840/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.658072:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937baa00 with x1830945721555840 ext(1048576->2097151) 00002000:00010000:2.0:1746126619.658077:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937baa00 00000100:00100000:2.0:1746126619.658102:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7855 00000100:00100000:2.0:1746126619.658108:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721555840:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126619.676757:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721555840:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 18636us (18866us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126619.676769:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7855 00002000:00100000:2.0:1746126619.676779:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800937baa00 x1830945721555840/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.676794:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937baa00 with x1830945721555840 ext(1048576->2097151) 00002000:00010000:2.0:1746126619.676800:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937baa00 00000100:00100000:0.0:1746126619.682606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.682785:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721555968 00000100:00100000:3.0:1746126619.682795:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721555968 00000100:00100000:3.0:1746126619.682869:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13739 00000100:00100000:3.0:1746126619.682877:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31386:x1830945721555968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.682897:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.682915:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e163 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.682946:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.682953:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.682955:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126619.682958:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.682989:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.683285:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 18 pid: 8437 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.683297:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721404416:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.683405:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.689533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.689621:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721556096 00000100:00100000:0.0:1746126619.689630:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721556096 00000100:00100000:3.0:1746126619.689661:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721404416:192.168.203.2@tcp:104: 00002000:00100000:0.0:1746126619.689681:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2195456->2633727) req@ffff8800920bc380 x1830945721556096/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746126619.689689:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746126619.689690:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bc380 with x1830945721556096 ext(2195456->2633727) 00010000:00010000:0.0:1746126619.689696:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 19 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.689706:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581600, rc 0) 00010000:00010000:0.0:1746126619.689709:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 19 pid: 8437 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746126619.689716:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920bc380 00000100:00100000:3.0:1746126619.689752:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31386:x1830945721555968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6876us (7170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.689760:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13739 00000100:00100000:1.0:1746126619.690017:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1795 00000100:00100000:1.0:1746126619.690026:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721556096:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126619.698409:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721556096:12345-192.168.203.2@tcp:4:cat.0 Request processed in 8373us (8874us total) trans 21474840390 rc 0/0 00000100:00100000:1.0:1746126619.698421:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1795 00002000:00100000:1.0:1746126619.698433:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2195456->2633727) req@ffff8800920bc380 x1830945721556096/t21474840390(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.698442:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bc380 with x1830945721556096 ext(2195456->2633727) 00010000:00010000:1.0:1746126619.698452:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 21 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.698468:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 21 pid: 8437 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746126619.698479:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920bc380 00000100:00100000:0.0:1746126619.708178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.710347:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721556224 00000100:00100000:3.0:1746126619.710360:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721556224 00000100:00100000:3.0:1746126619.711115:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13740 00000100:00100000:3.0:1746126619.711126:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:31381:x1830945721556224:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126619.711146:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.711164:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e16a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.711195:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.711208:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.711214:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.711216:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.711219:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1515520->2097151] (req 1515520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.711248:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.711259:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 13 pid: 8436 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.711270:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721404544:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.716934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.716974:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721556352 00000100:00100000:2.0:1746126619.716983:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721556352 00010000:00010000:2.0:1746126619.717020:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 21 pid: 8437 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.717063:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7172 00000100:00100000:2.0:1746126619.717071:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721556352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.717084:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.717110:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 21 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.717122:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 21 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.717146:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570e400/0xb50e82586761404f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2633727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ec expref: 21 pid: 8437 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.717165:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.717167:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.717175:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.717188:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.717222:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.717234:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721404672:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.719684:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.719702:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 27 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.719717:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721404800:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.719773:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.720093:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.726655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.726690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.726783:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721556480 00000100:00100000:1.0:1746126619.726792:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721556480 00000100:00100000:2.0:1746126619.726803:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721556608 00000100:00100000:2.0:1746126619.726808:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721556608 00010000:00010000:2.0:1746126619.726846:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746126619.726847:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 14 pid: 8436 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746126619.726882:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7173 00000100:00100000:1.0:1746126619.726889:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721556480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126619.726902:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.726926:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 14 pid: 8436 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.726938:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 14 pid: 8436 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.726963:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.727027:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7174 00000100:00100000:2.0:1746126619.727034:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721556608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.727054:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.727067:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.727080:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.727096:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.727098:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.727108:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.727116:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.727153:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.727154:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721556480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 264us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126619.727160:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7173 00000100:00100000:2.0:1746126619.727165:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721404928:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126619.727216:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.727252:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721404672:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126619.727266:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126619.727335:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5aa6600/0xb50e8258676140a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e132 expref: 13 pid: 8436 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.727358:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721404544:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.727367:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092dc5000/0xb50e825867614079 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e116 expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.727374:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721404800:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.727391:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.727399:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581a00, rc 0) 00000100:00100000:2.0:1746126619.727413:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721556352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10343us (10491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.727420:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7172 00000100:00100000:3.0:1746126619.727421:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:31381:x1830945721556224:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 16299us (19253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.727427:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13740 00000100:00100000:0.0:1746126619.729917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.729947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.730027:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721556864 00000100:00100000:3.0:1746126619.730036:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721556864 00000100:00100000:1.0:1746126619.730066:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721557120 00000100:00100000:1.0:1746126619.730070:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721557120 00002000:00100000:3.0:1746126619.730095:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800937b8e00 x1830945721556864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.730095:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800937b9880 x1830945721557120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.730104:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8e00 with x1830945721556864 ext(2097152->3145727) 00002000:00100000:1.0:1746126619.730104:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9880 with x1830945721557120 ext(3145728->4194303) 00002000:00010000:3.0:1746126619.730109:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b8e00 00002000:00010000:1.0:1746126619.730109:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9880 00000100:00100000:3.0:1746126619.730127:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7856 00000100:00100000:3.0:1746126619.730134:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721556864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.730192:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721404928:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126619.730207:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7857 00010000:00010000:2.0:1746126619.730212:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126619.730213:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721557120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126619.730253:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721556608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3219us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.730261:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7174 00000100:00100000:2.0:1746126619.732099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.733124:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721557376 00000100:00100000:0.0:1746126619.733136:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721557376 00002000:00100000:2.0:1746126619.734057:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1515520->1519615) req@ffff8800920bf800 x1830945721557376/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.734068:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bf800 with x1830945721557376 ext(1515520->1519615) 00002000:00010000:2.0:1746126619.734074:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bf800 00000100:00100000:2.0:1746126619.734098:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7858 00000100:00100000:2.0:1746126619.734105:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721557376:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126619.734258:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721557376:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 154us (2168us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126619.734264:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7858 00002000:00100000:2.0:1746126619.734270:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1515520->1519615) req@ffff8800920bf800 x1830945721557376/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.734276:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bf800 with x1830945721557376 ext(1515520->1519615) 00002000:00010000:2.0:1746126619.734279:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bf800 00000100:00100000:3.0:1746126619.746019:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721556864:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15874us (16099us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.746032:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7856 00002000:00100000:3.0:1746126619.746054:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800937b8e00 x1830945721556864/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.746063:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8e00 with x1830945721556864 ext(2097152->3145727) 00002000:00010000:3.0:1746126619.746069:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b8e00 00000100:00100000:1.0:1746126619.750378:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721557120:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20155us (20419us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.750388:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7857 00002000:00100000:1.0:1746126619.750398:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800937b9880 x1830945721557120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.750407:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9880 with x1830945721557120 ext(3145728->4194303) 00002000:00010000:1.0:1746126619.750413:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9880 00000100:00100000:0.0:1746126619.758999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.759125:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721557504 00000100:00100000:3.0:1746126619.759134:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721557504 00000100:00100000:3.0:1746126619.759480:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13741 00000100:00100000:3.0:1746126619.759489:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:31381:x1830945721557504:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126619.759510:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.759528:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e171 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.759558:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 12 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.759566:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.759573:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.759579:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.759581:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.759584:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1048576->1441791] (req 1048576->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.759809:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.759823:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.759865:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721405056:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.760182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.760633:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721557632 00000100:00100000:0.0:1746126619.760638:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721557632 00000100:00100000:0.0:1746126619.760696:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13742 00000100:00100000:0.0:1746126619.760702:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721557632:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126619.760711:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126619.760719:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef64600/0xb50e8258676140e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e178 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126619.760748:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721405184:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.760854:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.760862:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 7 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.760869:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721405312:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.761077:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 14 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.761086:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 14 pid: 20294 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.761094:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721405440:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126619.761175:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.761193:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.765330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.765367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.765435:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721557760 00000100:00100000:0.0:1746126619.765443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.765444:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721557760 00000100:00100000:0.0:1746126619.765462:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721558272 00000100:00100000:0.0:1746126619.765465:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721558272 00010000:00010000:2.0:1746126619.765478:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 8 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:0.0:1746126619.765478:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 15 pid: 20294 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746126619.765539:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721557888 00000100:00100000:1.0:1746126619.765543:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721557888 00000100:00100000:1.0:1746126619.765567:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13743 00000100:00100000:1.0:1746126619.765574:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721557888:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126619.765589:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.765605:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c2ea00/0xb50e8258676140f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e17f expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.765625:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.765641:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c2ea00/0xb50e8258676140f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e17f expref: 29 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.765650:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c2ea00/0xb50e8258676140f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e17f expref: 29 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.765664:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2ea00, rc 0) 00000100:00100000:1.0:1746126619.765714:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721557888:12345-192.168.203.2@tcp:101:cat.0 Request processed in 139us (345us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126619.765720:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13743 00002000:00010000:1.0:1746126619.765778:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126618 -> 1746126619 00000100:00100000:1.0:1746126619.765797:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721405184:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126619.765821:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef64600/0xb50e8258676140e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e178 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.765859:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef64600/0xb50e8258676140e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e178 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.765866:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64600, rc 0) 00000100:00100000:1.0:1746126619.765884:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721557632:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5182us (5789us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126619.765888:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13742 00000100:00100000:0.0:1746126619.766054:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7175 00000100:00100000:0.0:1746126619.766060:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721558272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126619.766072:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126619.766083:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 13 pid: 20294 timeout: 841 lvb_type: 1 00010000:00010000:0.0:1746126619.766092:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 13 pid: 20294 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746126619.766108:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7176 00010000:00010000:0.0:1746126619.766110:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.766115:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721557760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.766122:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126619.766128:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721558272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (685us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126619.766130:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 8 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:0.0:1746126619.766133:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7175 00010000:00010000:2.0:1746126619.766138:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 8 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746126619.766149:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.766164:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721557760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 50us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.766173:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7176 00000100:00100000:3.0:1746126619.766256:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721405056:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.766266:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f130000/0xb50e825867613fc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e098 expref: 7 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.766287:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721405312:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.766298:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e23fe00/0xb50e825867613da1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4defb expref: 12 pid: 20294 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.766305:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721405440:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126619.766323:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->1441791] (req 1048576->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.766330:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580400, rc 0) 00000100:00100000:3.0:1746126619.766352:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:31381:x1830945721557504:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6865us (7364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.766357:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13741 00000100:00100000:2.0:1746126619.768326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.768367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.768406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.768470:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721558016 00000100:00100000:3.0:1746126619.768478:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721558016 00000100:00100000:3.0:1746126619.768510:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721558400 00000100:00100000:3.0:1746126619.768511:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721558400 00000100:00100000:3.0:1746126619.768525:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13744 00000100:00100000:3.0:1746126619.768530:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721558016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.768548:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.768564:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e186 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.768586:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.768588:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.768596:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.768610:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.768618:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580200, rc 0) 00000100:00100000:3.0:1746126619.768651:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721558016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 120us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.768656:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13744 00000100:00100000:3.0:1746126619.768667:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13745 00000100:00100000:3.0:1746126619.768671:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721558400:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.768676:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.768682:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e18d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.768691:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.768692:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.768695:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.768702:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.768708:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580800, rc 0) 00000100:00100000:3.0:1746126619.768719:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721558400:12345-192.168.203.2@tcp:101:cat.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.768723:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13745 00000100:00100000:1.0:1746126619.768855:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721558144 00000100:00100000:1.0:1746126619.768859:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721558144 00010000:00010000:1.0:1746126619.768877:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746126619.768894:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7177 00000100:00100000:1.0:1746126619.768899:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721558144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126619.768909:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126619.768928:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.768943:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.768960:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2600/0xb50e825867613e0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4df41 expref: 27 pid: 10890 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746126619.768972:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.768973:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.768977:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.768984:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.769010:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.769020:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721405568:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126619.769085:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.775201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.775303:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721405568:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126619.775322:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.775439:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721558144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6537us (7069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.775451:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7177 00000100:00100000:0.0:1746126619.777301:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721558656 00000100:00100000:0.0:1746126619.777311:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721558656 00002000:00100000:0.0:1746126619.777359:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092ad3800 x1830945721558656/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.777369:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3800 with x1830945721558656 ext(4194304->4976639) 00002000:00010000:0.0:1746126619.777374:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad3800 00000100:00100000:0.0:1746126619.777406:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7859 00000100:00100000:0.0:1746126619.777414:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721558656:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.778900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.779639:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721558912 00000100:00100000:1.0:1746126619.779646:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721558912 00002000:00100000:1.0:1746126619.779682:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1437696->1441791) req@ffff880093496680 x1830945721558912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.779692:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093496680 with x1830945721558912 ext(1437696->1441791) 00002000:00010000:1.0:1746126619.779697:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093496680 00000100:00100000:1.0:1746126619.779715:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7860 00000100:00100000:1.0:1746126619.779722:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721558912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.779883:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721558912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 160us (989us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126619.779890:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7860 00002000:00100000:1.0:1746126619.779896:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1437696->1441791) req@ffff880093496680 x1830945721558912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.779903:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093496680 with x1830945721558912 ext(1437696->1441791) 00002000:00010000:1.0:1746126619.779906:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093496680 00000100:00100000:0.0:1746126619.781209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.781351:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721559168 00000100:00100000:3.0:1746126619.781357:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721559168 00002000:00100000:3.0:1746126619.781384:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1515519) req@ffff8800a5965f80 x1830945721559168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.781391:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965f80 with x1830945721559168 ext(1048576->1515519) 00002000:00010000:3.0:1746126619.781396:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5965f80 00000100:00100000:3.0:1746126619.781412:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7861 00000100:00100000:3.0:1746126619.781418:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721559168:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.790922:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721558656:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13497us (15720us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126619.790935:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7859 00002000:00100000:1.0:1746126619.790947:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092ad3800 x1830945721558656/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.790956:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad3800 with x1830945721558656 ext(4194304->4976639) 00002000:00010000:1.0:1746126619.790961:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad3800 00000100:00100000:3.0:1746126619.791900:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721559168:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10479us (10692us total) trans 0 rc 466944/466944 00000100:00100000:3.0:1746126619.791908:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7861 00002000:00100000:3.0:1746126619.791914:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1515519) req@ffff8800a5965f80 x1830945721559168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.791920:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965f80 with x1830945721559168 ext(1048576->1515519) 00002000:00010000:3.0:1746126619.791924:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5965f80 00000100:00100000:0.0:1746126619.795490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.796408:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721559296 00000100:00100000:2.0:1746126619.796419:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721559296 00000100:00100000:2.0:1746126619.796465:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13746 00000100:00100000:2.0:1746126619.796473:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721559296:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126619.796491:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.796509:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135526c00/0xb50e825867614105 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e194 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.796562:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721405696:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126619.796653:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.799614:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721405696:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.799651:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135526c00/0xb50e825867614105 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e194 expref: 13 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.799664:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135526c00/0xb50e825867614105 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e194 expref: 13 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.799698:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526c00, rc 0) 00000100:00100000:2.0:1746126619.799759:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721559296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3286us (4277us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.799768:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13746 00000100:00100000:0.0:1746126619.801118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.801322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.801415:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721559424 00000100:00100000:3.0:1746126619.801422:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721559424 00000100:00100000:3.0:1746126619.801467:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13747 00000100:00100000:3.0:1746126619.801473:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721559424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.801488:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.801503:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e581c00/0xb50e82586761410c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e19b expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.801550:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721405824:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.801615:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.801928:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721559680 00000100:00100000:2.0:1746126619.801937:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721559680 00002000:00100000:2.0:1746126619.801970:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1441792->2097151) req@ffff8800a5967100 x1830945721559680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126619.801979:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967100 with x1830945721559680 ext(1441792->2097151) 00002000:00010000:2.0:1746126619.801983:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967100 00000100:00100000:2.0:1746126619.802002:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7862 00000100:00100000:2.0:1746126619.802007:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721559680:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:3.0:1746126619.808062:0:4641:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126617 -> 1746126619 00002000:00010000:3.0:1746126619.808070:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126617 -> 1746126619 00002000:00010000:3.0:1746126619.808072:0:4641:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126617 -> 1746126619 00000100:00100000:3.0:1746126619.808095:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721405824:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.808128:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e581c00/0xb50e82586761410c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e19b expref: 13 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.808143:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e581c00/0xb50e82586761410c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e19b expref: 13 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.808159:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581c00, rc 0) 00000100:00100000:3.0:1746126619.808203:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721559424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6728us (7089us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.808211:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13747 00000100:00100000:0.0:1746126619.808519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.809663:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721559936 00000100:00100000:1.0:1746126619.809675:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721559936 00002000:00100000:1.0:1746126619.809719:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5966a00 x1830945721559936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.809729:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966a00 with x1830945721559936 ext(1048576->2097151) 00002000:00010000:1.0:1746126619.809734:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966a00 00000100:00100000:1.0:1746126619.809756:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7863 00000100:00100000:1.0:1746126619.809763:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721559936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126619.811820:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721559680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9804us (10490us total) trans 0 rc 655360/655360 00000100:00100000:3.0:1746126619.811844:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7862 00002000:00100000:3.0:1746126619.811854:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1441792->2097151) req@ffff8800a5967100 x1830945721559680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.811863:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967100 with x1830945721559680 ext(1441792->2097151) 00002000:00010000:3.0:1746126619.811868:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967100 00000100:00100000:3.0:1746126619.813505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.813551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.813619:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721560064 00000100:00100000:1.0:1746126619.813628:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721560064 00000100:00100000:1.0:1746126619.813664:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721560192 00000100:00100000:1.0:1746126619.813666:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721560192 00000100:00100000:1.0:1746126619.813681:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13748 00000100:00100000:1.0:1746126619.813688:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721560064:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126619.813705:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.813722:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092efb600/0xb50e825867614113 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1a2 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126619.813777:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721405952:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126619.813924:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13749 00000100:00100000:0.0:1746126619.813932:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721560192:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126619.813939:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126619.813946:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef65800/0xb50e82586761411a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1a9 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126619.813967:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5965c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721406080:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126619.814336:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.814722:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.823243:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721559936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13469us (14713us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.823256:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7863 00002000:00100000:1.0:1746126619.823267:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5966a00 x1830945721559936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.823276:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966a00 with x1830945721559936 ext(1048576->2097151) 00002000:00010000:1.0:1746126619.823282:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966a00 00000100:00100000:0.0:1746126619.823945:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5965c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721406080:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126619.824021:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65800/0xb50e82586761411a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1a9 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126619.824036:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65800/0xb50e82586761411a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1a9 expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126619.824061:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65800, rc 0) 00000100:00100000:0.0:1746126619.824104:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721560192:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10172us (10552us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126619.824111:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13749 00000100:00100000:1.0:1746126619.824631:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721405952:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126619.824648:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092efb600/0xb50e825867614113 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1a2 expref: 13 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.824657:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092efb600/0xb50e825867614113 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1a2 expref: 13 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.824677:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092efb600, rc 0) 00000100:00100000:1.0:1746126619.824778:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721560064:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11090us (11278us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126619.824784:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13748 00000100:00100000:0.0:1746126619.835184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.835240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.835306:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721560576 00000100:00100000:3.0:1746126619.835317:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721560576 00002000:00100000:3.0:1746126619.835363:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5965c00 x1830945721560576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.835378:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965c00 with x1830945721560576 ext(3145728->4194303) 00002000:00010000:3.0:1746126619.835383:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965c00 00000100:00100000:3.0:1746126619.836684:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721560448 00000100:00100000:3.0:1746126619.836692:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721560448 00002000:00100000:3.0:1746126619.836722:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5966680 x1830945721560448/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.836730:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966680 with x1830945721560448 ext(2097152->3145727) 00002000:00010000:3.0:1746126619.836735:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966680 00000100:00100000:3.0:1746126619.836763:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7864 00000100:00100000:3.0:1746126619.836771:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721560576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126619.839232:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7865 00000100:00100000:0.0:1746126619.839246:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721560448:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:0.0:1746126619.845046:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126619.870736:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721560448:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31479us (35479us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126619.870750:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7865 00002000:00100000:1.0:1746126619.870766:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5966680 x1830945721560448/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126619.870776:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5966680 with x1830945721560448 ext(2097152->3145727) 00002000:00010000:1.0:1746126619.870783:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5966680 00000100:00100000:3.0:1746126619.870964:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721560576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34191us (35787us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126619.870972:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7864 00002000:00100000:3.0:1746126619.870978:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a5965c00 x1830945721560576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.870986:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965c00 with x1830945721560576 ext(3145728->4194303) 00002000:00010000:3.0:1746126619.870989:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965c00 00000100:00100000:0.0:1746126619.897172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.897282:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721560960 00000100:00100000:3.0:1746126619.897291:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721560960 00002000:00100000:3.0:1746126619.897341:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a5964a80 x1830945721560960/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.897352:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964a80 with x1830945721560960 ext(4194304->4976639) 00002000:00010000:3.0:1746126619.897358:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5964a80 00000100:00100000:3.0:1746126619.897393:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7866 00000100:00100000:3.0:1746126619.897400:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721560960:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126619.928509:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721560960:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31094us (31331us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126619.928522:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7866 00002000:00100000:3.0:1746126619.928535:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a5964a80 x1830945721560960/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.928545:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964a80 with x1830945721560960 ext(4194304->4976639) 00002000:00010000:3.0:1746126619.928552:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5964a80 00000100:00100000:0.0:1746126619.947063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.948632:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561088 00000100:00100000:1.0:1746126619.948645:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561088 00000100:00100000:1.0:1746126619.948698:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13750 00000100:00100000:1.0:1746126619.948707:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31395:x1830945721561088:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126619.948726:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126619.948744:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1b0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.948773:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.948782:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.948793:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.948795:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126619.948798:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [786432->1048575] (req 786432->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.948849:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126619.948862:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746126619.948874:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721406208:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.948977:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126619.948986:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 21 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.948994:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721406336:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126619.949011:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.953261:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721406208:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.953455:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721406336:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.953487:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [786432->1048575] (req 786432->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.953504:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092efb800, rc 0) 00000100:00100000:2.0:1746126619.953557:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31395:x1830945721561088:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4851us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.953566:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13750 00000100:00100000:0.0:1746126619.954242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.954355:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561216 00000100:00100000:2.0:1746126619.954362:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561216 00010000:00010000:2.0:1746126619.954389:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.954424:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7178 00000100:00100000:2.0:1746126619.954431:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721561216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.954445:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.954468:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.954478:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.954500:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c889000/0xb50e825867614072 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e10f expref: 22 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.954524:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.954547:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721561216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 113us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.954553:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7178 00000100:00100000:1.0:1746126619.954846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.954885:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561344 00000100:00100000:3.0:1746126619.954889:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561344 00010000:00010000:3.0:1746126619.954904:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746126619.954919:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7179 00000100:00100000:3.0:1746126619.954924:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721561344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.954930:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.954939:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.954948:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.954960:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e82586761409c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e12b expref: 25 pid: 8437 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746126619.954987:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.954989:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126619.954996:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.955004:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126619.955031:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.955050:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721406464:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126619.955099:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.959614:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721406464:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126619.959638:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126619.959705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126619.960372:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721561344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5444us (5542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.960383:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7179 00000100:00100000:0.0:1746126619.961069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.961129:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561600 00000100:00100000:2.0:1746126619.961137:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561600 00000100:00100000:2.0:1746126619.961756:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8986 00000100:00100000:2.0:1746126619.961764:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31401:x1830945721561600:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126619.961789:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.961809:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5a00/0xb50e825867614128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1b7 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.961889:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.961902:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.961911:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.961924:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.961929:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.961933:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746126619.962066:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561728 00000100:00100000:3.0:1746126619.962071:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561728 00002000:00100000:3.0:1746126619.962101:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (786432->790527) req@ffff88009f137800 x1830945721561728/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.962110:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137800 with x1830945721561728 ext(786432->790527) 00002000:00010000:3.0:1746126619.962114:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f137800 00000100:00100000:3.0:1746126619.962176:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7867 00000100:00100000:3.0:1746126619.962184:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721561728:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:2.0:1746126619.962382:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.962393:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.962401:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 238 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.962406:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.962561:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 238 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.962573:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 238 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.962589:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721406592:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.962793:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.962802:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 21 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.962809:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721406720:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126619.963004:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721561728:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 820us (1935us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126619.963012:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7867 00002000:00100000:3.0:1746126619.963017:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (786432->790527) req@ffff88009f137800 x1830945721561728/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/4536 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.963024:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137800 with x1830945721561728 ext(786432->790527) 00002000:00010000:3.0:1746126619.963027:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f137800 00000100:00100000:2.0:1746126619.963163:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.964568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.964602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.965521:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561856 00000100:00100000:2.0:1746126619.965530:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561856 00000100:00100000:1.0:1746126619.965689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.965759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.965803:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721561984 00000100:00100000:2.0:1746126619.965806:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721561984 00000100:00100000:3.0:1746126619.965901:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13751 00000100:00100000:3.0:1746126619.965912:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721561856:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.965929:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.965946:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867614144 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1be expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.965998:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721406848:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.966090:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.966108:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721562368 00000100:00100000:3.0:1746126619.966110:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721562368 00010000:00010000:3.0:1746126619.966130:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 22 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126619.966148:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7180 00000100:00100000:3.0:1746126619.966153:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721562368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126619.966162:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126619.966167:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 22 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.966178:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 22 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.966197:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126619.966201:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126619.966209:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126619.966213:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126619.966217:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126619.966236:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721562368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126619.966242:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7180 00000100:00100000:3.0:1746126619.966278:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13752 00000100:00100000:3.0:1746126619.966283:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721561984:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126619.966290:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.966296:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e82586761414b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1c5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126619.966318:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721406976:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.966336:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.966388:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721562240 00000100:00100000:0.0:1746126619.966392:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721562240 00000100:00100000:0.0:1746126619.966417:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3809 00000100:00100000:0.0:1746126619.966422:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+239:23947:x1830945721562240:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746126619.966595:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+240:23947:x1830945721562240:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 172us (906us total) trans 8589943174 rc 0/0 00000100:00100000:0.0:1746126619.966601:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3809 00000100:00100000:1.0:1746126619.966912:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721406592:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.966925:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e825867614041 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0e5 expref: 21 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746126619.966940:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721406720:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126619.966957:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126619.968676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.969405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.969476:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721562496 00000100:00100000:2.0:1746126619.969484:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721562496 00000100:00100000:2.0:1746126619.969523:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13753 00000100:00100000:2.0:1746126619.969529:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31395:x1830945721562496:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126619.969546:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.969562:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1cc expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.969588:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.969594:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126619.969596:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126619.969600:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->1462271] (req 1048576->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.969625:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.969634:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 25 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.969645:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721407104:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.969708:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.969731:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721562624 00000100:00100000:2.0:1746126619.969733:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721562624 00010000:00010000:2.0:1746126619.969748:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 240 pid: 15560 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.969762:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7181 00000100:00100000:2.0:1746126619.969766:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+240:1963:x1830945721562624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126619.969773:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126619.969778:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 240 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.969786:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 240 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.969800:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e82586761408e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e124 expref: 240 pid: 15560 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126619.969819:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126619.969823:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.969847:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.969852:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.969866:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126619.969882:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+239:1963:x1830945721562624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.969887:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7181 00000100:00100000:2.0:1746126619.969935:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721406976:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.969953:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e82586761414b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1c5 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.969961:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e82586761414b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1c5 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.969966:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbae00, rc 0) 00000100:00100000:2.0:1746126619.969980:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721561984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3697us (5378us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.969984:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13752 00010000:00010000:2.0:1746126619.970019:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970028:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126619.970077:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126619.970080:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126619.970095:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970103:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970112:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970118:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970122:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970127:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098df5e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126619.970130:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970136:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970143:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126619.970145:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126619.970148:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970152:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e82586761412f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970160:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970164:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970169:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970172:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eeb8200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126619.970173:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970177:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970181:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a593b300) 00010000:00010000:2.0:1746126619.970182:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126619.970184:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970187:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eeb8200/0xb50e825867614136 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.970211:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5a00/0xb50e825867614128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.970218:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.970222:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126619.970225:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126619.970227:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:2.0:1746126619.970245:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31401:x1830945721561600:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 8484us (10542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.970251:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8986 00000100:00100000:3.0:1746126619.970333:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721406848:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.970348:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867614144 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1be expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.970359:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbbe00/0xb50e825867614144 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1be expref: 15 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.970379:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbbe00, rc 0) 00000100:00100000:3.0:1746126619.970407:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721561856:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4498us (5843us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.970457:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13751 00000100:00100000:0.0:1746126619.974900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.975111:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721407104:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.975143:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->1462271] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.975158:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae42200, rc 0) 00000100:00100000:3.0:1746126619.975251:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721562752 00000100:00100000:3.0:1746126619.975257:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721562752 00000100:00100000:3.0:1746126619.975296:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13754 00000100:00100000:3.0:1746126619.975302:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1963:x1830945721562752:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126619.975316:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126619.975331:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebbbc00/0xb50e825867614159 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1d3 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.975860:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31395:x1830945721562496:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6296us (7157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.975867:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13753 00000100:00100000:3.0:1746126619.975961:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721407232:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126619.976020:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126619.976142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.976215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.976356:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563264 00000100:00100000:2.0:1746126619.976360:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563264 00000100:00100000:2.0:1746126619.976387:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13755 00000100:00100000:2.0:1746126619.976392:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721563264:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126619.976401:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.976412:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b1e00/0xb50e825867614160 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1da expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.976711:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721407360:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126619.976748:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126619.976894:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563136 00000100:00100000:3.0:1746126619.976898:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563136 00002000:00100000:3.0:1746126619.976929:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1515520->2097151) req@ffff8800937bb100 x1830945721563136/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126619.976938:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bb100 with x1830945721563136 ext(1515520->2097151) 00010000:00010000:3.0:1746126619.976944:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 26 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126619.976961:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 26 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126619.976967:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937bb100 00000100:00100000:3.0:1746126619.976980:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1796 00000100:00100000:3.0:1746126619.976985:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721563136:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126619.977800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126619.977855:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563008 00000100:00100000:0.0:1746126619.977859:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563008 00000100:00100000:1.0:1746126619.977889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:0.0:1746126619.978225:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (0->786431) req@ffff880135bcd180 x1830945721563008/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/0 e 0 to 0 dl 1746126630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.978233:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcd180 with x1830945721563008 ext(0->786431) 00002000:00010000:0.0:1746126619.978237:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcd180 00000100:00100000:0.0:1746126619.978249:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7868 00000100:00100000:0.0:1746126619.978254:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721563008:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126619.978685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126619.978728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.978897:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563392 00000100:00100000:2.0:1746126619.978902:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563392 00000100:00100000:2.0:1746126619.978923:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563520 00000100:00100000:2.0:1746126619.978925:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563520 00000100:00100000:2.0:1746126619.978936:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563648 00000100:00100000:2.0:1746126619.978938:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563648 00000100:00100000:2.0:1746126619.978949:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13756 00000100:00100000:2.0:1746126619.978954:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721563392:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126619.978963:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.978978:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e21200/0xb50e825867614167 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1e1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126619.979020:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721407488:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126619.979088:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126619.979106:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13757 00000100:00100000:2.0:1746126619.979112:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721563520:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126619.979118:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.979129:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1e8 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.979141:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.979143:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.979150:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.979163:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.979172:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d8e0a00, rc 0) 00000100:00100000:2.0:1746126619.979193:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721563520:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 81us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.979202:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13757 00000100:00100000:2.0:1746126619.979218:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13758 00000100:00100000:2.0:1746126619.979222:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721563648:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126619.979227:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.979234:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1ef expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.979244:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.979245:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126619.979249:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.979257:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 9 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.979264:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43200, rc 0) 00000100:00100000:2.0:1746126619.979279:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721563648:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 56us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126619.979283:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13758 00000100:00100000:2.0:1746126619.981054:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093494000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721407360:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126619.981088:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b1e00/0xb50e825867614160 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1da expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.981099:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1e00/0xb50e825867614160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1da expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126619.981114:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1e00, rc 0) 00000100:00100000:2.0:1746126619.981681:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721563264:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5287us (5465us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126619.981688:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13755 00000100:00100000:3.0:1746126619.982493:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721407488:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.982515:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e21200/0xb50e825867614167 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e1 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.982525:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e21200/0xb50e825867614167 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e1 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.982637:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e21200, rc 0) 00000100:00100000:3.0:1746126619.982780:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721563392:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3825us (4890us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.982786:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13756 00002000:00010000:3.0:1746126619.988776:0:4641:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126618 -> 1746126619 00000100:00100000:3.0:1746126619.988804:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721407232:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126619.988870:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebbbc00/0xb50e825867614159 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1d3 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.988886:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebbbc00/0xb50e825867614159 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1d3 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126619.988898:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbbc00, rc 0) 00000100:00100000:3.0:1746126619.988971:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721562752:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13668us (14081us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126619.988980:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13754 00000100:00100000:0.0:1746126619.994935:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721563136:12345-192.168.203.2@tcp:4:cat.0 Request processed in 17935us (18778us total) trans 17179873238 rc 0/0 00000100:00100000:0.0:1746126619.994948:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1796 00002000:00100000:0.0:1746126619.994960:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1515520->2097151) req@ffff8800937bb100 x1830945721563136/t17179873238(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:380/0 lens 488/448 e 0 to 0 dl 1746126630 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.994970:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bb100 with x1830945721563136 ext(1515520->2097151) 00010000:00010000:0.0:1746126619.994980:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746126619.994994:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746126619.995001:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937bb100 00000100:00100000:1.0:1746126619.995247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126619.995318:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721563904 00000100:00100000:2.0:1746126619.995327:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721563904 00000100:00100000:2.0:1746126619.995364:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8987 00000100:00100000:2.0:1746126619.995370:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31401:x1830945721563904:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126619.995386:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126619.995403:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9600/0xb50e82586761417c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1f6 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.995490:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.995504:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.995511:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126619.995539:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126619.995549:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 15 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126619.995559:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721407616:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126619.995621:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126619.996214:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721563008:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17958us (18414us total) trans 0 rc 786432/786432 00000100:00100000:0.0:1746126619.996222:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7868 00002000:00100000:0.0:1746126619.996228:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (0->786431) req@ffff880135bcd180 x1830945721563008/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:380/0 lens 488/440 e 0 to 0 dl 1746126630 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126619.996236:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcd180 with x1830945721563008 ext(0->786431) 00002000:00010000:0.0:1746126619.996240:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135bcd180 00000100:00100000:2.0:1746126619.998184:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721407616:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126619.998207:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126619.999003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.000011:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564032 00000100:00100000:2.0:1746126620.000020:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564032 00010000:00010000:2.0:1746126620.000061:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 16 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.000096:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7182 00000100:00100000:2.0:1746126620.000103:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:1964:x1830945721564032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.000118:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.000124:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 16 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.000133:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 16 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.000154:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a570e400/0xb50e82586761413d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b7 expref: 16 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.000172:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.000177:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.000186:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.000196:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.000227:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.000271:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721564032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 168us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.000277:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7182 00010000:00010000:3.0:1746126620.000904:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.000912:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746126620.000932:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126620.001270:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9600/0xb50e82586761417c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.001286:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.001293:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.001296:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126620.001298:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54f9800, rc 0) 00000100:00100000:3.0:1746126620.001348:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31401:x1830945721563904:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5976us (6100us total) trans 8589943175 rc 0/0 00000100:00100000:3.0:1746126620.001354:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8987 00000100:00100000:0.0:1746126620.001557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.002571:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564160 00000100:00100000:3.0:1746126620.002578:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564160 00010000:00010000:3.0:1746126620.002611:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126620.002646:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7183 00000100:00100000:3.0:1746126620.002652:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721564160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.002663:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.002682:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.002691:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.002708:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e581a00/0xb50e8258676140db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e16a expref: 28 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.002720:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.002722:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.002728:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 12 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.002735:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 12 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.002760:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 12 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.002770:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721407744:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126620.003063:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211900 going to sleep for 11 seconds 00000100:00080000:1.0:1746126620.003499:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126620.006028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.006180:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721407744:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126620.006202:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.006242:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721564160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3589us (4685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.006253:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7183 00000100:00100000:2.0:1746126620.006321:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564288 00000100:00100000:2.0:1746126620.006328:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564288 00000100:00100000:2.0:1746126620.006369:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8988 00000100:00100000:2.0:1746126620.006376:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31401:x1830945721564288:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.006398:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.006415:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9c00/0xb50e825867614191 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e1fd expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.006497:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.006511:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.006517:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.006546:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.006558:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 16 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.006573:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721407872:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.006622:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746126620.006960:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126620.007541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.007684:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564544 00000100:00100000:2.0:1746126620.007689:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564544 00002000:00100000:2.0:1746126620.007727:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009f137b80 x1830945721564544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.007736:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137b80 with x1830945721564544 ext(1048576->2097151) 00002000:00010000:2.0:1746126620.007741:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f137b80 00000100:00100000:2.0:1746126620.007753:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7869 00000100:00100000:2.0:1746126620.007759:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721564544:12345-192.168.203.2@tcp:3:cat.0 00000100:00080000:1.0:1746126620.008609:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126620.015189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.015473:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564672 00000100:00100000:3.0:1746126620.015483:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564672 00010000:00010000:3.0:1746126620.015519:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 17 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126620.015557:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7184 00000100:00100000:3.0:1746126620.015565:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:1964:x1830945721564672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.015580:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.015586:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 17 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.015598:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 17 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.015620:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.015625:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.015635:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.015641:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.015658:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126620.016279:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9800/0xb50e825867614183 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1f6 expref: 17 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.016300:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721407872:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.016317:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.017524:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.017534:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126620.017579:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126620.017584:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126620.017600:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.017636:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9c00/0xb50e825867614191 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.017652:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.017660:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.017663:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126620.017666:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54f9400, rc 0) 00000100:00100000:2.0:1746126620.017711:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:31401:x1830945721564288:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 11335us (11692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.017720:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8988 00000100:00100000:2.0:1746126620.018009:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721564544:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10250us (10469us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.018017:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7869 00002000:00100000:2.0:1746126620.018025:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009f137b80 x1830945721564544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.018033:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137b80 with x1830945721564544 ext(1048576->2097151) 00002000:00010000:2.0:1746126620.018037:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f137b80 00000100:00100000:3.0:1746126620.018164:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721564672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2598us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.018173:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7184 00000100:00100000:0.0:1746126620.022589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.022627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.022660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.022735:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564928 00000100:00100000:2.0:1746126620.022745:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564928 00000100:00100000:2.0:1746126620.022785:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721564800 00000100:00100000:2.0:1746126620.022787:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721564800 00000100:00100000:2.0:1746126620.022799:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721565056 00000100:00100000:2.0:1746126620.022800:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721565056 00000100:00100000:2.0:1746126620.022813:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13759 00000100:00100000:2.0:1746126620.022821:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721564928:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.022859:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.022878:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9200/0xb50e82586761419f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e20b expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.022928:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721408000:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126620.022991:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.023008:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13760 00000100:00100000:2.0:1746126620.023012:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721564800:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.023019:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.023028:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54f8a00/0xb50e8258676141a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e204 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.023058:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721408128:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126620.023073:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.023099:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13761 00000100:00100000:2.0:1746126620.023103:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721565056:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.023108:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.023114:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9800/0xb50e8258676141ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e212 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.023133:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099252d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721408256:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126620.023146:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.025726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.025814:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721565312 00000100:00100000:1.0:1746126620.025823:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721565312 00000100:00100000:1.0:1746126620.025916:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3810 00000100:00100000:1.0:1746126620.025923:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973cc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31395:x1830945721565312:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126620.026156:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973cc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31395:x1830945721565312:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 233us (439us total) trans 8589943176 rc 0/0 00000100:00100000:1.0:1746126620.026163:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3810 00000100:00080000:0.0:1746126620.026373:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126620.026780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.026917:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721565568 00000100:00100000:2.0:1746126620.026922:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721565568 00000100:00100000:2.0:1746126620.026975:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8989 00000100:00100000:2.0:1746126620.026981:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+239:31403:x1830945721565568:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126620.026993:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.027010:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9600/0xb50e8258676141b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e219 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.027107:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.027120:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.027127:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.027157:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.027169:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 14 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.027180:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721408384:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.027238:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce900 going to sleep for 11 seconds 00000100:00080000:1.0:1746126620.027281:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126620.028121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.028305:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721408128:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126620.028333:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54f8a00/0xb50e8258676141a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e204 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.028344:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54f8a00/0xb50e8258676141a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e204 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.028357:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54f8a00, rc 0) 00000100:00100000:3.0:1746126620.028387:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721564800:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5374us (5759us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126620.028394:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13760 00000100:00100000:2.0:1746126620.028921:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099252300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721408000:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.028938:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9200/0xb50e82586761419f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e20b expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.028947:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9200/0xb50e82586761419f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e20b expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.028960:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54f9200, rc 0) 00000100:00100000:2.0:1746126620.028979:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721564928:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6159us (6400us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.028984:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13759 00000100:00100000:3.0:1746126620.030520:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721565696 00000100:00100000:3.0:1746126620.030531:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721565696 00000100:00100000:3.0:1746126620.030566:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13762 00000100:00100000:3.0:1746126620.030572:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31400:x1830945721565696:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126620.030586:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.030600:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e220 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.030625:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.030632:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126620.030634:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126620.030638:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.030664:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.030673:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 26 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126620.030683:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721408512:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.030737:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.031149:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099252d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721408256:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.031172:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9800/0xb50e8258676141ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e212 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.031180:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9800/0xb50e8258676141ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e212 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.031189:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54f9800, rc 0) 00000100:00100000:2.0:1746126620.031222:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721565056:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 8116us (8561us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.031228:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13761 00000100:00100000:0.0:1746126620.033329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.033365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.035409:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721408512:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.035444:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.035461:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebbae00, rc 0) 00000100:00100000:3.0:1746126620.035519:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31400:x1830945721565696:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4946us (7398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.035528:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13762 00000100:00100000:3.0:1746126620.035565:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721565824 00000100:00100000:3.0:1746126620.035571:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721565824 00010000:00010000:3.0:1746126620.035594:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 15 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746126620.035614:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7185 00000100:00100000:3.0:1746126620.035619:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1965:x1830945721565824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.035630:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.035635:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 15 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.035644:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 15 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.035664:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.035668:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.035675:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.035681:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126620.035693:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.035705:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1965:x1830945721565824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 86us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.035709:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7185 00010000:00010000:2.0:1746126620.035818:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9400/0xb50e825867614198 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1fd expref: 14 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.035845:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721408384:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.035856:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.035864:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.035868:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126620.035886:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126620.036024:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54f9600/0xb50e8258676141b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 242 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.036034:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.036052:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.036054:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126620.036056:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093778000, rc 0) 00000100:00100000:2.0:1746126620.036097:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+241:31403:x1830945721565568:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9115us (9317us total) trans 8589943177 rc 0/0 00000100:00100000:2.0:1746126620.036103:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8989 00000100:00100000:2.0:1746126620.036126:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721565952 00000100:00100000:2.0:1746126620.036129:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721565952 00002000:00100000:2.0:1746126620.036156:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1441791) req@ffff88009f137100 x1830945721565952/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.036164:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137100 with x1830945721565952 ext(1048576->1441791) 00010000:00010000:2.0:1746126620.036170:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 27 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.036180:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 27 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746126620.036186:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f137100 00000100:00100000:2.0:1746126620.036197:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1797 00000100:00100000:2.0:1746126620.036202:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:1965:x1830945721565952:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126620.039395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.040164:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721566208 00000100:00100000:2.0:1746126620.040175:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721566208 00000100:00100000:2.0:1746126620.040614:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8990 00000100:00100000:2.0:1746126620.040625:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31401:x1830945721566208:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.040649:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.040670:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093778600/0xb50e8258676141d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e227 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.040781:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.040799:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 240 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.040806:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.040891:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 240 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.040904:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 240 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.040917:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721408640:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.043440:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.050876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.051148:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721408640:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.051177:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746126620.053223:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721566336 00000100:00100000:2.0:1746126620.053232:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721566336 00010000:00010000:2.0:1746126620.053266:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 241 pid: 14549 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.053301:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7186 00000100:00100000:2.0:1746126620.053308:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+241:1964:x1830945721566336:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.053323:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.053328:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 241 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.053339:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 241 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.053361:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778000/0xb50e8258676141bb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e219 expref: 241 pid: 14549 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.053375:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.053379:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053389:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053395:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053414:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.053470:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+240:1964:x1830945721566336:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 161us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.053477:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7186 00010000:00010000:2.0:1746126620.053536:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053541:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053558:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053564:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053569:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053575:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093778800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126620.053578:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053585:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053592:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.053595:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126620.053598:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053603:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778800/0xb50e8258676141d7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.053637:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778600/0xb50e8258676141d0 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e227 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.053648:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778600/0xb50e8258676141d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e227 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.053655:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093778600, rc 0) 00000100:00100000:2.0:1746126620.053678:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31401:x1830945721566208:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13056us (14297us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.053686:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8990 00000100:00100000:3.0:1746126620.055171:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721565952:12345-192.168.203.2@tcp:4:cat.0 Request processed in 18965us (21847us total) trans 17179873239 rc 0/0 00000100:00100000:3.0:1746126620.055181:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1797 00002000:00100000:3.0:1746126620.055190:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1441791) req@ffff88009f137100 x1830945721565952/t17179873239(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.055199:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f137100 with x1830945721565952 ext(1048576->1441791) 00010000:00010000:3.0:1746126620.055207:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 29 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746126620.055224:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 29 pid: 8436 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746126620.055230:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f137100 00000100:00100000:0.0:1746126620.069561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.069753:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721566592 00000100:00100000:2.0:1746126620.069765:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721566592 00000100:00100000:2.0:1746126620.070019:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3811 00000100:00100000:2.0:1746126620.070031:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31401:x1830945721566592:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1746126620.070270:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31401:x1830945721566592:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 242us (721us total) trans 8589943178 rc 0/0 00000100:00100000:2.0:1746126620.070276:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3811 00000100:00100000:0.0:1746126620.076748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.076876:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721566720 00000100:00100000:2.0:1746126620.076886:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721566720 00010000:00010000:2.0:1746126620.076919:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 29 pid: 8436 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746126620.076948:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7187 00000100:00100000:2.0:1746126620.076954:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721566720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.076967:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.076987:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 29 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.077003:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 29 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.077024:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e8258676140e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e171 expref: 29 pid: 8436 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746126620.077046:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.077048:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.077054:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.077061:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.077089:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.077098:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721408768:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126620.079969:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.082818:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721408768:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126620.082868:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.082925:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721566720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5969us (6186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.082935:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7187 00000100:00100000:0.0:1746126620.087478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.090613:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721566976 00000100:00100000:3.0:1746126620.090626:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721566976 00002000:00100000:3.0:1746126620.090677:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009f135180 x1830945721566976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.090685:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135180 with x1830945721566976 ext(1048576->2097151) 00002000:00010000:3.0:1746126620.090691:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f135180 00000100:00100000:3.0:1746126620.090713:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7870 00000100:00100000:3.0:1746126620.090720:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721566976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126620.100990:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721566976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10257us (13508us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126620.101002:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7870 00002000:00100000:3.0:1746126620.101014:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009f135180 x1830945721566976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.101024:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135180 with x1830945721566976 ext(1048576->2097151) 00002000:00010000:3.0:1746126620.101030:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f135180 00000100:00100000:1.0:1746126620.118976:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721409152:0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.119035:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126620.119168:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126620.119173:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721409280:0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.119194:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126620.119234:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409152 00000100:00100000:1.0:1746126620.119241:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409152 00000100:00080000:1.0:1746126620.119263:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126620.119292:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746126620.119298:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721409152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.119333:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721409152:12345-0@lo:400:kworker.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.119338:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746126620.119366:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721409152:0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.119387:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409280 00000100:00100000:1.0:1746126620.119389:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409280 00000100:00100000:1.0:1746126620.119407:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1746126620.119411:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721409280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.119431:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721409280:12345-0@lo:400:kworker.0 Request processed in 19us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.119435:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1746126620.119444:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126620.119453:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721409280:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.119773:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721408896:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.119804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.119850:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721409408:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.119866:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.119877:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746126620.119881:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1830945721409024:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.119894:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.119903:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830945721409536:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.119914:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.119927:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409024 00000100:00100000:2.0:1746126620.119929:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409024 00000100:00080000:2.0:1746126620.119939:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126620.119951:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409536 00000100:00100000:2.0:1746126620.119953:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409536 00000100:00100000:2.0:1746126620.119968:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1746126620.119972:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830945721409024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.119994:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830945721409024:12345-0@lo:400:kworker.0 Request processed in 22us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.119999:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1746126620.120008:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1746126620.120011:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830945721409536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.120026:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830945721409536:12345-0@lo:400:kworker.0 Request processed in 15us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.120030:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1746126620.120059:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1830945721409024:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.120067:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830945721409536:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.120106:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721408896 00000100:00100000:2.0:1746126620.120109:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721408896 00000100:00100000:1.0:1746126620.120123:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409408 00000100:00100000:2.0:1746126620.120126:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746126620.120126:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409408 00000100:00100000:2.0:1746126620.120130:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3294:x1830945721408896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.120146:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1746126620.120150:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830945721409408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.120153:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3294:x1830945721408896:12345-0@lo:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.120157:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746126620.120172:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830945721409408:12345-0@lo:400:kworker.0 Request processed in 22us (305us total) trans 0 rc 0/0 00000100:00080000:2.0:1746126620.120176:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746126620.120180:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1746126620.120185:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2fb79569-8691-41f9-a471-439cf21ba3b2:3294:1830945721408896:0@lo:400:kworker.0 00000100:00100000:2.0:1746126620.120193:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721409408:0@lo:400:kworker.0 00000100:00100000:1.0:1746126620.149209:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721409664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746126620.149276:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.149300:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409664 00000100:00100000:2.0:1746126620.149308:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409664 00000100:00100000:2.0:1746126620.149937:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1746126620.149947:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3296:x1830945721409664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746126620.149985:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 586481664 pending 13631488 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746126620.150024:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3296:x1830945721409664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.150030:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1746126620.150087:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721409664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746126620.151807:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746126620.151852:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721409792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746126620.151903:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126620.151997:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721409792 00000100:00100000:1.0:1746126620.152004:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721409792 00000100:00100000:1.0:1746126620.152047:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1746126620.152055:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721409792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746126620.152073:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 581500928 pending 20447232 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746126620.152121:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721409792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.152127:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1746126620.153341:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721409792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746126620.162510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.162579:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721567232 00000100:00100000:1.0:1746126620.162589:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721567232 00000100:00100000:1.0:1746126620.162650:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8991 00000100:00100000:1.0:1746126620.162658:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31408:x1830945721567232:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126620.162683:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.162703:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5a00/0xb50e8258676141de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e22e expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.162796:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.162809:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.162820:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126620.162866:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126620.162979:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5a00/0xb50e8258676141de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 25 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.163011:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 24 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.163019:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126620.163022:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126620.163025:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098df5e00, rc 0) 00000100:00100000:1.0:1746126620.163084:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31408:x1830945721567232:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 426us (582us total) trans 8589943179 rc 0/0 00000100:00100000:1.0:1746126620.163091:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8991 00000100:00100000:0.0:1746126620.163232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.163266:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721567360 00000100:00100000:1.0:1746126620.163270:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721567360 00000100:00100000:1.0:1746126620.163291:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13763 00000100:00100000:1.0:1746126620.163296:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:31403:x1830945721567360:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126620.163304:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.163315:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e235 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.163333:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 29 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.163341:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.163352:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.163357:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.163359:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.163362:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3870720->4194303] (req 3870720->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.163388:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.163399:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 13 pid: 8437 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126620.163410:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721409920:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.163480:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.163488:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 6 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126620.163496:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721410048:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.163521:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 29 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.163532:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 29 pid: 4641 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.163540:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721410176:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.163557:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.168913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.168942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.169030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.171992:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721567488 00000100:00100000:1.0:1746126620.172004:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721567488 00000100:00100000:1.0:1746126620.172067:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721567616 00000100:00100000:1.0:1746126620.172070:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721567616 00000100:00100000:1.0:1746126620.172081:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721567744 00000100:00100000:1.0:1746126620.172083:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721567744 00000100:00100000:1.0:1746126620.172100:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13764 00000100:00100000:1.0:1746126620.172107:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721567488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.172124:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.172143:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e8258676141fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e23c expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.172192:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410304:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126620.172256:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.172289:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721409920:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.172299:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721410048:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.172306:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721410176:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.172329:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3870720->4194303] (req 3870720->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.172344:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eeb8200, rc 0) 00000100:00100000:1.0:1746126620.172363:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:31403:x1830945721567360:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9067us (9131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.172370:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13763 00000100:00100000:1.0:1746126620.172387:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13765 00000100:00100000:1.0:1746126620.172391:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721567616:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.172398:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.172407:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e580600/0xb50e825867614201 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e243 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.172427:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721410432:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126620.172449:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.172477:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13766 00000100:00100000:1.0:1746126620.172482:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721567744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.172488:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.172494:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e24a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.172503:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.172505:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.172512:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.172526:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.172537:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581e00, rc 0) 00000100:00100000:1.0:1746126620.172551:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721567744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 70us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.172556:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13766 00000100:00080000:1.0:1746126620.172587:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126620.192187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.192219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.192861:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721567872 00000100:00100000:2.0:1746126620.192871:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721567872 00010000:00010000:2.0:1746126620.192910:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 7 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.192951:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568000 00000100:00100000:2.0:1746126620.192954:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568000 00010000:00010000:2.0:1746126620.192965:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 14 pid: 8437 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.192979:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7188 00000100:00100000:2.0:1746126620.192986:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721567872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.192999:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.193021:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 7 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.193032:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 7 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.193063:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aec7a00/0xb50e825867613fd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0ad expref: 7 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.193082:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.193124:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721567872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 137us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.193130:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7188 00000100:00100000:2.0:1746126620.193145:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7189 00000100:00100000:2.0:1746126620.193150:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721568000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.193159:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.193166:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 14 pid: 8437 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.193181:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 14 pid: 8437 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.193195:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fc00/0xb50e825867613f7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e067 expref: 14 pid: 8437 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.193205:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.193222:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721568000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 72us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.193229:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7189 00000100:00100000:2.0:1746126620.193338:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721410432:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.193369:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e580600/0xb50e825867614201 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e243 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.193381:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e580600/0xb50e825867614201 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e243 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.193390:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580600, rc 0) 00000100:00100000:2.0:1746126620.193420:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721567616:12345-192.168.203.2@tcp:101:cat.0 Request processed in 21027us (24474us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.193427:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13765 00000100:00100000:2.0:1746126620.193481:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410304:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.193498:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e8258676141fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e23c expref: 22 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.193513:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e8258676141fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e23c expref: 22 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.193521:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581200, rc 0) 00000100:00100000:2.0:1746126620.193546:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721567488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 21438us (24641us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.193552:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13764 00000100:00100000:2.0:1746126620.195379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.196527:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568128 00000100:00100000:1.0:1746126620.196537:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568128 00010000:00010000:1.0:1746126620.196571:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 30 pid: 4641 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.196609:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7190 00000100:00100000:1.0:1746126620.196617:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721568128:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.196631:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.196653:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 30 pid: 4641 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.196665:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 30 pid: 4641 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.196686:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921fc800/0xb50e825867613f3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e028 expref: 30 pid: 4641 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.196710:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.196713:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.196719:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.196732:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.196766:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.196778:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721410560:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126620.199777:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.200257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.200488:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568256 00000100:00100000:3.0:1746126620.200497:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568256 00000100:00100000:3.0:1746126620.200537:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13767 00000100:00100000:3.0:1746126620.200544:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:31411:x1830945721568256:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126620.200560:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.200577:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e251 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.200603:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 23 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.200610:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126620.200612:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126620.200615:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 22 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.200640:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 23 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.200649:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 23 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.200659:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410688:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.200721:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.211594:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721410560:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126620.211617:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.211671:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721568128:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 15053us (16299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.211682:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7190 00000100:00100000:3.0:1746126620.211863:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410688:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.211885:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 22 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.211904:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a04a00, rc 0) 00000100:00100000:3.0:1746126620.211928:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:31411:x1830945721568256:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11385us (11675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.211934:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13767 00000100:00100000:0.0:1746126620.215266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.215315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.215394:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568384 00000100:00100000:1.0:1746126620.215403:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568384 00002000:00100000:1.0:1746126620.215455:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (786432->1048575) req@ffff88012d919c00 x1830945721568384/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.215464:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919c00 with x1830945721568384 ext(786432->1048575) 00010000:00010000:1.0:1746126620.215473:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 24 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.215486:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 24 pid: 9686 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746126620.215497:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d919c00 00000100:00100000:1.0:1746126620.215512:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568640 00000100:00100000:1.0:1746126620.215513:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568640 00002000:00100000:1.0:1746126620.215524:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3870720->3874815) req@ffff88012d918e00 x1830945721568640/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.215530:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918e00 with x1830945721568640 ext(3870720->3874815) 00002000:00010000:1.0:1746126620.215533:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d918e00 00000100:00100000:1.0:1746126620.215552:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1798 00000100:00100000:1.0:1746126620.215557:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721568384:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126620.215817:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7871 00000100:00100000:1.0:1746126620.215823:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721568640:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126620.215985:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721568640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 162us (668us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126620.215990:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7871 00002000:00100000:1.0:1746126620.215995:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3870720->3874815) req@ffff88012d918e00 x1830945721568640/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.216002:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918e00 with x1830945721568640 ext(3870720->3874815) 00002000:00010000:1.0:1746126620.216004:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d918e00 00000100:00080000:0.0:1746126620.216431:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746126620.233218:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721568384:12345-192.168.203.2@tcp:4:cat.0 Request processed in 17648us (17949us total) trans 21474840391 rc 0/0 00000100:00100000:1.0:1746126620.233230:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1798 00002000:00100000:1.0:1746126620.233243:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (786432->1048575) req@ffff88012d919c00 x1830945721568384/t21474840391(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.233254:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919c00 with x1830945721568384 ext(786432->1048575) 00010000:00010000:1.0:1746126620.233265:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 26 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.233282:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 26 pid: 9686 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746126620.233289:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d919c00 00000100:00100000:0.0:1746126620.237445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.237691:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568768 00000100:00100000:3.0:1746126620.237700:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568768 00000100:00100000:3.0:1746126620.237865:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13768 00000100:00100000:3.0:1746126620.237873:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:31403:x1830945721568768:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126620.237892:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.237908:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e258 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.237939:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.237946:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 6 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.237953:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.237958:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.237960:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.237964:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4620287] (req 4194304->4620287) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.237997:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.238007:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746126620.238018:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410816:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.240631:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 6 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.240649:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 6 pid: 4640 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746126620.240662:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410944:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.240726:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.240735:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 25 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.240743:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721411072:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.240761:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.252592:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410816:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.252607:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721410944:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.252614:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721411072:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.252643:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4620287] (req 4194304->4620287) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.252659:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a04c00, rc 0) 00000100:00100000:3.0:1746126620.253610:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:31403:x1830945721568768:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15734us (16170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.253619:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13768 00000100:00100000:0.0:1746126620.255506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.255849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.256902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.257478:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721568896 00000100:00100000:1.0:1746126620.257489:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721568896 00010000:00010000:1.0:1746126620.257527:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126620.257773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.257790:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569152 00000100:00100000:0.0:1746126620.257793:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569152 00000100:00100000:1.0:1746126620.257841:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7191 00000100:00100000:1.0:1746126620.257849:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721568896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.257862:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.257887:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.257899:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.257922:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e580800/0xb50e8258676140fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e18d expref: 23 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.257942:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.257979:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721568896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 132us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.257985:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7191 00000100:00100000:1.0:1746126620.257999:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569024 00000100:00100000:1.0:1746126620.258001:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569024 00010000:00010000:1.0:1746126620.258011:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 7 pid: 4640 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.258059:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7192 00000100:00100000:2.0:1746126620.258067:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721569024:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.258075:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.258084:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 7 pid: 4640 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.258092:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 7 pid: 4640 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.258103:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e825867614175 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1ef expref: 7 pid: 4640 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.258116:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.258130:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721569024:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.258135:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7192 00000100:00100000:2.0:1746126620.258177:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569280 00000100:00100000:2.0:1746126620.258180:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569280 00000100:00100000:2.0:1746126620.258195:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13769 00000100:00100000:2.0:1746126620.258199:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721569152:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.258211:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.258220:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093779000/0xb50e82586761421d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e25f expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.258261:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721411200:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126620.258303:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.258322:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13770 00000100:00100000:2.0:1746126620.258326:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721569280:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.258332:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.258337:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093779800/0xb50e825867614224 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e266 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.258346:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.258352:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093779800/0xb50e825867614224 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e266 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.258361:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093779800/0xb50e825867614224 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e266 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.258368:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093779800, rc 0) 00000100:00100000:2.0:1746126620.258380:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721569280:12345-192.168.203.2@tcp:101:cat.0 Request processed in 54us (608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.258385:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13770 00000100:00100000:2.0:1746126620.258429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.258563:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569408 00000100:00100000:0.0:1746126620.258570:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569408 00000100:00100000:0.0:1746126620.258590:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13771 00000100:00100000:0.0:1746126620.258594:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721569408:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.258600:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.258614:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135526200/0xb50e82586761422b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e26d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.258636:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721411328:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126620.258661:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.268660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.268717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.268815:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569536 00000100:00100000:2.0:1746126620.268857:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569536 00010000:00010000:2.0:1746126620.268894:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 28 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.268931:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569664 00000100:00100000:2.0:1746126620.268933:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569664 00010000:00010000:2.0:1746126620.268943:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 29 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.268956:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7193 00000100:00100000:2.0:1746126620.268962:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721569536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.268978:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.269001:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 29 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.269010:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 29 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.269034:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.269061:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.269069:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.269076:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.269106:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.269117:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721411456:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126620.269188:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.269206:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7194 00000100:00100000:2.0:1746126620.269210:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721569664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.269217:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.269226:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 29 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.269233:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 29 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.269243:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e581600/0xb50e8258676140d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e163 expref: 29 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.269255:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.269256:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.269259:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.269265:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.269278:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.269289:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721411584:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126620.269304:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.273363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.273460:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721411456:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126620.273483:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.273524:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721569536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4562us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.273535:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7193 00000100:00100000:3.0:1746126620.273610:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721411584:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126620.273618:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.273630:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721569664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4420us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.273635:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7194 00000100:00100000:3.0:1746126620.273655:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721569920 00000100:00100000:3.0:1746126620.273661:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721569920 00002000:00100000:3.0:1746126620.273696:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012d918a80 x1830945721569920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.273704:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918a80 with x1830945721569920 ext(0->1048575) 00002000:00010000:3.0:1746126620.273708:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d918a80 00000100:00100000:3.0:1746126620.273721:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7872 00000100:00100000:3.0:1746126620.273726:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721569920:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:1.0:1746126620.275689:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126618 -> 1746126619 00002000:00010000:1.0:1746126620.275696:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126618 -> 1746126619 00002000:00010000:1.0:1746126620.275698:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126618 -> 1746126619 00000100:00100000:1.0:1746126620.275719:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721411328:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126620.275749:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135526200/0xb50e82586761422b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e26d expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.275761:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135526200/0xb50e82586761422b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e26d expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.275783:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526200, rc 0) 00000100:00100000:1.0:1746126620.275809:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721569408:12345-192.168.203.2@tcp:101:cat.0 Request processed in 17213us (17379us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126620.275817:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13771 00010000:00010000:2.0:1746126620.275959:0:9686:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff880099250e00 x1830945721411200) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 26 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.275980:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092efb800/0xb50e825867614121 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 786432->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1b0 expref: 26 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.275993:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721411200:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.276011:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093779000/0xb50e82586761421d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e25f expref: 25 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.276019:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093779000/0xb50e82586761421d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e25f expref: 25 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.276025:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093779000, rc 0) 00000100:00100000:2.0:1746126620.276057:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721569152:12345-192.168.203.2@tcp:101:cat.0 Request processed in 17856us (19156us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.276063:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13769 00000100:00100000:1.0:1746126620.287308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.287428:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721570176 00000100:00100000:2.0:1746126620.287438:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721570176 00002000:00100000:2.0:1746126620.287486:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (4616192->4620287) req@ffff8800a4c8c000 x1830945721570176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.287496:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8c000 with x1830945721570176 ext(4616192->4620287) 00002000:00010000:2.0:1746126620.287502:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8c000 00000100:00100000:2.0:1746126620.287523:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7873 00000100:00100000:2.0:1746126620.287530:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721570176:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126620.287702:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721570176:12345-192.168.203.2@tcp:3:cat.0 Request processed in 170us (404us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126620.287708:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7873 00002000:00100000:2.0:1746126620.287713:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (4616192->4620287) req@ffff8800a4c8c000 x1830945721570176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.287719:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8c000 with x1830945721570176 ext(4616192->4620287) 00002000:00010000:2.0:1746126620.287722:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8c000 00000100:00100000:2.0:1746126620.288297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.288566:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721570304 00000100:00100000:0.0:1746126620.288572:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721570304 00000100:00100000:0.0:1746126620.288606:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13772 00000100:00100000:0.0:1746126620.288613:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31414:x1830945721570304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.288623:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.288638:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e274 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.288658:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.288660:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.288668:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.288681:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.288690:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526a00, rc 0) 00000100:00100000:0.0:1746126620.288724:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31414:x1830945721570304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 111us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.288729:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13772 00000100:00100000:0.0:1746126620.292493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.292588:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721570432 00000100:00100000:1.0:1746126620.292598:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721570432 00000100:00100000:1.0:1746126620.292650:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13773 00000100:00100000:1.0:1746126620.292659:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31408:x1830945721570432:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126620.292679:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.292696:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e27b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.292724:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.292732:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.292733:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.292736:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3411968->4087807] (req 3411968->4087807) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.292768:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.292780:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 28 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.292792:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721411712:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.292908:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.297498:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721411712:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.297531:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3411968->4087807] (req 3411968->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.297561:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e580400, rc 0) 00000100:00100000:1.0:1746126620.297619:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31408:x1830945721570432:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4959us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.297629:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13773 00000100:00100000:0.0:1746126620.301901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.302073:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721570560 00000100:00100000:2.0:1746126620.302083:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721570560 00002000:00100000:2.0:1746126620.302129:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3870720->4194303) req@ffff88012d919880 x1830945721570560/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.302139:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919880 with x1830945721570560 ext(3870720->4194303) 00010000:00010000:2.0:1746126620.302148:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 29 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.302160:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 29 pid: 8437 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746126620.302166:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d919880 00000100:00100000:2.0:1746126620.302195:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1799 00000100:00100000:2.0:1746126620.302202:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721570560:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126620.302987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.303020:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721570816 00000100:00100000:0.0:1746126620.303024:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721570816 00002000:00100000:0.0:1746126620.303053:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800a4c8c380 x1830945721570816/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126620.303061:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8c380 with x1830945721570816 ext(0->1048575) 00002000:00010000:0.0:1746126620.303065:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8c380 00000100:00100000:0.0:1746126620.303077:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7874 00000100:00100000:0.0:1746126620.303082:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721570816:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126620.304314:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721569920:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30583us (30955us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126620.304323:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7872 00002000:00100000:3.0:1746126620.304330:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012d918a80 x1830945721569920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.304337:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918a80 with x1830945721569920 ext(0->1048575) 00002000:00010000:3.0:1746126620.304342:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d918a80 00000100:00100000:1.0:1746126620.306649:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.306676:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721571072 00000100:00100000:1.0:1746126620.306684:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721571072 00000100:00100000:1.0:1746126620.306731:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3812 00000100:00100000:1.0:1746126620.306737:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+240:31403:x1830945721571072:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126620.306979:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+241:31403:x1830945721571072:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 241us (337us total) trans 8589943180 rc 0/0 00000100:00100000:1.0:1746126620.306985:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3812 00000100:00100000:2.0:1746126620.311462:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721570560:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9248us (9558us total) trans 17179873240 rc 0/0 00000100:00100000:2.0:1746126620.311475:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1799 00002000:00100000:2.0:1746126620.311487:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3870720->4194303) req@ffff88012d919880 x1830945721570560/t17179873240(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.311495:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919880 with x1830945721570560 ext(3870720->4194303) 00010000:00010000:2.0:1746126620.311505:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.311521:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746126620.311527:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d919880 00000100:00100000:1.0:1746126620.315513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.315580:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721571200 00000100:00100000:3.0:1746126620.315589:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721571200 00010000:00010000:3.0:1746126620.315625:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.315652:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7195 00000100:00100000:3.0:1746126620.315658:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721571200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.315672:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.315693:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.315704:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.315724:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eeb8200/0xb50e8258676141f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3870720->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e235 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.315742:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.315745:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.315751:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.315759:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.315788:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.315799:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721411840:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126620.315879:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.316150:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721570816:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 13067us (13163us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126620.316158:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7874 00002000:00100000:1.0:1746126620.316167:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800a4c8c380 x1830945721570816/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.316176:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8c380 with x1830945721570816 ext(0->1048575) 00002000:00010000:1.0:1746126620.316180:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8c380 00000100:00100000:0.0:1746126620.316389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.316483:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721571328 00000100:00100000:1.0:1746126620.316487:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721571328 00000100:00100000:1.0:1746126620.316510:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13774 00000100:00100000:1.0:1746126620.316516:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:31411:x1830945721571328:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.316529:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.316541:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e282 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.316559:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.316564:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.316565:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.316568:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.316584:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.316593:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 13 pid: 10890 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.316602:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721411968:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.316634:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.317555:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721411840:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126620.317570:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.317929:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721571200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2270us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.317937:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7195 00000100:00100000:0.0:1746126620.319354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.319401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.319496:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721411968:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.319520:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.319535:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:1.0:1746126620.319568:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:31411:x1830945721571328:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3051us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.319575:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13774 00000100:00100000:1.0:1746126620.319602:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721571712 00000100:00100000:1.0:1746126620.319608:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721571712 00002000:00100000:1.0:1746126620.319642:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3411968->3416063) req@ffff88012d91b800 x1830945721571712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.319652:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b800 with x1830945721571712 ext(3411968->3416063) 00002000:00010000:1.0:1746126620.319657:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91b800 00000100:00100000:1.0:1746126620.319682:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7875 00000100:00100000:1.0:1746126620.319689:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721571712:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126620.319703:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721571584 00000100:00100000:2.0:1746126620.319707:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721571584 00002000:00100000:2.0:1746126620.319724:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1462271) req@ffff88012d91bb80 x1830945721571584/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.319729:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91bb80 with x1830945721571584 ext(1048576->1462271) 00010000:00010000:2.0:1746126620.319735:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 15 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.319745:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 15 pid: 10890 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746126620.319751:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d91bb80 00000100:00100000:2.0:1746126620.319770:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1800 00000100:00100000:2.0:1746126620.319775:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721571584:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126620.320985:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721571712:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 1290us (1631us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126620.320993:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7875 00002000:00100000:1.0:1746126620.321000:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3411968->3416063) req@ffff88012d91b800 x1830945721571712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.321006:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b800 with x1830945721571712 ext(3411968->3416063) 00002000:00010000:1.0:1746126620.321010:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91b800 00000100:00100000:0.0:1746126620.326345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.326653:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721571840 00000100:00100000:1.0:1746126620.326663:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721571840 00000100:00100000:1.0:1746126620.326707:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13775 00000100:00100000:1.0:1746126620.326715:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31414:x1830945721571840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.326735:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.326754:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e289 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.326782:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.326787:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.326802:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.326812:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fa00, rc 0) 00000100:00100000:1.0:1746126620.326875:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31414:x1830945721571840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 161us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.326881:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13775 00000100:00100000:3.0:1746126620.330591:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721571584:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 10803us (11176us total) trans 17179873241 rc 0/0 00000100:00100000:3.0:1746126620.330605:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1800 00002000:00100000:3.0:1746126620.330617:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1462271) req@ffff88012d91bb80 x1830945721571584/t17179873241(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.330626:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91bb80 with x1830945721571584 ext(1048576->1462271) 00010000:00010000:3.0:1746126620.330637:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.330654:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746126620.330661:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d91bb80 00000100:00100000:0.0:1746126620.334394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.334716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.334802:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721572224 00000100:00100000:2.0:1746126620.334811:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721572224 00010000:00010000:2.0:1746126620.334879:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.334909:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7196 00000100:00100000:2.0:1746126620.334918:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721572224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.334931:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126620.334950:0:7073:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126619 -> 1746126620 00010000:00010000:2.0:1746126620.334957:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.334969:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.334992:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae42200/0xb50e825867614152 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1cc expref: 17 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.335025:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.335028:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.335044:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.335053:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.335067:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.335068:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.335072:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.335078:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.335109:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.335122:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099253480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721412096:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126620.335205:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.335213:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721412224:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126620.335243:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.338664:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721572096 00000100:00100000:3.0:1746126620.338676:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721572096 00002000:00100000:3.0:1746126620.338721:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (4083712->4087807) req@ffff88008dad3480 x1830945721572096/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.338731:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3480 with x1830945721572096 ext(4083712->4087807) 00002000:00010000:3.0:1746126620.338737:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad3480 00000100:00100000:3.0:1746126620.338776:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7876 00000100:00100000:3.0:1746126620.338783:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721572096:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126620.339004:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721572096:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 219us (4621us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126620.339010:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7876 00002000:00100000:3.0:1746126620.339016:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (4083712->4087807) req@ffff88008dad3480 x1830945721572096/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.339022:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3480 with x1830945721572096 ext(4083712->4087807) 00002000:00010000:3.0:1746126620.339025:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad3480 00000100:00100000:0.0:1746126620.339810:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099253480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721412096:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126620.340208:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721412224:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126620.340238:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.340273:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721572224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5355us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.340282:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7196 00000100:00100000:0.0:1746126620.345012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.346664:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721572480 00000100:00100000:3.0:1746126620.346676:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721572480 00002000:00100000:3.0:1746126620.346730:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad0380 x1830945721572480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.346744:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0380 with x1830945721572480 ext(1048576->2097151) 00002000:00010000:3.0:1746126620.346749:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad0380 00000100:00100000:1.0:1746126620.347125:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7877 00000100:00100000:1.0:1746126620.347136:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721572480:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126620.348664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.348780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.348802:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721572736 00000100:00100000:1.0:1746126620.348809:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721572736 00002000:00100000:1.0:1746126620.349583:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad0e00 x1830945721572736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.349593:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0e00 with x1830945721572736 ext(1048576->2097151) 00002000:00010000:1.0:1746126620.349598:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad0e00 00000100:00100000:1.0:1746126620.349788:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721572864 00000100:00100000:1.0:1746126620.349792:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721572864 00000100:00100000:3.0:1746126620.349802:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7878 00002000:00100000:1.0:1746126620.349806:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a4c8d180 x1830945721572864/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746126620.349811:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721572736:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:1.0:1746126620.349812:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8d180 with x1830945721572864 ext(1048576->2097151) 00002000:00010000:1.0:1746126620.349815:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c8d180 00000100:00100000:1.0:1746126620.349845:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7879 00000100:00100000:1.0:1746126620.349850:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721572864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126620.373593:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721572480:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 26445us (28576us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126620.373607:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7877 00002000:00100000:0.0:1746126620.373620:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad0380 x1830945721572480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126620.373630:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0380 with x1830945721572480 ext(1048576->2097151) 00002000:00010000:0.0:1746126620.373636:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad0380 00000100:00100000:3.0:1746126620.375480:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721572736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25662us (26812us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126620.375489:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7878 00002000:00100000:3.0:1746126620.375498:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad0e00 x1830945721572736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.375505:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0e00 with x1830945721572736 ext(1048576->2097151) 00002000:00010000:3.0:1746126620.375511:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad0e00 00000100:00100000:1.0:1746126620.376362:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721572864:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26509us (27579us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126620.376370:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7879 00002000:00100000:1.0:1746126620.376376:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a4c8d180 x1830945721572864/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.376383:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8d180 with x1830945721572864 ext(1048576->2097151) 00002000:00010000:1.0:1746126620.376387:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c8d180 00000100:00100000:0.0:1746126620.387755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.392200:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721573248 00000100:00100000:1.0:1746126620.392215:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721573248 00002000:00100000:1.0:1746126620.392273:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dad1c00 x1830945721573248/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.392282:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1c00 with x1830945721573248 ext(2097152->3145727) 00002000:00010000:1.0:1746126620.392288:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad1c00 00000100:00100000:1.0:1746126620.392324:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7880 00000100:00100000:1.0:1746126620.392332:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721573248:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126620.392952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.393097:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721573376 00000100:00100000:0.0:1746126620.393102:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721573376 00000100:00100000:0.0:1746126620.393128:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13776 00000100:00100000:0.0:1746126620.393133:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31414:x1830945721573376:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.393143:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.393159:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e290 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.393182:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 22 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.393190:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126620.393191:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126620.393195:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.393223:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 22 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.393234:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 22 pid: 10890 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.393245:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721412352:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.393328:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.403243:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721412352:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.403277:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.403295:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e581200, rc 0) 00000100:00100000:1.0:1746126620.403354:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31414:x1830945721573376:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10219us (10402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.403364:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13776 00000100:00100000:0.0:1746126620.403889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.403969:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721573504 00000100:00100000:3.0:1746126620.403977:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721573504 00002000:00100000:3.0:1746126620.404013:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4620287) req@ffff88008dad3800 x1830945721573504/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.404022:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3800 with x1830945721573504 ext(4194304->4620287) 00010000:00010000:3.0:1746126620.404029:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.404055:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746126620.404062:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad3800 00000100:00100000:3.0:1746126620.404368:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1801 00000100:00100000:3.0:1746126620.404377:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721573504:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126620.410535:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721573248:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18193us (22780us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126620.410546:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7880 00002000:00100000:1.0:1746126620.410558:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dad1c00 x1830945721573248/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.410567:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1c00 with x1830945721573248 ext(2097152->3145727) 00010000:00010000:1.0:1746126620.410577:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.410591:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746126620.410597:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad1c00 00000100:00100000:0.0:1746126620.414220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.414526:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721573504:12345-192.168.203.2@tcp:4:cat.0 Request processed in 10148us (10636us total) trans 21474840392 rc 0/0 00000100:00100000:3.0:1746126620.414538:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1801 00002000:00100000:3.0:1746126620.414549:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4620287) req@ffff88008dad3800 x1830945721573504/t21474840392(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.414557:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3800 with x1830945721573504 ext(4194304->4620287) 00010000:00010000:3.0:1746126620.414567:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.414580:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746126620.414587:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad3800 00000100:00100000:1.0:1746126620.414667:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721573632 00000100:00100000:1.0:1746126620.414675:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721573632 00000100:00100000:1.0:1746126620.414719:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13777 00000100:00100000:1.0:1746126620.414725:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+31:31411:x1830945721573632:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.414738:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.414759:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e297 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.414784:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.414791:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.414792:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126620.414795:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 32 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.414845:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.414856:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 15 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.414866:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721412480:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.414927:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.419609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.419709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.419735:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721573888 00000100:00100000:0.0:1746126620.419740:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721573888 00000100:00100000:1.0:1746126620.419752:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721412480:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.419773:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.419782:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 32 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.419797:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c000, rc 0) 00000100:00100000:0.0:1746126620.419798:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7197 00000100:00100000:0.0:1746126620.419803:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721573888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126620.419814:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126620.419858:0:7073:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126619 -> 1746126620 00002000:00010000:0.0:1746126620.419861:0:7073:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126619 -> 1746126620 00000100:00100000:1.0:1746126620.419866:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+32:31411:x1830945721573632:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5141us (5656us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126620.419867:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.419873:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13777 00010000:00010000:0.0:1746126620.419876:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.419902:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04c00/0xb50e825867614216 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e258 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.419923:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.419925:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.419932:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.419940:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.419982:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.419994:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721412608:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126620.420028:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721573760 00000100:00100000:3.0:1746126620.420032:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721573760 00000100:00100000:1.0:1746126620.420056:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195dd80 going to sleep for 11 seconds 00002000:00100000:3.0:1746126620.420074:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3411968->4087807) req@ffff88008dad1880 x1830945721573760/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.420089:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1880 with x1830945721573760 ext(3411968->4087807) 00010000:00010000:3.0:1746126620.420095:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 16 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.420106:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 16 pid: 8437 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746126620.420115:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dad1880 00000100:00100000:3.0:1746126620.420139:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1802 00000100:00100000:3.0:1746126620.420144:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721573760:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126620.423644:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721412608:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126620.423672:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.423712:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721573888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3906us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.423723:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7197 00000100:00100000:2.0:1746126620.425571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.425641:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721574144 00000100:00100000:1.0:1746126620.425648:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721574144 00002000:00100000:1.0:1746126620.425693:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880099253480 x1830945721574144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.425702:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253480 with x1830945721574144 ext(2097152->3145727) 00002000:00010000:1.0:1746126620.425707:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253480 00000100:00100000:1.0:1746126620.425734:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7881 00000100:00100000:1.0:1746126620.425742:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721574144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126620.430274:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721573760:12345-192.168.203.2@tcp:4:cat.0 Request processed in 10117us (10664us total) trans 17179873242 rc 0/0 00000100:00100000:3.0:1746126620.430286:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1802 00002000:00100000:3.0:1746126620.430297:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3411968->4087807) req@ffff88008dad1880 x1830945721573760/t17179873242(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.430307:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1880 with x1830945721573760 ext(3411968->4087807) 00010000:00010000:3.0:1746126620.430317:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.430334:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746126620.430341:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dad1880 00000100:00100000:0.0:1746126620.433441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.433525:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721574272 00000100:00100000:2.0:1746126620.433534:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721574272 00010000:00010000:2.0:1746126620.433567:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.433594:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7198 00000100:00100000:2.0:1746126620.433600:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721574272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.433614:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126620.433637:0:7073:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126619 -> 1746126620 00002000:00010000:2.0:1746126620.433640:0:7073:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126619 -> 1746126620 00010000:00010000:2.0:1746126620.433645:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.433656:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.433660:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721574144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 7918us (8094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126620.433669:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7881 00010000:00010000:2.0:1746126620.433677:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e580400/0xb50e825867614239 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3411968->4087807) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e27b expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00002000:00100000:1.0:1746126620.433677:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880099253480 x1830945721574144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.433686:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253480 with x1830945721574144 ext(2097152->3145727) 00002000:00010000:1.0:1746126620.433689:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253480 00010000:00010000:2.0:1746126620.433695:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.433697:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.433703:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.433711:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.433741:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.433753:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721412736:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126620.433799:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.435552:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721412736:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126620.435580:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.435628:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721574272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2026us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.435638:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7198 00000100:00100000:0.0:1746126620.437368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.437456:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721574400 00000100:00100000:1.0:1746126620.437465:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721574400 00000100:00100000:1.0:1746126620.437513:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13778 00000100:00100000:1.0:1746126620.437520:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31414:x1830945721574400:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.437538:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.437554:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e29e expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.437582:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.437584:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.437595:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 18 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.437608:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 18 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.437617:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c600, rc 0) 00000100:00100000:1.0:1746126620.437696:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31414:x1830945721574400:12345-192.168.203.2@tcp:101:cat.0 Request processed in 176us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.437700:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13778 00000100:00100000:0.0:1746126620.438432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.438582:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721574656 00000100:00100000:1.0:1746126620.438587:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721574656 00002000:00100000:1.0:1746126620.438622:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dad1500 x1830945721574656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.438630:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1500 with x1830945721574656 ext(2097152->3145727) 00002000:00010000:1.0:1746126620.438634:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad1500 00000100:00100000:1.0:1746126620.438658:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7882 00000100:00100000:1.0:1746126620.438664:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721574656:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126620.446535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.448153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.449096:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721574912 00000100:00100000:3.0:1746126620.449107:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721574912 00000100:00100000:1.0:1746126620.449111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:3.0:1746126620.449154:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e3f7b80 x1830945721574912/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.449164:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7b80 with x1830945721574912 ext(2097152->3145727) 00002000:00010000:3.0:1746126620.449169:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f7b80 00000100:00100000:0.0:1746126620.450147:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721575168 00000100:00100000:0.0:1746126620.450153:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721575168 00000100:00100000:3.0:1746126620.450156:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721575424 00000100:00100000:3.0:1746126620.450158:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721575424 00002000:00100000:3.0:1746126620.450175:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e3f5c00 x1830945721575424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126620.450175:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e3f6a00 x1830945721575168/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126620.450183:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6a00 with x1830945721575168 ext(3145728->4194303) 00002000:00010000:0.0:1746126620.450187:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6a00 00002000:00100000:3.0:1746126620.450188:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5c00 with x1830945721575424 ext(3145728->4194303) 00002000:00010000:3.0:1746126620.450191:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5c00 00000100:00100000:0.0:1746126620.450201:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7883 00000100:00100000:3.0:1746126620.450204:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7884 00000100:00100000:0.0:1746126620.450207:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721574912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126620.450208:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721575168:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126620.450264:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7885 00000100:00100000:3.0:1746126620.450268:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721575424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126620.456914:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721574656:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18237us (18471us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126620.456930:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7882 00002000:00100000:1.0:1746126620.456944:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dad1500 x1830945721574656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.456954:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1500 with x1830945721574656 ext(2097152->3145727) 00002000:00010000:1.0:1746126620.456960:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad1500 00000100:00100000:0.0:1746126620.474647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.474711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.474749:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721575552 00000100:00100000:1.0:1746126620.474763:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721575552 00000100:00100000:1.0:1746126620.474814:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721575680 00000100:00100000:1.0:1746126620.474817:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721575680 00000100:00100000:0.0:1746126620.474935:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13779 00000100:00100000:0.0:1746126620.474946:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:31411:x1830945721575552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.474967:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.474988:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2a5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475015:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.475017:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.475024:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475050:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475062:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae42200, rc 0) 00000100:00100000:0.0:1746126620.475118:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:31411:x1830945721575552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 174us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.475124:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13779 00000100:00100000:0.0:1746126620.475142:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13780 00000100:00100000:0.0:1746126620.475147:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31418:x1830945721575680:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126620.475153:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.475160:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2ac expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475175:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475182:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475188:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.475189:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.475192:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->2543615] (req 2383872->2543615) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475219:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475229:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 23 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.475239:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721412864:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.475254:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721575168:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25042us (27105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.475262:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7884 00002000:00100000:2.0:1746126620.475271:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e3f6a00 x1830945721575168/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.475279:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6a00 with x1830945721575168 ext(3145728->4194303) 00002000:00010000:2.0:1746126620.475284:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6a00 00010000:00010000:0.0:1746126620.475308:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.475316:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 29 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.475324:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721412992:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.475343:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.479433:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721574912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29219us (32902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.479442:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7883 00002000:00100000:2.0:1746126620.479451:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e3f7b80 x1830945721574912/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.479458:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7b80 with x1830945721574912 ext(2097152->3145727) 00002000:00010000:2.0:1746126620.479463:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f7b80 00000100:00100000:0.0:1746126620.485918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.485949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.486021:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721412864:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.486075:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721412992:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.486108:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->2543615] (req 2383872->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.486125:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43200, rc 0) 00000100:00100000:0.0:1746126620.486162:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+29:31418:x1830945721575680:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11015us (11450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.486172:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13780 00000100:00100000:2.0:1746126620.486451:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576064 00000100:00100000:2.0:1746126620.486460:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576064 00002000:00100000:2.0:1746126620.486496:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009204f100 x1830945721576064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.486504:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f100 with x1830945721576064 ext(3145728->4194303) 00010000:00010000:2.0:1746126620.486512:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.486523:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746126620.486529:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204f100 00000100:00100000:2.0:1746126620.486550:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576192 00000100:00100000:2.0:1746126620.486552:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576192 00002000:00100000:2.0:1746126620.486561:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009204d500 x1830945721576192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.486566:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d500 with x1830945721576192 ext(3145728->4194303) 00002000:00010000:2.0:1746126620.486569:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204d500 00000100:00100000:2.0:1746126620.486579:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1803 00000100:00100000:2.0:1746126620.486584:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721576064:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126620.487656:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7886 00000100:00100000:3.0:1746126620.487668:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721576192:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126620.487794:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721575424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 37524us (38682us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126620.487801:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7885 00002000:00100000:1.0:1746126620.487808:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e3f5c00 x1830945721575424/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.487816:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5c00 with x1830945721575424 ext(3145728->4194303) 00010000:00010000:1.0:1746126620.487837:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 27 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.487849:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 27 pid: 9686 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746126620.487855:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f5c00 00000100:00100000:0.0:1746126620.501355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.502872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.503087:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576320 00000100:00100000:2.0:1746126620.503098:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576320 00000100:00100000:2.0:1746126620.503142:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13781 00000100:00100000:2.0:1746126620.503149:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31414:x1830945721576320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.503168:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.503183:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2b3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.503209:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.503211:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.503217:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.503236:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.503247:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11600, rc 0) 00000100:00100000:2.0:1746126620.505555:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31414:x1830945721576320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2394us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.505566:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13781 00000100:00100000:2.0:1746126620.505606:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576448 00000100:00100000:2.0:1746126620.505613:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576448 00010000:00010000:2.0:1746126620.505641:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 28 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.505672:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7199 00000100:00100000:2.0:1746126620.505679:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721576448:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.505692:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.505711:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 28 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.505721:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 28 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.505736:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721576192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18071us (19784us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746126620.505743:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e581200/0xb50e82586761424e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e290 expref: 28 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.505745:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7886 00002000:00100000:3.0:1746126620.505753:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009204d500 x1830945721576192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746126620.505759:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746126620.505761:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d500 with x1830945721576192 ext(3145728->4194303) 00002000:00010000:3.0:1746126620.505765:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204d500 00000100:00100000:2.0:1746126620.505781:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721576448:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.505786:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7199 00000100:00100000:2.0:1746126620.506392:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721576064:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19806us (20482us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.506399:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1803 00002000:00100000:2.0:1746126620.506404:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009204f100 x1830945721576064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.506412:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f100 with x1830945721576064 ext(3145728->4194303) 00010000:00010000:2.0:1746126620.506419:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.506430:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746126620.506436:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204f100 00000100:00100000:0.0:1746126620.513929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.513977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.514484:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576832 00000100:00100000:3.0:1746126620.514495:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576832 00000100:00100000:0.0:1746126620.514519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126620.514533:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.514564:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7200 00000100:00100000:3.0:1746126620.514571:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721576832:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.514588:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.514610:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.514621:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.514646:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae42200/0xb50e825867614263 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2a5 expref: 24 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.514667:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.514669:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.514675:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.514675:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576960 00000100:00100000:2.0:1746126620.514680:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576960 00010000:00010000:3.0:1746126620.514682:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.514702:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13782 00000100:00100000:2.0:1746126620.514707:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721576960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126620.514716:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.514727:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721413120:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126620.514727:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.514738:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd11400/0xb50e825867614278 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2ba expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.514759:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11400/0xb50e825867614278 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ba expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.514771:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11400/0xb50e825867614278 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ba expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.514796:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11400, rc 0) 00000100:00100000:3.0:1746126620.514806:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.514821:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721576960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 112us (302us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.514850:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13782 00000100:00100000:3.0:1746126620.515568:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721576704 00000100:00100000:3.0:1746126620.515573:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721576704 00002000:00100000:3.0:1746126620.515604:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009204f480 x1830945721576704/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.515619:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f480 with x1830945721576704 ext(3145728->4194303) 00002000:00010000:3.0:1746126620.515623:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204f480 00000100:00100000:3.0:1746126620.515648:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7887 00000100:00100000:3.0:1746126620.515653:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721576704:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126620.518851:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721413120:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126620.518873:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.518910:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721576832:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4340us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.518920:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7200 00000100:00100000:0.0:1746126620.520283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.521279:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721577088 00000100:00100000:3.0:1746126620.521289:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721577088 00000100:00100000:3.0:1746126620.521347:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13783 00000100:00100000:3.0:1746126620.521356:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:31411:x1830945721577088:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126620.521374:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.521392:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2c1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.521417:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.521420:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.521428:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.521442:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.521452:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921b1400, rc 0) 00000100:00100000:3.0:1746126620.521500:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:31411:x1830945721577088:12345-192.168.203.2@tcp:101:cat.0 Request processed in 145us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.521506:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13783 00000100:00100000:0.0:1746126620.526262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.527810:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721577344 00000100:00100000:2.0:1746126620.527821:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721577344 00002000:00100000:2.0:1746126620.527879:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2383872->2387967) req@ffff88009204d880 x1830945721577344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.527888:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d880 with x1830945721577344 ext(2383872->2387967) 00002000:00010000:2.0:1746126620.527894:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204d880 00000100:00100000:2.0:1746126620.527917:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7888 00000100:00100000:2.0:1746126620.527924:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721577344:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126620.529998:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721577344:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 2066us (3739us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126620.530009:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7888 00002000:00100000:2.0:1746126620.530018:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2383872->2387967) req@ffff88009204d880 x1830945721577344/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.530026:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204d880 with x1830945721577344 ext(2383872->2387967) 00002000:00010000:2.0:1746126620.530032:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204d880 00000100:00100000:0.0:1746126620.530311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.530364:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721577600 00000100:00100000:2.0:1746126620.530369:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721577600 00002000:00100000:2.0:1746126620.530395:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204ed80 x1830945721577600/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.530403:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ed80 with x1830945721577600 ext(4194304->4976639) 00002000:00010000:2.0:1746126620.530406:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204ed80 00000100:00100000:2.0:1746126620.530418:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7889 00000100:00100000:2.0:1746126620.530424:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721577600:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126620.538804:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721576704:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23136us (24871us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.538819:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7887 00002000:00100000:2.0:1746126620.538846:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009204f480 x1830945721576704/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.538856:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204f480 with x1830945721576704 ext(3145728->4194303) 00002000:00010000:2.0:1746126620.538862:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204f480 00000100:00100000:0.0:1746126620.548674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.548741:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721577856 00000100:00100000:2.0:1746126620.548750:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721577856 00000100:00100000:3.0:1746126620.549182:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721577600:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18756us (18870us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126620.549193:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7889 00002000:00100000:3.0:1746126620.549204:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204ed80 x1830945721577600/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.549214:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ed80 with x1830945721577600 ext(4194304->4976639) 00002000:00010000:3.0:1746126620.549219:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204ed80 00002000:00100000:2.0:1746126620.549306:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2539520->2543615) req@ffff88009204e300 x1830945721577856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.549313:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204e300 with x1830945721577856 ext(2539520->2543615) 00002000:00010000:2.0:1746126620.549317:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204e300 00000100:00100000:2.0:1746126620.549330:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7890 00000100:00100000:2.0:1746126620.549337:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721577856:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126620.549476:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721577856:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 139us (813us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126620.549483:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7890 00002000:00100000:2.0:1746126620.549487:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2539520->2543615) req@ffff88009204e300 x1830945721577856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.549494:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204e300 with x1830945721577856 ext(2539520->2543615) 00002000:00010000:2.0:1746126620.549497:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204e300 00000100:00100000:0.0:1746126620.553220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.553285:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721577984 00000100:00100000:2.0:1746126620.553295:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721577984 00000100:00100000:2.0:1746126620.553345:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13784 00000100:00100000:2.0:1746126620.553353:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721577984:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.553371:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.553389:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135526e00/0xb50e825867614286 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2c8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.553420:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135526e00/0xb50e825867614286 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c8 expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.553430:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135526e00/0xb50e825867614286 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c8 expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.553457:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526e00, rc 0) 00000100:00100000:2.0:1746126620.553510:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721577984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 158us (301us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.553516:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13784 00000100:00100000:0.0:1746126620.555983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.556078:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721578112 00000100:00100000:3.0:1746126620.556087:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721578112 00000100:00100000:3.0:1746126620.556303:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13785 00000100:00100000:3.0:1746126620.556312:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721578112:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126620.556329:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.556345:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093778800/0xb50e82586761428d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2cf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.556374:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093778800/0xb50e82586761428d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2cf expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.556383:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093778800/0xb50e82586761428d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2cf expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.557461:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093778800, rc 0) 00000100:00100000:3.0:1746126620.558236:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721578112:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1918us (2256us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126620.558245:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13785 00000100:00100000:0.0:1746126620.566994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.567028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.567068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.567325:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721578752 00000100:00100000:2.0:1746126620.567335:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721578752 00000100:00100000:2.0:1746126620.567379:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13786 00000100:00100000:2.0:1746126620.567386:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721578752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.567405:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.567421:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e825867614294 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2dd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.567452:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e825867614294 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2dd expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.567462:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e825867614294 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2dd expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.567474:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527e00, rc 0) 00000100:00100000:2.0:1746126620.567514:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721578752:12345-192.168.203.2@tcp:101:cat.0 Request processed in 128us (445us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.567521:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13786 00000100:00100000:1.0:1746126620.567597:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721578368 00000100:00100000:1.0:1746126620.567602:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721578368 00000100:00100000:1.0:1746126620.567627:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8992 00000100:00100000:1.0:1746126620.567632:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+241:31420:x1830945721578368:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126620.567647:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.567660:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e82586761429b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2d6 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.567750:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.567765:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.567775:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:1.0:1746126620.567786:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126620.567916:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e82586761429b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 244 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.567932:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 243 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.567940:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126620.567943:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126620.567945:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7da00, rc 0) 00000100:00100000:1.0:1746126620.567968:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+243:31420:x1830945721578368:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 335us (983us total) trans 8589943181 rc 0/0 00000100:00100000:1.0:1746126620.567973:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8992 00000100:00100000:3.0:1746126620.568147:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721578624 00000100:00100000:3.0:1746126620.568152:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721578624 00002000:00100000:3.0:1746126620.568182:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204fb80 x1830945721578624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.568190:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204fb80 with x1830945721578624 ext(4194304->4976639) 00002000:00010000:3.0:1746126620.568194:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204fb80 00000100:00100000:3.0:1746126620.568206:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7891 00000100:00100000:3.0:1746126620.568211:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721578624:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126620.578894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.579112:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721578880 00000100:00100000:2.0:1746126620.579122:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721578880 00000100:00100000:2.0:1746126620.579167:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13787 00000100:00100000:2.0:1746126620.579175:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:31420:x1830945721578880:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126620.579193:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.579210:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2e4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.579240:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.579248:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.579253:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.579255:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.579257:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1855488->1966079] (req 1855488->1966079) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.579283:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.579293:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.579303:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721413248:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.579380:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.579388:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 17 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.579394:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721413376:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.579410:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.581541:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721578624:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13319us (14501us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126620.581554:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7891 00002000:00100000:3.0:1746126620.581566:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204fb80 x1830945721578624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.581574:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204fb80 with x1830945721578624 ext(4194304->4976639) 00002000:00010000:3.0:1746126620.581580:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204fb80 00000100:00100000:2.0:1746126620.586743:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099250380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721413248:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.586760:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721413376:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.586791:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1855488->1966079] (req 1855488->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.586809:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527200, rc 0) 00000100:00100000:2.0:1746126620.586899:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:31420:x1830945721578880:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7724us (8016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.586909:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13787 00000100:00100000:0.0:1746126620.587318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.588069:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579008 00000100:00100000:2.0:1746126620.588077:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579008 00010000:00010000:2.0:1746126620.588105:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.588128:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7201 00000100:00100000:2.0:1746126620.588134:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721579008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.588146:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.588168:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.588179:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.588203:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e581e00/0xb50e825867614208 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e24a expref: 33 pid: 8438 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.588233:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.588259:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721579008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 125us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.588265:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7201 00000100:00100000:2.0:1746126620.588294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.588307:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579264 00000100:00100000:2.0:1746126620.588310:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579264 00000100:00100000:2.0:1746126620.588325:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13788 00000100:00100000:2.0:1746126620.588329:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721579264:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.588342:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.588351:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527c00/0xb50e8258676142b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2eb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.588368:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.588374:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527c00/0xb50e8258676142b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2eb expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.588382:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527c00/0xb50e8258676142b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2eb expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.588389:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527c00, rc 0) 00000100:00100000:2.0:1746126620.588403:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721579264:12345-192.168.203.2@tcp:101:cat.0 Request processed in 73us (109us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.588407:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13788 00000100:00100000:2.0:1746126620.588441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.588451:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579392 00000100:00100000:2.0:1746126620.588454:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579392 00000100:00100000:1.0:1746126620.588739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.588761:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579136 00000100:00100000:1.0:1746126620.588764:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579136 00010000:00010000:1.0:1746126620.588777:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.588793:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7202 00000100:00100000:1.0:1746126620.588798:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721579136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.588804:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.588812:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.588821:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.588997:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebbae00/0xb50e8258676141c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e220 expref: 18 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.589008:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.589010:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.589015:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.589022:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.589060:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.589071:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721413504:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126620.589115:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.589134:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13789 00000100:00100000:1.0:1746126620.589140:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721579392:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.589148:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.589157:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e8258676142be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2f2 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.589172:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e8258676142be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2f2 expref: 28 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.589180:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e8258676142be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2f2 expref: 28 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.589188:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7d000, rc 0) 00000100:00100000:1.0:1746126620.589202:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721579392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 63us (761us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126620.589208:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13789 00000100:00100000:0.0:1746126620.592267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.592280:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721413504:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126620.592301:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.592306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.592346:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721579136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3546us (3605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.592356:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7202 00000100:00100000:2.0:1746126620.592366:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579520 00000100:00100000:2.0:1746126620.592374:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579520 00000100:00100000:2.0:1746126620.592411:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13790 00000100:00100000:2.0:1746126620.592418:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721579520:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.592434:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.592450:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527a00/0xb50e8258676142c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e2f9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.592497:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721413632:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126620.592545:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.594019:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579776 00000100:00100000:3.0:1746126620.594026:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579776 00002000:00100000:3.0:1746126620.594076:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1855488->1859583) req@ffff88008dad3b80 x1830945721579776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.594085:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3b80 with x1830945721579776 ext(1855488->1859583) 00002000:00010000:3.0:1746126620.594090:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad3b80 00000100:00100000:1.0:1746126620.594450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.594610:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7892 00000100:00100000:3.0:1746126620.594618:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721579776:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126620.595029:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721579776:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 410us (2720us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126620.595046:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7892 00002000:00100000:3.0:1746126620.595053:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1855488->1859583) req@ffff88008dad3b80 x1830945721579776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.595061:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3b80 with x1830945721579776 ext(1855488->1859583) 00002000:00010000:3.0:1746126620.595064:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad3b80 00000100:00100000:0.0:1746126620.595860:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721579904 00000100:00100000:0.0:1746126620.595867:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721579904 00000100:00100000:0.0:1746126620.595910:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13791 00000100:00100000:0.0:1746126620.595916:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721579904:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.595928:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.595943:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c2fc00/0xb50e8258676142cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e300 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.595970:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c2fc00/0xb50e8258676142cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e300 expref: 28 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.595981:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c2fc00/0xb50e8258676142cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e300 expref: 28 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.595999:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2fc00, rc 0) 00000100:00100000:0.0:1746126620.596026:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721579904:12345-192.168.203.2@tcp:101:cat.0 Request processed in 110us (1577us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126620.596031:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13791 00002000:00010000:3.0:1746126620.596358:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126619 -> 1746126620 00002000:00010000:3.0:1746126620.596361:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126619 -> 1746126620 00002000:00010000:3.0:1746126620.596363:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126619 -> 1746126620 00000100:00100000:3.0:1746126620.596379:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721413632:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126620.596403:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527a00/0xb50e8258676142c5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2f9 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.596413:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527a00/0xb50e8258676142c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2f9 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.596425:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527a00, rc 0) 00000100:00100000:3.0:1746126620.596756:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721579520:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4337us (4504us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126620.596763:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13790 00000100:00100000:0.0:1746126620.598547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.598734:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721580032 00000100:00100000:2.0:1746126620.598741:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721580032 00000100:00100000:1.0:1746126620.599197:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8993 00000100:00100000:1.0:1746126620.599209:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31423:x1830945721580032:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126620.599235:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.599253:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e8258676142d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e307 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.599309:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.599321:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126620.600509:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126620.600787:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.600809:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.600818:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.600824:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.600937:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.600947:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 23 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.600953:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 242 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.600959:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.600990:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 242 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.601005:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 242 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.601015:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721413760:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.601102:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 23 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.601109:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 23 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.601115:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721413888:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.601128:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.601168:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721580288 00000100:00100000:3.0:1746126620.601175:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721580288 00002000:00100000:3.0:1746126620.601211:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1961984->1966079) req@ffff88009bb2ca80 x1830945721580288/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.601220:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830945721580288 ext(1961984->1966079) 00002000:00010000:3.0:1746126620.601224:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ca80 00000100:00100000:3.0:1746126620.601246:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7893 00000100:00100000:3.0:1746126620.601253:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721580288:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126620.601380:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721580288:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 126us (873us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126620.601385:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7893 00002000:00100000:3.0:1746126620.601390:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1961984->1966079) req@ffff88009bb2ca80 x1830945721580288/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/4536 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.601397:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830945721580288 ext(1961984->1966079) 00002000:00010000:3.0:1746126620.601400:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ca80 00000100:00100000:1.0:1746126620.603294:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721413760:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.603308:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721413888:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.603331:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:2.0:1746126620.604725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.604783:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721580416 00000100:00100000:1.0:1746126620.604790:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721580416 00010000:00010000:1.0:1746126620.604820:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 243 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.604864:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7203 00000100:00100000:1.0:1746126620.604870:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+243:1964:x1830945721580416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.604882:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.604888:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 243 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.604898:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 243 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.604917:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7da00/0xb50e8258676142a2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2d6 expref: 243 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.604933:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126620.604937:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.604945:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.604949:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.604953:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.604986:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+242:1964:x1830945721580416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.604991:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7203 00000100:00100000:1.0:1746126620.605511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.605548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.605604:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721580672 00000100:00100000:3.0:1746126620.605609:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721580672 00000100:00100000:3.0:1746126620.605632:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721580928 00000100:00100000:3.0:1746126620.605634:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721580928 00000100:00100000:3.0:1746126620.605645:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3813 00000100:00100000:3.0:1746126620.605650:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:26822:x1830945721580672:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746126620.605847:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3814 00000100:00100000:2.0:1746126620.605855:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+242:31420:x1830945721580928:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126620.606375:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:26822:x1830945721580672:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 721us (861us total) trans 8589943182 rc 0/0 00000100:00100000:3.0:1746126620.606381:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3813 00000100:00100000:2.0:1746126620.606590:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+243:31420:x1830945721580928:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 735us (1041us total) trans 8589943183 rc 0/0 00000100:00100000:2.0:1746126620.606595:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3814 00000100:00100000:0.0:1746126620.609996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.610500:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581056 00000100:00100000:2.0:1746126620.610510:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581056 00010000:00010000:2.0:1746126620.610549:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 25 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.610642:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7204 00000100:00100000:2.0:1746126620.610653:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721581056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.610670:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.610676:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 25 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.610687:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 25 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.610709:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098df5e00/0xb50e8258676141e5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e22e expref: 25 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.610724:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.610728:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.610737:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.610744:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.610878:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126620.610982:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.610989:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:0.0:1746126620.611030:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126620.611044:0:15560:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126620.611060:0:15560:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611074:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611084:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611089:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611095:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611101:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7d000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126620.611105:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611111:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611120:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126620.611123:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126620.611126:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611131:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d000/0xb50e8258676142da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611160:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611165:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611170:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611174:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7ce00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126620.611176:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611181:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611187:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009eb53700) 00010000:00010000:0.0:1746126620.611188:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126620.611191:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611194:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ce00/0xb50e8258676142e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.611230:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e8258676142d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 17 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.611243:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 16 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.611249:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126620.611251:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126620.611253:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7cc00, rc 0) 00000100:00100000:2.0:1746126620.611293:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721581056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 639us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.611300:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7204 00000100:00100000:0.0:1746126620.612401:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:31423:x1830945721580032:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13192us (13853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.612409:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8993 00000100:00100000:0.0:1746126620.616002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.616045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.616063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.616088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.616149:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581184 00000100:00100000:3.0:1746126620.616158:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581184 00000100:00100000:3.0:1746126620.616196:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581440 00000100:00100000:2.0:1746126620.616222:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581312 00000100:00100000:2.0:1746126620.616229:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581312 00000100:00100000:2.0:1746126620.616249:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581568 00000100:00100000:2.0:1746126620.616251:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581568 00000100:00100000:2.0:1746126620.616265:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13792 00000100:00100000:2.0:1746126620.616273:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721581184:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:1.0:1746126620.616458:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13793 00000100:00100000:1.0:1746126620.616475:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721581312:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126620.616492:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.616508:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.616508:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e315 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.616523:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e30e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.616536:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.616538:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.616543:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.616544:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.616546:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 7 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.616552:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.616566:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.616567:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 7 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.616577:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527e00, rc 0) 00010000:00010000:1.0:1746126620.616578:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7da00, rc 0) 00000100:00100000:3.0:1746126620.616612:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581440 00000100:00100000:3.0:1746126620.616788:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13794 00000100:00100000:3.0:1746126620.616796:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721581568:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:2.0:1746126620.616907:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721581184:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 633us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.616914:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13792 00000100:00100000:0.0:1746126620.616925:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13795 00000100:00100000:0.0:1746126620.616932:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721581440:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126620.616935:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.616940:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.616943:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676142fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e323 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.616948:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c2e600/0xb50e825867614304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e31c expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.616966:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676142fd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e323 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.616974:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676142fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e323 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.616984:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1e00, rc 0) 00000100:00100000:3.0:1746126620.617005:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721581568:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 211us (917us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126620.617009:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721581312:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 540us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.617011:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13794 00000100:00100000:1.0:1746126620.617016:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13793 00000100:00100000:0.0:1746126620.617147:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721414016:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126620.617889:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.617985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.618052:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581696 00000100:00100000:1.0:1746126620.618058:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581696 00000100:00100000:1.0:1746126620.618083:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13796 00000100:00100000:1.0:1746126620.618087:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721581696:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126620.618095:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.618103:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e32a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.618116:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.618117:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.618122:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.618132:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.618149:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c400, rc 0) 00000100:00100000:1.0:1746126620.618170:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721581696:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.618175:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13796 00000100:00100000:2.0:1746126620.621457:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721414016:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.621486:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c2e600/0xb50e825867614304 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e31c expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.621498:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c2e600/0xb50e825867614304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e31c expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.621504:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2e600, rc 0) 00000100:00100000:2.0:1746126620.621587:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721581440:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 4654us (5548us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.621597:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13795 00000100:00100000:0.0:1746126620.623761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.623886:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721581952 00000100:00100000:2.0:1746126620.623897:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721581952 00000100:00100000:2.0:1746126620.623946:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8994 00000100:00100000:2.0:1746126620.623953:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:31423:x1830945721581952:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.623974:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.623995:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135526c00/0xb50e825867614312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e331 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.624111:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.624125:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 17 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.624131:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.624161:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 17 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.624171:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 17 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.624182:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099253100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721414144:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.624265:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.625886:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099253100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721414144:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.625907:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126620.626411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.627065:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582080 00000100:00100000:2.0:1746126620.627071:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582080 00010000:00010000:2.0:1746126620.627097:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 18 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.627336:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7205 00000100:00100000:2.0:1746126620.627344:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945721582080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.627358:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.627364:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 18 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.627376:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 18 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.627396:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e8258676142e8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e307 expref: 18 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.627410:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.627415:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.627423:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.627429:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.627459:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126620.627668:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.627679:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126620.627697:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126620.627814:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526c00/0xb50e825867614312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 19 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.627851:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 18 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.627859:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.627861:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126620.627864:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526e00, rc 0) 00000100:00100000:2.0:1746126620.628025:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+18:1963:x1830945721582080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 679us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.628044:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7205 00000100:00100000:3.0:1746126620.628129:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:31423:x1830945721581952:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 4174us (4375us total) trans 8589943184 rc 0/0 00000100:00100000:3.0:1746126620.628137:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8994 00000100:00100000:0.0:1746126620.631365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.631531:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582208 00000100:00100000:3.0:1746126620.631541:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582208 00000100:00100000:3.0:1746126620.631588:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8995 00000100:00100000:3.0:1746126620.631595:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:31423:x1830945721582208:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126620.631622:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.631640:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1c00/0xb50e825867614327 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e338 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.631698:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.631709:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 18 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.631715:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.631739:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 18 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.631749:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 18 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.631758:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721414272:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.631856:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.636660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.636753:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582336 00000100:00100000:2.0:1746126620.636761:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582336 00010000:00010000:2.0:1746126620.636788:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 19 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.636851:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7206 00000100:00100000:2.0:1746126620.636860:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1964:x1830945721582336:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.636871:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.636876:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 19 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.636887:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 19 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.636904:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.636908:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.636916:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.636922:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.636936:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.636969:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:1964:x1830945721582336:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.636976:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7206 00010000:00010000:3.0:1746126620.637347:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526e00/0xb50e825867614319 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e331 expref: 18 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.637364:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721414272:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.637378:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.637384:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.637389:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126620.637418:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126620.637422:0:15560:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126620.637434:0:15560:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.637458:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1c00/0xb50e825867614327 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e338 expref: 18 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.637469:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e338 expref: 17 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.637474:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.637477:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126620.637479:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1400, rc 0) 00000100:00100000:3.0:1746126620.637505:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:31423:x1830945721582208:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5909us (6149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.637510:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8995 00000100:00100000:0.0:1746126620.640012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.640300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.640872:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582464 00000100:00100000:2.0:1746126620.640880:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582464 00000100:00100000:2.0:1746126620.640918:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582592 00000100:00100000:2.0:1746126620.640921:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582592 00000100:00100000:2.0:1746126620.642149:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13797 00000100:00100000:2.0:1746126620.642159:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721582464:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.642172:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.642185:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527c00/0xb50e825867614335 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e33f expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.642229:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099253100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721414400:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126620.642292:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126620.642453:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13798 00000100:00100000:1.0:1746126620.642565:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721582592:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126620.642574:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.642584:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e82586761433c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e346 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.642602:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e82586761433c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e346 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.642610:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e82586761433c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e346 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.642634:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7ca00, rc 0) 00000100:00100000:1.0:1746126620.642661:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721582592:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 201us (2361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126620.642667:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13798 00000100:00100000:2.0:1746126620.647914:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099253100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721414400:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126620.647942:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527c00/0xb50e825867614335 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e33f expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.647954:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527c00/0xb50e825867614335 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e33f expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.647978:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527c00, rc 0) 00000100:00100000:2.0:1746126620.648027:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721582464:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 5870us (8019us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126620.648043:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13797 00000100:00100000:0.0:1746126620.652679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.652772:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582848 00000100:00100000:3.0:1746126620.652782:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582848 00000100:00100000:3.0:1746126620.652856:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8996 00000100:00100000:3.0:1746126620.652863:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:31423:x1830945721582848:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126620.652879:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.652894:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e825867614343 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e34d expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.652976:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.652988:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126620.652996:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126620.653005:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126620.653105:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e825867614343 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 20 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.653563:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 19 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.653570:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.653572:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126620.653574:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1800, rc 0) 00000100:00100000:3.0:1746126620.653629:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:31423:x1830945721582848:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 765us (958us total) trans 8589943185 rc 0/0 00000100:00100000:3.0:1746126620.653635:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8996 00000100:00100000:0.0:1746126620.657371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.657397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.657417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.658225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.658455:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721582976 00000100:00100000:3.0:1746126620.658462:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721582976 00000100:00100000:3.0:1746126620.658493:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583104 00000100:00100000:3.0:1746126620.658495:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583104 00000100:00100000:2.0:1746126620.658503:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583360 00000100:00100000:3.0:1746126620.658511:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583616 00000100:00100000:3.0:1746126620.658512:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583616 00000100:00100000:2.0:1746126620.658516:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583360 00000100:00100000:3.0:1746126620.658524:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13799 00000100:00100000:3.0:1746126620.658530:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721582976:12345-192.168.203.2@tcp:1:lfs.0 00000100:00100000:2.0:1746126620.658541:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13800 00000100:00100000:2.0:1746126620.658551:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721583104:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126620.658561:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.658576:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.658583:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.658588:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.658589:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.658594:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.658595:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.658598:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.658604:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.658612:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.658619:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.658620:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 26 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.658625:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.658627:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.658629:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.658630:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 26 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.658646:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721414528:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.658654:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.658664:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 16 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.658675:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099253100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721414656:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.659447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126620.659852:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.659861:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.659862:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 8 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746126620.659871:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721414784:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.659876:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 9 pid: 20294 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.659886:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721414912:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.659893:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.659900:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 23 pid: 10890 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.659907:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721415040:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.659919:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.659920:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746126620.659928:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.659935:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721415168:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.659937:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583232 00000100:00100000:3.0:1746126620.659941:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583232 00000100:00100000:2.0:1746126620.659956:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.659962:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13801 00000100:00100000:3.0:1746126620.659967:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721583616:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126620.659985:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.659996:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.660002:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13802 00010000:00010000:3.0:1746126620.660003:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.660009:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.660009:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721583232:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126620.660015:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.660016:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.660018:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.660031:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 16 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.660031:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.660048:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 16 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.660052:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.660056:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721415296:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.660058:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126620.660059:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126620.660061:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.660083:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.660087:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.660090:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 31 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.660095:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.660099:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721415424:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.660102:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721415552:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.660118:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.660130:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13803 00000100:00100000:2.0:1746126620.660135:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721583360:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:2.0:1746126620.660151:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.660161:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.660167:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.660174:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.660178:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.660178:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.660180:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.660195:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.660202:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 23 pid: 8436 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126620.660210:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721415680:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.662824:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 31 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.662861:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 31 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.662879:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721415808:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126620.662907:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.663366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.663385:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583488 00000100:00100000:0.0:1746126620.663390:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583488 00010000:00010000:2.0:1746126620.663397:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.663415:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126620.663417:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13804 00000100:00100000:0.0:1746126620.663428:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721583488:12345-192.168.203.2@tcp:1:lfs.0 00000100:00100000:2.0:1746126620.663432:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721415936:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.663460:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663472:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663478:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663484:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663489:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746126620.663493:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746126620.663495:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663496:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.663504:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.663512:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721416064:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.663512:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663519:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.663526:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.663528:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721416192:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.663552:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663563:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.663583:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721416320:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.663596:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.663602:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.663608:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721416448:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.663615:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.676599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.676623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.676637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.676675:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099253100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721414656:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.676727:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583744 00000100:00100000:1.0:1746126620.676733:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583744 00010000:00010000:1.0:1746126620.676761:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 17 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.676787:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584000 00000100:00100000:1.0:1746126620.676789:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584000 00010000:00010000:1.0:1746126620.676798:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 11 pid: 20294 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126620.676808:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721583872 00000100:00100000:1.0:1746126620.676810:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721583872 00010000:00010000:1.0:1746126620.676819:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 10 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126620.676857:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7207 00000100:00100000:1.0:1746126620.676863:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721583744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.676873:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.676891:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 17 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.676899:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 17 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.676917:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614247 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e289 expref: 17 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.676932:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.677008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.677059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.677071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.677083:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721414912:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.677108:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584128 00000100:00100000:2.0:1746126620.677113:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584128 00000100:00100000:0.0:1746126620.677115:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721415680:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.677129:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584384 00000100:00100000:0.0:1746126620.677132:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584384 00010000:00010000:2.0:1746126620.677141:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00002000:00100000:0.0:1746126620.677155:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1855488->1966079) req@ffff8800a5b69880 x1830945721584384/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746126620.677157:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584256 00000100:00100000:2.0:1746126620.677159:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584256 00002000:00100000:0.0:1746126620.677164:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69880 with x1830945721584384 ext(1855488->1966079) 00010000:00010000:2.0:1746126620.677168:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 17 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.677169:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 32 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.677178:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 32 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.677180:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7208 00002000:00010000:0.0:1746126620.677183:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b69880 00000100:00100000:2.0:1746126620.677186:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1965:x1830945721584000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.677196:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126620.677196:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1804 00000100:00100000:0.0:1746126620.677201:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721584384:12345-192.168.203.2@tcp:4:multiop.0 00010000:00010000:2.0:1746126620.677212:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 11 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.677221:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 11 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.677238:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7da00/0xb50e8258676142ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e315 expref: 11 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.677266:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.677307:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721584000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.677313:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7208 00000100:00100000:2.0:1746126620.677328:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7209 00000100:00100000:2.0:1746126620.677333:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721583872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.677339:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.677352:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 10 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.677359:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 10 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126620.677371:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.677383:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721583872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 50us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.677387:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7209 00000100:00100000:2.0:1746126620.677394:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7210 00000100:00100000:2.0:1746126620.677397:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721584128:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.677402:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.677406:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.677413:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 24 pid: 10890 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.677420:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.677432:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721584128:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 34us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.677436:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7210 00000100:00100000:2.0:1746126620.677447:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7211 00000100:00100000:2.0:1746126620.677452:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721584256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.677456:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.677463:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 17 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.677467:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721416192:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.677470:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 17 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.677478:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.677481:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721415936:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.677488:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721584256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 36us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.677488:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721416064:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.677492:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7211 00010000:00010000:0.0:1746126620.677510:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.677517:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721415424:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.677533:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.677547:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721416320:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.677559:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721415168:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.677575:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.677623:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e82586761425c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e29e expref: 16 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.677633:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721415296:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.677633:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721416448:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126620.677642:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721415552:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.677647:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.677650:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721415808:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126620.677666:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.678402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.678422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.678512:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584640 00000100:00100000:0.0:1746126620.678515:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584640 00010000:00010000:0.0:1746126620.678530:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 34 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.678543:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584512 00000100:00100000:0.0:1746126620.678545:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584512 00010000:00010000:0.0:1746126620.678552:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126620.678561:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7212 00000100:00100000:0.0:1746126620.678566:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721584640:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126620.678575:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126620.678586:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 34 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.678594:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 34 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.678607:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c000/0xb50e825867614255 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e297 expref: 34 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.678621:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.678715:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721414528:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.678724:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135527e00/0xb50e8258676142f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e30e expref: 9 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746126620.678736:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721414784:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.678744:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a04a00/0xb50e82586761420f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e251 expref: 23 pid: 10890 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.678749:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721415040:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126620.678762:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.678803:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721584640:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 236us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.678809:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7212 00000100:00100000:0.0:1746126620.678822:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7213 00000100:00100000:0.0:1746126620.678838:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721584512:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126620.678845:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126620.678852:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746126620.678859:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746126620.678868:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c400/0xb50e82586761430b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e32a expref: 10 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746126620.678876:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.678877:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.678881:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.678886:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.678985:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721583744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2122us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.678992:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7207 00010000:00010000:0.0:1746126620.679355:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126620.679441:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679449:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679471:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679477:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679483:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679488:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a0000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126620.679491:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679497:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679507:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.679512:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e825867614366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.679764:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721584512:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 935us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.679771:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7213 00000100:00100000:3.0:1746126620.679798:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721583616:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 19831us (21574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.679806:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13801 00000100:00100000:0.0:1746126620.687217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.687316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.687928:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721584384:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 10724us (10853us total) trans 17179873243 rc 0/0 00000100:00100000:1.0:1746126620.687938:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1804 00002000:00100000:1.0:1746126620.687947:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1855488->1966079) req@ffff8800a5b69880 x1830945721584384/t17179873243(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.687959:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b69880 with x1830945721584384 ext(1855488->1966079) 00010000:00010000:1.0:1746126620.687971:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 33 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.687981:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 33 pid: 8437 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746126620.687988:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b69880 00000100:00100000:1.0:1746126620.690973:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584896 00000100:00100000:1.0:1746126620.690984:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584896 00010000:00010000:1.0:1746126620.691015:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126620.691052:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585152 00000100:00100000:1.0:1746126620.691054:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585152 00010000:00010000:1.0:1746126620.691065:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 27 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.691092:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7214 00000100:00100000:1.0:1746126620.691098:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721584896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.691109:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.691127:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.691136:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.691151:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d8e0a00/0xb50e82586761416e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e1e8 expref: 9 pid: 4640 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.691173:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.691215:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721584896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 117us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.691220:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7214 00000100:00100000:1.0:1746126620.691263:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7215 00000100:00100000:1.0:1746126620.691267:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721585152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.691272:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.691280:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 27 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691286:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 27 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691295:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e580a00/0xb50e8258676140bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e14e expref: 27 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691302:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.691314:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721585152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 47us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.691320:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7215 00000100:00100000:1.0:1746126620.691359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.691373:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721584768 00000100:00100000:1.0:1746126620.691376:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721584768 00010000:00010000:1.0:1746126620.691386:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 33 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.691398:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7216 00000100:00100000:1.0:1746126620.691402:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721584768:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.691407:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.691417:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 33 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691424:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 33 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691434:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e282 expref: 33 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691442:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.691443:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.691447:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.691453:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.691475:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.691488:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721584768:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 86us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.691493:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7216 00000100:00100000:1.0:1746126620.691537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.691546:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585024 00000100:00100000:1.0:1746126620.691548:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585024 00010000:00010000:1.0:1746126620.691558:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.691571:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7217 00000100:00100000:1.0:1746126620.691575:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721585024:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.691579:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.691589:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691596:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691606:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1400/0xb50e82586761427f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2c1 expref: 23 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691614:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.691628:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721585024:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 53us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.691636:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7217 00000100:00100000:1.0:1746126620.691670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.691689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.691699:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585408 00000100:00100000:1.0:1746126620.691701:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585408 00010000:00010000:1.0:1746126620.691710:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.691722:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7218 00000100:00100000:1.0:1746126620.691726:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721585408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.691731:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.691738:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691744:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691753:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11600/0xb50e825867614271 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2b3 expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691763:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.691777:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721585408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 51us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.691781:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7218 00000100:00100000:1.0:1746126620.691796:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585280 00000100:00100000:1.0:1746126620.691799:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585280 00002000:00100000:1.0:1746126620.691815:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2383872->2543615) req@ffff88009e3f4a80 x1830945721585280/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.691823:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4a80 with x1830945721585280 ext(2383872->2543615) 00010000:00010000:1.0:1746126620.691858:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 25 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.691866:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 25 pid: 8436 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746126620.691872:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f4a80 00000100:00100000:1.0:1746126620.691884:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1805 00000100:00100000:1.0:1746126620.691888:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721585280:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126620.692085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.692098:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585536 00000100:00100000:1.0:1746126620.692101:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585536 00010000:00010000:1.0:1746126620.692110:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 22 pid: 8436 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126620.692122:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7219 00000100:00100000:1.0:1746126620.692126:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721585536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.692132:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.692140:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 22 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.692146:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 22 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.692160:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e580200/0xb50e8258676140f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e186 expref: 22 pid: 8436 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126620.692167:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.692168:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.692171:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.692177:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.692189:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.692203:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721585536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 76us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.692207:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7219 00010000:00010000:0.0:1746126620.693305:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693314:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693335:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693341:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693347:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693352:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921b1200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126620.693355:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693361:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693370:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.693375:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1200/0xb50e825867614374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.693417:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721583360:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 33280us (35998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.693423:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13803 00000100:00100000:0.0:1746126620.695085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.695106:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585664 00000100:00100000:0.0:1746126620.695112:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585664 00010000:00010000:0.0:1746126620.695136:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 27 pid: 9686 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.695154:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7220 00000100:00100000:0.0:1746126620.695159:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721585664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126620.695169:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126620.695182:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 27 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.695191:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 27 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.695205:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135526a00/0xb50e825867614232 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e274 expref: 27 pid: 9686 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.695215:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.695216:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.695219:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.695225:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.695242:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.695263:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721585664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 104us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.695270:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7220 00000100:00100000:0.0:1746126620.695844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.695859:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585792 00000100:00100000:0.0:1746126620.695862:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585792 00010000:00010000:0.0:1746126620.695874:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 32 pid: 8437 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.695889:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7221 00000100:00100000:0.0:1746126620.695894:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721585792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126620.695900:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126620.695910:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 32 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.695918:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 32 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.695930:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527200/0xb50e8258676142b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->1966079) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2e4 expref: 32 pid: 8437 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.695938:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.695939:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.695942:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.695947:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.695964:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.695978:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721585792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.695983:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7221 00010000:00010000:0.0:1746126620.696018:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696025:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696050:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696057:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696063:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696068:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921b1e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126620.696071:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696077:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696090:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.696094:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921b1e00/0xb50e82586761436d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.696128:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721583232:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 36119us (36683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.696134:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13802 00010000:00010000:2.0:1746126620.696552:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696559:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696572:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696576:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696581:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696586:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135526400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126620.696588:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696593:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696601:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696606:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761435f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.696637:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721583104:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 38089us (39239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.696643:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13800 00010000:00010000:2.0:1746126620.696839:0:4640:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696846:0:4640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696861:0:4640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696867:0:4640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696872:0:4640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696876:0:4640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a1000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126620.696878:0:4640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696882:0:4640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696891:0:4640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.696896:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.696924:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721582976:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 38395us (39559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.696929:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13799 00000100:00100000:2.0:1746126620.703573:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721585280:12345-192.168.203.2@tcp:4:cat.0 Request processed in 11675us (11892us total) trans 21474840393 rc 0/0 00000100:00100000:2.0:1746126620.703585:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1805 00002000:00100000:2.0:1746126620.703595:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2383872->2543615) req@ffff88009e3f4a80 x1830945721585280/t21474840393(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:381/0 lens 488/448 e 0 to 0 dl 1746126631 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.703603:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4a80 with x1830945721585280 ext(2383872->2543615) 00010000:00010000:2.0:1746126620.703614:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.703626:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746126620.703632:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f4a80 00000100:00100000:0.0:1746126620.707568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.707713:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721585920 00000100:00100000:1.0:1746126620.707721:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721585920 00010000:00010000:1.0:1746126620.707750:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.707783:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7222 00000100:00100000:1.0:1746126620.707789:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721585920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.707801:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126620.707816:0:9817:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126619 -> 1746126620 00010000:00010000:1.0:1746126620.707821:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.707873:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.707891:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae43200/0xb50e82586761426a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2383872->3145727] (req 2383872->2543615) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e2ac expref: 26 pid: 8436 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.707913:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.707915:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.707918:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.707925:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.707946:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.707983:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721585920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 193us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.707989:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7222 00010000:00010000:0.0:1746126620.708209:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708217:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708235:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708241:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708246:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708252:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2ee00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126620.708256:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708262:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708271:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.708276:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e82586761437b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126620.708315:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1963:x1830945721583488:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 44892us (44949us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.708322:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13804 00000100:00100000:2.0:1746126620.712557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.712593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.712815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.712996:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586048 00000100:00100000:2.0:1746126620.713003:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586048 00000100:00100000:2.0:1746126620.713031:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586176 00000100:00100000:2.0:1746126620.713033:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586176 00000100:00100000:2.0:1746126620.713055:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586304 00000100:00100000:2.0:1746126620.713057:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586304 00000100:00100000:2.0:1746126620.713068:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13805 00000100:00100000:2.0:1746126620.713074:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721586048:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.713088:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.713103:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e354 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126620.713122:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c71b, atime: 0x6813c71b, ctime: 0x6813c71b, blocks: 0x79f 00010000:00010000:2.0:1746126620.713137:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.713138:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.713145:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.713156:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.713165:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11800, rc 0) 00000100:00100000:2.0:1746126620.713198:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721586048:12345-192.168.203.2@tcp:101:cat.0 Request processed in 124us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.713203:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13805 00000100:00100000:0.0:1746126620.713513:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13806 00000100:00100000:0.0:1746126620.713530:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721586176:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.713538:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.713548:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e35b expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126620.713562:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71b, ctime: 0x6813c71b, blocks: 0x81f 00010000:00010000:0.0:1746126620.713572:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.713573:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.713578:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 33 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.713590:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 33 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.713596:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2ec00, rc 0) 00000100:00100000:0.0:1746126620.713614:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721586176:12345-192.168.203.2@tcp:101:cat.0 Request processed in 94us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.713618:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13806 00000100:00100000:1.0:1746126620.713658:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13807 00000100:00100000:1.0:1746126620.713665:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721586304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.713670:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.713677:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e362 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126620.713687:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71b, ctime: 0x6813c71c, blocks: 0x821 00010000:00010000:1.0:1746126620.713695:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.713697:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.713701:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 34 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.713709:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 34 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.713714:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7d800, rc 0) 00000100:00100000:1.0:1746126620.713729:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721586304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 66us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.713733:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13807 00000100:00100000:2.0:1746126620.714062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.714415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.714438:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586432 00000100:00100000:0.0:1746126620.714441:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586432 00000100:00100000:1.0:1746126620.714526:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13808 00000100:00100000:1.0:1746126620.714532:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721586432:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126620.714540:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.714551:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e369 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126620.714563:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c71b, atime: 0x6813c71a, ctime: 0x6813c71b, blocks: 0x81d 00010000:00010000:1.0:1746126620.714571:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.714572:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.714576:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 23 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.714585:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 23 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.714591:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c000, rc 0) 00000100:00100000:1.0:1746126620.714610:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721586432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 78us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.714614:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13808 00000100:00100000:0.0:1746126620.714993:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586560 00000100:00100000:0.0:1746126620.714997:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586560 00000100:00100000:0.0:1746126620.715016:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13809 00000100:00100000:0.0:1746126620.715020:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721586560:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.715027:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.715044:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e370 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126620.715055:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c71c, atime: 0x6813c71c, ctime: 0x6813c71c, blocks: 0x163d 00010000:00010000:0.0:1746126620.715062:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.715063:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.715067:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.715076:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.715086:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2e000, rc 0) 00000100:00100000:0.0:1746126620.715102:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721586560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 82us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.715107:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13809 00000100:00100000:1.0:1746126620.715309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.715382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.715397:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586944 00000100:00100000:1.0:1746126620.715400:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586944 00000100:00100000:1.0:1746126620.715419:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8997 00000100:00100000:1.0:1746126620.715423:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+19:31423:x1830945721586944:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:1.0:1746126620.715453:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746126620.715469:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1400/0xb50e82586761432e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e338 expref: 19 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715483:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65c00/0xb50e825867614025 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e0d7 expref: 18 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715491:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126620.715495:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126620.715512:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.715521:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715527:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 242 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715533:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715543:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715549:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 242 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715554:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.715574:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 242 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715583:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 242 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.715594:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416576:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.715642:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715650:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 23 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.715657:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416704:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.715675:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715681:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 23 pid: 14549 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.715688:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416832:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.715703:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 242 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715710:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 242 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.715716:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416960:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.715733:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.715740:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.715746:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721417088:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.715756:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126620.717088:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721586688 00000100:00100000:2.0:1746126620.717095:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721586688 00000100:00100000:2.0:1746126620.717127:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13810 00000100:00100000:2.0:1746126620.717132:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721586688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.717141:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.717153:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e377 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126620.717169:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c71c, atime: 0x6813c71b, ctime: 0x6813c71c, blocks: 0x102b 00010000:00010000:2.0:1746126620.717181:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.717183:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.717188:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 34 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.717198:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 34 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.717206:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10600, rc 0) 00000100:00100000:2.0:1746126620.717225:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721586688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 93us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.717231:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13810 00000100:00100000:1.0:1746126620.728135:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416576:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.728149:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416704:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.728156:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416832:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.731289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.731450:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721416960:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.731459:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721417088:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.731485:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126620.731549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.731561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.732050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.732615:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587200 00000100:00100000:2.0:1746126620.732623:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587200 00010000:00010000:2.0:1746126620.732649:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 24 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.732674:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587456 00000100:00100000:2.0:1746126620.732676:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587456 00010000:00010000:2.0:1746126620.732685:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 243 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.732695:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587072 00000100:00100000:2.0:1746126620.732696:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587072 00010000:00010000:2.0:1746126620.732702:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 244 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.732708:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587328 00000100:00100000:2.0:1746126620.732709:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587328 00010000:00010000:2.0:1746126620.732714:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 25 pid: 14549 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.732722:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7223 00000100:00100000:2.0:1746126620.732728:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721587200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.732737:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.732741:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 25 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732749:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 25 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732766:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a4aa00/0xb50e825867613c27 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de53 expref: 25 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732779:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.732784:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.732791:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.732824:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721587200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.732845:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7223 00000100:00100000:2.0:1746126620.732857:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7224 00000100:00100000:2.0:1746126620.732861:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+244:1963:x1830945721587456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.732867:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.732871:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 244 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732877:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 244 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732887:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3000/0xb50e825867613bbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddff expref: 244 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732895:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.732897:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.732902:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.732917:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+243:1963:x1830945721587456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 56us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.732922:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7224 00000100:00100000:2.0:1746126620.732930:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7225 00000100:00100000:2.0:1746126620.732933:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+242:1963:x1830945721587072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.732939:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.732942:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 242 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732952:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 242 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732960:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093417600/0xb50e825867613c4a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de5a expref: 242 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.732969:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.732972:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.732976:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126620.732987:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+241:1963:x1830945721587072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 53us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.733029:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7226 00000100:00100000:1.0:1746126620.733044:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721587328:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.733051:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.733055:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 23 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.733062:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 23 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.733072:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973a3600/0xb50e825867613bc5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4de06 expref: 23 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.733083:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126620.733086:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.733090:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.733105:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721587328:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.733110:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7226 00000100:00100000:0.0:1746126620.733196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.733213:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587584 00000100:00100000:0.0:1746126620.733216:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587584 00010000:00010000:0.0:1746126620.733227:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.733238:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7227 00000100:00100000:0.0:1746126620.733242:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+242:1963:x1830945721587584:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126620.733249:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126620.733252:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.733259:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.733744:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592d800/0xb50e825867613bb7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ddf8 expref: 242 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746126620.734254:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126620.734259:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.734266:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.734271:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.734681:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126620.734708:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+241:1963:x1830945721587584:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1463us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.734714:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7227 00000100:00100000:0.0:1746126620.734789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.734807:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587712 00000100:00100000:0.0:1746126620.734811:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587712 00000100:00100000:2.0:1746126620.734970:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7225 00000100:00100000:0.0:1746126620.735146:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8998 00000100:00100000:0.0:1746126620.735153:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+240:31428:x1830945721587712:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.735169:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.735178:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e37e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.735213:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.735219:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.735233:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:0.0:1746126620.735240:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.735248:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126620.735250:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126620.735252:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.735257:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2f800, rc 0) 00000100:00100000:0.0:1746126620.735274:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+241:31428:x1830945721587712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 122us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.735278:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8998 00010000:00010000:1.0:1746126620.735397:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126620.735403:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00000040:00080000:1.0:1746126620.736793:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2668, 88 off226640 00000004:00080000:1.0:1746126620.736800:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742650972270ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739709:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2786, 88 off237120 00000004:00080000:1.0:1746126620.739721:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742653893206ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739750:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2787, 88 off237208 00000004:00080000:1.0:1746126620.739753:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742653925636ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739766:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2669, 88 off226728 00000004:00080000:1.0:1746126620.739768:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742653940266ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739774:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2670, 88 off226816 00000004:00080000:1.0:1746126620.739776:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742653948990ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739782:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2788, 88 off237296 00000004:00080000:1.0:1746126620.739784:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742653956591ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739790:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2789, 88 off237384 00000004:00080000:1.0:1746126620.739792:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742653964269ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739797:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2671, 88 off226904 00000004:00080000:1.0:1746126620.739800:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742653972157ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739805:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2790, 88 off237472 00000004:00080000:1.0:1746126620.739809:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742653981592ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739815:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2672, 88 off226992 00000004:00080000:1.0:1746126620.739817:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742653990064ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739883:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2792, 88 off237656 00000004:00080000:1.0:1746126620.739886:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742654058831ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739895:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2673, 88 off227080 00000004:00080000:1.0:1746126620.739897:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742654070111ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739903:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2793, 88 off237744 00000004:00080000:1.0:1746126620.739905:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742654077397ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739910:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2674, 88 off227168 00000004:00080000:1.0:1746126620.739912:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742654085072ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.739918:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2794, 88 off237832 00000004:00080000:1.0:1746126620.739921:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742654093289ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739926:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2795, 88 off237920 00000004:00080000:1.0:1746126620.739929:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742654101147ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.739934:0:15560:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2675, 88 off227256 00000004:00080000:1.0:1746126620.739937:0:15560:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742654109092ns, next at 687927188999ns, rc = 0 00000100:00100000:2.0:1746126620.756525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.757365:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721587968 00000100:00100000:0.0:1746126620.757372:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721587968 00000100:00100000:0.0:1746126620.757702:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8999 00000100:00100000:0.0:1746126620.757710:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+241:31430:x1830945721587968:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126620.757725:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.757740:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fc00/0xb50e8258676143ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e385 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.757815:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.757844:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.757854:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.757865:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.757870:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.757875:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000001:00080000:0.0:1746126620.774733:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943174 is committed 00000001:00080000:0.0:1746126620.774746:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943166 is committed 00000001:00080000:0.0:1746126620.774750:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943156 is committed 00000001:00080000:0.0:1746126620.774757:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943186 is committed 00000004:00080000:0.0:1746126620.774760:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2060 committed 00000004:00080000:0.0:1746126620.774886:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2176 committed 00000100:00100000:3.0:1746126620.775010:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775077:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775114:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775144:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746126620.775148:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775170:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775196:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721417472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775209:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775219:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721417984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775230:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775240:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746126620.775243:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721417600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775253:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775261:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775271:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.775286:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417216 00000100:00100000:3.0:1746126620.775291:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417216 00000100:00100000:3.0:1746126620.775313:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417728 00000100:00100000:3.0:1746126620.775314:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417728 00000100:00100000:3.0:1746126620.775322:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417344 00000100:00100000:3.0:1746126620.775324:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417344 00000100:00100000:3.0:1746126620.775330:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417856 00000100:00100000:3.0:1746126620.775331:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417856 00000100:00100000:3.0:1746126620.775335:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417472 00000100:00100000:3.0:1746126620.775336:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417472 00000100:00100000:3.0:1746126620.775341:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417984 00000100:00100000:3.0:1746126620.775342:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417984 00000100:00100000:3.0:1746126620.775347:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721417600 00000100:00100000:3.0:1746126620.775348:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721417600 00000100:00100000:3.0:1746126620.775352:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418112 00000100:00100000:3.0:1746126620.775353:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418112 00000100:00100000:3.0:1746126620.775359:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13811 00000100:00100000:3.0:1746126620.775363:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721417216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126620.775508:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746126620.775511:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126620.775513:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126620.775515:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126620.775516:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:3.0:1746126620.775543:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721417216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (466us total) trans 21474840394 rc 0/0 00000100:00100000:3.0:1746126620.775548:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13811 00000100:00100000:3.0:1746126620.775560:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13812 00000100:00100000:3.0:1746126620.775564:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721417728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775641:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721417728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (512us total) trans 21474840395 rc 0/0 00000100:00100000:3.0:1746126620.775645:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13812 00000100:00100000:3.0:1746126620.775654:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13813 00000100:00100000:3.0:1746126620.775657:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721417344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126620.775722:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126620.775724:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126620.775726:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126618 -> 1746126618 00002000:00010000:3.0:1746126620.775728:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126620.775730:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746126620.775749:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721417344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (586us total) trans 21474840396 rc 0/0 00000100:00100000:3.0:1746126620.775754:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13813 00000100:00100000:3.0:1746126620.775762:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13814 00000100:00100000:3.0:1746126620.775766:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721417856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.775868:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721417856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (686us total) trans 21474840397 rc 0/0 00000100:00100000:3.0:1746126620.775874:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13814 00000100:00100000:3.0:1746126620.775882:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13815 00000100:00100000:3.0:1746126620.775886:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721417472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126620.775954:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:3.0:1746126620.775957:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126620.775958:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126620.775960:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126620.775961:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:3.0:1746126620.775984:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721417472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (773us total) trans 21474840398 rc 0/0 00000100:00100000:3.0:1746126620.775988:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13815 00000100:00100000:3.0:1746126620.775997:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13816 00000100:00100000:3.0:1746126620.776001:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721417984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.776089:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721417984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (856us total) trans 21474840399 rc 0/0 00000100:00100000:3.0:1746126620.776093:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13816 00000100:00100000:3.0:1746126620.776102:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13817 00000100:00100000:3.0:1746126620.776106:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721417600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.776178:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721417600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (923us total) trans 21474840400 rc 0/0 00000100:00100000:3.0:1746126620.776182:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13817 00000100:00100000:3.0:1746126620.776190:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13818 00000100:00100000:3.0:1746126620.776194:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721418112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126620.776262:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721418112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (989us total) trans 21474840401 rc 0/0 00000100:00100000:3.0:1746126620.776266:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13818 00000004:00080000:3.0:1746126620.776308:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8a80/2, rc 0, transno 21474840400 00000100:00100000:3.0:1746126620.776313:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721417600:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776319:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918eb100/2, rc 0, transno 21474840401 00000100:00100000:3.0:1746126620.776321:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721418112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776326:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8e00/2, rc 0, transno 21474840398 00000100:00100000:3.0:1746126620.776328:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721417472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776332:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8700/2, rc 0, transno 21474840399 00000100:00100000:3.0:1746126620.776334:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721417984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776347:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918eaa00/2, rc 0, transno 21474840396 00000100:00100000:3.0:1746126620.776349:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417344:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776354:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8380/2, rc 0, transno 21474840397 00000100:00100000:3.0:1746126620.776356:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776361:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e9180/2, rc 0, transno 21474840394 00000100:00100000:3.0:1746126620.776363:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126620.776370:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800918e8000/2, rc 0, transno 21474840395 00000100:00100000:3.0:1746126620.776373:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721417728:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746126620.776460:0:15560:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e3f7100 reply state ffff88009ede6400 transno 8589943186 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00000100:00100000:2.0:1746126620.776468:0:15560:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746126620.776532:0:15560:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746126620.776544:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+17:31423:x1830945721586944:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 61119us (61160us total) trans 8589943186 rc 0/0 00000100:00100000:2.0:1746126620.776550:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8997 00010000:00010000:2.0:1746126620.776581:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.776587:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.776595:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.776600:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7de00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126620.776603:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.776609:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.776621:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.776624:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126620.776628:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.776637:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.776644:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.776668:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 241 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.776678:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3280:1830945721418240:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126620.776711:0:3280:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59dc240 going to sleep for 11 seconds 00000004:00080000:0.0:1746126620.777331:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2175 committed 00000004:00080000:0.0:1746126620.777334:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2059 committed 00000004:00080000:0.0:1746126620.777335:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2174 committed 00000004:00080000:0.0:1746126620.777336:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2058 committed 00000004:00080000:0.0:1746126620.777337:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2173 committed 00000004:00080000:0.0:1746126620.777339:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2057 committed 00000004:00080000:0.0:1746126620.777340:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2172 committed 00000004:00080000:0.0:1746126620.777341:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2056 committed 00000004:00080000:0.0:1746126620.777343:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2171 committed 00000004:00080000:0.0:1746126620.777344:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2170 committed 00000004:00080000:0.0:1746126620.777345:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2055 committed 00000004:00080000:0.0:1746126620.777346:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2054 committed 00000004:00080000:0.0:1746126620.777347:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2169 committed 00000004:00080000:0.0:1746126620.777349:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2168 committed 00000004:00080000:0.0:1746126620.777350:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2053 committed 00000001:00080000:0.0:1746126620.777368:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943181 is committed 00000001:00080000:0.0:1746126620.777375:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943179 is committed 00000001:00080000:0.0:1746126620.777408:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943183 is committed 00000001:00080000:0.0:1746126620.777442:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943182 is committed 00010000:00010000:0.0:1746126620.777471:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.777480:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.777485:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.777505:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 7 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.777515:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 7 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.777523:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721418368:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.777560:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746126620.779629:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721418752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126620.779674:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.779727:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721418880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.779753:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721418624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.780376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.780461:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721418496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.780502:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721418368:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.780518:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746126620.780758:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721588096 00000100:00100000:2.0:1746126620.780763:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721588096 00000100:00100000:2.0:1746126620.780796:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9000 00000100:00100000:2.0:1746126620.780802:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31423:x1830945721588096:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126620.780818:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.780847:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e38c expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.780892:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.780902:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 9 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.780916:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.780918:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126620.780920:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527c00, rc 0) 00000100:00100000:2.0:1746126620.780951:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31423:x1830945721588096:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 149us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.780957:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9000 00000100:00100000:2.0:1746126620.780982:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3280:1830945721418240:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126620.780996:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126620.781001:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7de00/0xb50e8258676143a5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126620.782139:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721419264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126620.782168:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.782190:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.782203:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721419392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126620.782217:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126620.782236:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418752 00000100:00100000:3.0:1746126620.782239:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418752 00000100:00100000:3.0:1746126620.782259:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419264 00000100:00100000:3.0:1746126620.782260:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419264 00000100:00100000:3.0:1746126620.782268:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418880 00000100:00100000:3.0:1746126620.782270:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418880 00000100:00100000:3.0:1746126620.782279:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419392 00000100:00100000:3.0:1746126620.782280:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419392 00000100:00100000:3.0:1746126620.782291:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13819 00000100:00100000:3.0:1746126620.782296:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830945721418752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126620.782439:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746126620.782442:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126620.782444:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126620.782446:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126620.782448:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746126620.782472:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721418752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (2799us total) trans 17179873244 rc 0/0 00000100:00100000:3.0:1746126620.782481:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13819 00000100:00100000:3.0:1746126620.782491:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13820 00000100:00100000:3.0:1746126620.782495:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830945721419264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126620.782566:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721419264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (396us total) trans 17179873245 rc 0/0 00000100:00100000:3.0:1746126620.782570:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13820 00000100:00100000:3.0:1746126620.782578:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13821 00000100:00100000:3.0:1746126620.782582:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3297:x1830945721418880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126620.782660:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3297:x1830945721418880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (468us total) trans 17179873246 rc 0/0 00000100:00100000:3.0:1746126620.782665:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13821 00000100:00100000:3.0:1746126620.782673:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13822 00000100:00100000:3.0:1746126620.782676:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3297:x1830945721419392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126620.782737:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3297:x1830945721419392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (518us total) trans 17179873247 rc 0/0 00000100:00100000:3.0:1746126620.782741:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13822 00000004:00080000:3.0:1746126620.782775:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f136d80/2, rc 0, transno 17179873246 00000100:00100000:3.0:1746126620.782782:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721418880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126620.782789:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6680/2, rc 0, transno 17179873247 00000100:00100000:3.0:1746126620.782792:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721419392:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126620.782881:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f134000/2, rc 0, transno 17179873244 00000100:00100000:3.0:1746126620.782884:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721418752:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126620.782890:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af6d80/2, rc 0, transno 17179873245 00000100:00100000:3.0:1746126620.782893:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721419264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.782946:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.782964:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721419136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.782979:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.782988:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746126620.782991:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721419520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.783000:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.783052:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418624 00000100:00100000:0.0:1746126620.783056:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418624 00000100:00100000:0.0:1746126620.783068:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419136 00000100:00100000:0.0:1746126620.783070:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419136 00000100:00100000:0.0:1746126620.783076:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419520 00000100:00100000:0.0:1746126620.783077:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419520 00000100:00100000:0.0:1746126620.783084:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13823 00000100:00100000:0.0:1746126620.783088:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721418624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126620.783159:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126620.783161:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126620.783163:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126620.783164:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126620.783166:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126620.783187:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721418624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (241us total) trans 17179873248 rc 0/0 00000100:00100000:0.0:1746126620.783192:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13823 00000100:00100000:0.0:1746126620.783201:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13824 00000100:00100000:0.0:1746126620.783205:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721419136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.783272:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721419136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (292us total) trans 17179873249 rc 0/0 00000100:00100000:0.0:1746126620.783277:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13824 00000100:00100000:0.0:1746126620.783285:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13825 00000100:00100000:0.0:1746126620.783289:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721419520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.783360:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721419520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (358us total) trans 17179873250 rc 0/0 00000100:00100000:0.0:1746126620.783365:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13825 00000100:00100000:0.0:1746126620.783381:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.783394:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721419008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.783408:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.783421:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721418496 00000100:00100000:0.0:1746126620.783423:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721418496 00000100:00100000:0.0:1746126620.783434:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721419008 00000100:00100000:0.0:1746126620.783436:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721419008 00000100:00100000:0.0:1746126620.783445:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13826 00000100:00100000:0.0:1746126620.783448:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830945721418496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126620.783683:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13827 00000100:00100000:1.0:1746126620.783691:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721419008:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126620.783776:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcce00/2, rc 0, transno 17179873250 00000100:00100000:2.0:1746126620.783780:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721419520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126620.783786:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f135500/2, rc 0, transno 17179873248 00000100:00100000:2.0:1746126620.783788:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721418624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126620.783792:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093af5880/2, rc 0, transno 17179873249 00000100:00100000:2.0:1746126620.783794:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721419136:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126620.785010:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126620.785014:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126620.785016:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126620.785017:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126620.785019:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126620.785059:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721418496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1609us (1677us total) trans 17179873251 rc 0/0 00000100:00100000:0.0:1746126620.785064:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13826 00000004:00080000:0.0:1746126620.785094:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f135880/2, rc 0, transno 17179873251 00000100:00100000:0.0:1746126620.785097:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721418496:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126620.785225:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126620.785227:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126620.785229:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126620.785230:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126620.785232:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746126620.785253:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721419008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1565us (1844us total) trans 17179873252 rc 0/0 00000100:00100000:1.0:1746126620.785258:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13827 00000100:00100000:2.0:1746126620.785330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.785354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.785368:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721588224 00000100:00100000:2.0:1746126620.785371:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721588224 00000100:00100000:2.0:1746126620.785391:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3815 00000100:00100000:2.0:1746126620.785395:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31428:x1830945721588224:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:2.0:1746126620.785454:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31428:x1830945721588224:12345-192.168.203.2@tcp:49:cat.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.785459:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3815 00000100:00100000:2.0:1746126620.785473:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721588352 00000100:00100000:2.0:1746126620.785475:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721588352 00010000:00010000:2.0:1746126620.785489:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 8 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746126620.785504:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7228 00000100:00100000:2.0:1746126620.785508:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721588352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126620.785515:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126620.785519:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 8 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.785529:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 8 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.785546:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761434a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e34d expref: 8 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746126620.785556:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.785560:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.785567:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.785573:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.785588:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1746126620.785711:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f135c00/2, rc 0, transno 17179873252 00000100:00100000:0.0:1746126620.785715:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721419008:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746126620.785726:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785731:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746126620.785741:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126620.785840:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785850:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785855:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785859:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2f000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126620.785861:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785866:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785872:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126620.785875:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126620.785877:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785880:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f000/0xb50e8258676143cf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785891:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785895:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785899:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785902:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2fa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126620.785904:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785910:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785915:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126620.785917:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126620.785918:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785922:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e8258676143c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785927:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785930:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785934:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785937:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2e400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126620.785938:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785942:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785946:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136a9f500) 00010000:00010000:0.0:1746126620.785947:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126620.785949:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785952:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e8258676143c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746126620.785979:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fc00/0xb50e8258676143ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e385 expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.785985:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fc00/0xb50e8258676143ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e385 expref: 224 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.785992:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2fc00, rc 0) 00000100:00100000:2.0:1746126620.787201:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721588352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1687us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.787208:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7228 00000100:00100000:0.0:1746126620.787669:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:31430:x1830945721587968:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 29957us (31147us total) trans 8589943187 rc 301/301 00000100:00100000:0.0:1746126620.787675:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8999 00000100:00100000:0.0:1746126620.801338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.801440:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721588608 00000100:00100000:2.0:1746126620.801448:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721588608 00000100:00100000:2.0:1746126620.801484:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3816 00000100:00100000:2.0:1746126620.801491:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973cc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31423:x1830945721588608:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1746126620.801651:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973cc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31423:x1830945721588608:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 160us (320us total) trans 8589943188 rc 0/0 00000100:00100000:2.0:1746126620.801662:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3816 00000100:00100000:0.0:1746126620.827518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.827576:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721588864 00000100:00100000:2.0:1746126620.827585:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721588864 00000100:00100000:2.0:1746126620.827631:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9001 00000100:00100000:2.0:1746126620.827638:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31432:x1830945721588864:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126620.827657:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.827672:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135527800/0xb50e8258676143e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e393 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.827755:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827765:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827774:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827784:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827789:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827794:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827905:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527e00/0xb50e8258676143f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827915:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135527e00/0xb50e8258676143f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.827921:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135527e00/0xb50e8258676143f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126620.827928:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126620.827994:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828000:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828006:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828011:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135527a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126620.828015:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828020:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828029:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126620.828032:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126620.828048:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828053:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e8258676143eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828072:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828080:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828084:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828087:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135526200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126620.828089:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828092:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828097:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5810600) 00010000:00010000:2.0:1746126620.828099:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126620.828100:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828104:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526200/0xb50e8258676143f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.828134:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527800/0xb50e8258676143e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e393 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.828142:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527e00/0xb50e8258676143f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e393 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.828148:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.828150:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126620.828151:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527e00, rc 0) 00000100:00100000:2.0:1746126620.828205:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31432:x1830945721588864:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 566us (694us total) trans 8589943189 rc 0/0 00000100:00100000:2.0:1746126620.828211:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9001 00000100:00100000:2.0:1746126620.830383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.831521:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721589120 00000100:00100000:0.0:1746126620.831529:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721589120 00000100:00100000:0.0:1746126620.831572:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3817 00000100:00100000:0.0:1746126620.831579:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31423:x1830945721589120:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1746126620.833129:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31423:x1830945721589120:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 1546us (2746us total) trans 8589943190 rc 0/0 00000100:00100000:0.0:1746126620.833137:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3817 00010000:00010000:0.0:1746126620.845179:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126620.845477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.845508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.845536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.845561:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721589504 00000100:00100000:0.0:1746126620.845562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.845568:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721589504 00000100:00100000:0.0:1746126620.845575:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721589632 00000100:00100000:0.0:1746126620.845577:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721589632 00002000:00100000:1.0:1746126620.845602:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800a5b68e00 x1830945721589504/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126620.845602:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5b6b100 x1830945721589632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.845610:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68e00 with x1830945721589504 ext(0->1048575) 00002000:00100000:0.0:1746126620.845610:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6b100 with x1830945721589632 ext(1048576->2097151) 00002000:00010000:1.0:1746126620.845615:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b68e00 00002000:00010000:0.0:1746126620.845615:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6b100 00000100:00100000:1.0:1746126620.845639:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721590016 00000100:00100000:1.0:1746126620.845641:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721590016 00002000:00100000:1.0:1746126620.845658:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5b6b480 x1830945721590016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126620.845664:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6b480 with x1830945721590016 ext(1048576->2097151) 00000100:00100000:0.0:1746126620.845664:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721589888 00000100:00100000:0.0:1746126620.845666:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721589888 00002000:00010000:1.0:1746126620.845667:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6b480 00002000:00100000:0.0:1746126620.845675:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5b6ad80 x1830945721589888/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/0 e 0 to 0 dl 1746126631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746126620.845677:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7894 00002000:00100000:0.0:1746126620.845681:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6ad80 with x1830945721589888 ext(1048576->2097151) 00000100:00100000:1.0:1746126620.845683:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721589504:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:0.0:1746126620.845683:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6ad80 00000100:00100000:0.0:1746126620.845691:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7895 00000100:00100000:0.0:1746126620.845695:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721589632:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126620.846165:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7896 00000100:00100000:3.0:1746126620.846172:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721590016:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126620.846705:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7897 00000100:00100000:0.0:1746126620.846710:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721589888:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126620.858405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.859007:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721590272 00000100:00100000:2.0:1746126620.859014:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721590272 00000100:00100000:2.0:1746126620.859060:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9002 00000100:00100000:2.0:1746126620.859066:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31435:x1830945721590272:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.859084:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.859099:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69000/0xb50e825867614407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e39a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.859147:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.859157:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.859165:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126620.859191:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126620.859194:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126620.859205:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.859212:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126620.859227:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69000/0xb50e825867614407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.859257:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.859265:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.859267:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126620.859269:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69200, rc 0) 00000100:00100000:2.0:1746126620.859305:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31435:x1830945721590272:12345-192.168.203.2@tcp:101:cat.0 Request processed in 239us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.859310:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9002 00000100:00100000:2.0:1746126620.881784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.882319:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721589632:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36621us (36807us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126620.882328:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7895 00002000:00100000:3.0:1746126620.882337:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a5b6b100 x1830945721589632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126620.882345:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6b100 with x1830945721589632 ext(1048576->2097151) 00002000:00010000:3.0:1746126620.882351:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b6b100 00000100:00100000:0.0:1746126620.882486:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721590528 00000100:00100000:0.0:1746126620.882492:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721590528 00000100:00100000:0.0:1746126620.882532:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9003 00000100:00100000:0.0:1746126620.882537:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31432:x1830945721590528:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126620.882549:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.882552:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746126620.882571:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527e00/0xb50e8258676143f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e393 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882592:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126620.882596:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126620.882603:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae42200/0xb50e825867614415 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3a1 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882636:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126620.882646:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 222 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882652:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882658:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882662:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126620.882682:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882690:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 10 pid: 14549 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.882698:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b68000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721419648:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.882752:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 8 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882759:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 8 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.882765:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b68a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721419776:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126620.882781:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 222 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.882787:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 222 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746126620.882792:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721419904:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126620.882801:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126620.892581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.892671:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721590784 00000100:00100000:3.0:1746126620.892683:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721590784 00010000:00010000:3.0:1746126620.892716:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 223 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.892738:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7229 00000100:00100000:3.0:1746126620.892744:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:1966:x1830945721590784:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.892754:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.892758:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 223 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.892766:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 223 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.892783:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.892788:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126620.892794:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126620.892799:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.892871:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:1966:x1830945721590784:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 126us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.892889:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7229 00000100:00100000:1.0:1746126620.893026:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b68000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721419648:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126620.893045:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b68a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721419776:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.893054:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e8258676143b3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e37e expref: 222 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.893069:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721419904:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126620.893087:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126620.901369:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721589888:12345-192.168.203.2@tcp:3:cat.0 Request processed in 53808us (54956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.901381:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7897 00002000:00100000:2.0:1746126620.901393:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5b6ad80 x1830945721589888/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.901401:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6ad80 with x1830945721589888 ext(1048576->2097151) 00002000:00010000:2.0:1746126620.901406:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6ad80 00000100:00100000:0.0:1746126620.901484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.901552:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721590656 00000100:00100000:3.0:1746126620.901563:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721590656 00010000:00010000:3.0:1746126620.901588:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 9 pid: 15560 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746126620.901612:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7230 00000100:00100000:3.0:1746126620.901617:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721590656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126620.901627:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126620.901632:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 9 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.901641:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 9 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.901657:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527c00/0xb50e8258676143d6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e38c expref: 9 pid: 15560 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746126620.901674:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.901678:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126620.901690:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126620.901694:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126620.901744:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721590656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 127us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.901750:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7230 00000100:00100000:2.0:1746126620.902092:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721590016:12345-192.168.203.2@tcp:3:cat.0 Request processed in 55920us (56554us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.902098:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7896 00002000:00100000:2.0:1746126620.902103:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5b6b480 x1830945721590016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126620.902109:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b6b480 with x1830945721590016 ext(1048576->2097151) 00002000:00010000:2.0:1746126620.902112:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b6b480 00000100:00100000:0.0:1746126620.904134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.904163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.904195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.904209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.904222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.904244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.904330:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721590912 00000100:00100000:2.0:1746126620.904339:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721590912 00000100:00100000:2.0:1746126620.904372:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591168 00000100:00100000:2.0:1746126620.904375:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591168 00000100:00100000:2.0:1746126620.904386:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591424 00000100:00100000:2.0:1746126620.904387:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591424 00000100:00100000:2.0:1746126620.904397:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591040 00000100:00100000:2.0:1746126620.904399:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591040 00000100:00100000:2.0:1746126620.904407:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591296 00000100:00100000:2.0:1746126620.904409:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591296 00000100:00100000:2.0:1746126620.904417:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591552 00000100:00100000:2.0:1746126620.904418:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591552 00000100:00100000:2.0:1746126620.904429:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13828 00000100:00100000:2.0:1746126620.904435:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721590912:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.904452:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.904468:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3a8 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.904492:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904494:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904502:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 28 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.904517:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 28 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.904527:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c68e00, rc 0) 00000100:00100000:2.0:1746126620.904560:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721590912:12345-192.168.203.2@tcp:101:cat.0 Request processed in 124us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.904563:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721589504:12345-192.168.203.2@tcp:3:cat.0 Request processed in 58875us (59086us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126620.904566:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13828 00000100:00100000:1.0:1746126620.904571:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7894 00000100:00100000:2.0:1746126620.904579:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13829 00002000:00100000:1.0:1746126620.904579:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800a5b68e00 x1830945721589504/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:381/0 lens 488/440 e 0 to 0 dl 1746126631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126620.904584:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721591168:12345-192.168.203.2@tcp:101:cat.0 00002000:00100000:1.0:1746126620.904586:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68e00 with x1830945721589504 ext(0->1048575) 00002000:00010000:1.0:1746126620.904591:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b68e00 00010000:00010000:2.0:1746126620.904593:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.904603:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3b6 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.904614:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904615:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904619:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126620.904622:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13830 00010000:00010000:2.0:1746126620.904628:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126620.904630:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721591424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.904635:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69400, rc 0) 00010000:00010000:1.0:1746126620.904642:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746126620.904649:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721591168:12345-192.168.203.2@tcp:101:cat.0 Request processed in 64us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.904655:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13829 00010000:00010000:1.0:1746126620.904655:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3c4 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126620.904664:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13831 00000100:00100000:2.0:1746126620.904668:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721591040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.904673:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126620.904675:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126620.904678:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904679:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3af expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126620.904684:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.904687:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904689:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126620.904693:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.904696:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126620.904701:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126620.904704:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7d000, rc 0) 00010000:00010000:2.0:1746126620.904709:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69600, rc 0) 00000100:00100000:1.0:1746126620.904725:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721591424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 97us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.904726:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721591040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 57us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.904731:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13830 00000100:00100000:2.0:1746126620.905349:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13831 00000100:00100000:0.0:1746126620.905371:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13832 00000100:00100000:0.0:1746126620.905379:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721591296:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126620.905387:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126620.905395:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3bd expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126620.905405:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.905406:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126620.905411:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.905419:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126620.905425:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a05800, rc 0) 00000100:00100000:0.0:1746126620.905441:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721591296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 65us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126620.905446:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13832 00000100:00100000:3.0:1746126620.905793:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13833 00000100:00100000:3.0:1746126620.905810:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721591552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126620.905820:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126620.905847:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3cb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.905861:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.905862:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126620.905871:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.905881:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126620.905892:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54f9400, rc 0) 00000100:00100000:3.0:1746126620.905916:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721591552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 112us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126620.905926:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13833 00000100:00100000:1.0:1746126620.907670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126620.907781:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591680 00000100:00100000:1.0:1746126620.907787:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591680 00010000:00010000:1.0:1746126620.907811:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 11 pid: 14549 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746126620.907852:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7231 00000100:00100000:1.0:1746126620.907859:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721591680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126620.907869:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126620.907874:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 11 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.907884:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 11 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.907906:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69200/0xb50e82586761440e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e39a expref: 11 pid: 14549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746126620.907922:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126620.907926:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126620.907933:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126620.907938:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126620.907954:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126620.908396:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721591680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 535us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.908402:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7231 00010000:00010000:1.0:1746126620.908422:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126620.908429:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000040:00080000:1.0:1746126620.908963:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2676, 88 off227344 00000004:00080000:1.0:1746126620.908968:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742823140584ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.909014:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2796, 88 off238008 00000004:00080000:1.0:1746126620.909018:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742823190267ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.916709:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2797, 88 off238096 00000004:00080000:1.0:1746126620.916719:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742830891288ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.918684:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2677, 88 off227432 00000004:00080000:1.0:1746126620.918691:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742832863112ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.918729:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2678, 88 off227520 00000004:00080000:1.0:1746126620.918732:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742832904311ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.918741:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2798, 88 off238184 00000004:00080000:1.0:1746126620.918743:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742832916051ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.920155:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2799, 88 off238272 00000004:00080000:1.0:1746126620.920161:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742834333262ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.922443:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2679, 88 off227608 00000004:00080000:1.0:1746126620.922451:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742836622895ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.922471:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2800, 88 off238360 00000004:00080000:1.0:1746126620.922473:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742836645866ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.922872:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2680, 88 off227696 00000004:00080000:1.0:1746126620.922876:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742837048366ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.922883:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2801, 88 off238448 00000004:00080000:1.0:1746126620.922885:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742837057168ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.922890:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2681, 88 off227784 00000004:00080000:1.0:1746126620.922893:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742837065185ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.922898:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2802, 88 off238536 00000004:00080000:1.0:1746126620.922900:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742837072560ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.922905:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2682, 88 off227872 00000004:00080000:1.0:1746126620.922907:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742837080020ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126620.922913:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2803, 88 off238624 00000004:00080000:1.0:1746126620.922915:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742837087313ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.922920:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2804, 88 off238712 00000004:00080000:1.0:1746126620.922922:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742837094924ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126620.922928:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2683, 88 off227960 00000004:00080000:1.0:1746126620.922930:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742837102664ns, next at 687927188999ns, rc = 0 00000100:00100000:2.0:1746126620.923211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.923237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126620.923257:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591808 00000100:00100000:2.0:1746126620.923262:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591808 00000100:00100000:2.0:1746126620.923287:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721591936 00000100:00100000:2.0:1746126620.923288:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721591936 00000100:00100000:2.0:1746126620.923311:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9004 00000100:00100000:2.0:1746126620.923317:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+222:31428:x1830945721591808:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.923333:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.923347:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3d2 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923384:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126620.923391:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923404:0:15560:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126620.923413:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923426:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.923428:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126620.923431:0:15560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 223 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923436:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c68a00, rc 0) 00000100:00100000:2.0:1746126620.923468:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+223:31428:x1830945721591808:12345-192.168.203.2@tcp:101:cat.0 Request processed in 151us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.923473:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9004 00000100:00100000:2.0:1746126620.923484:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9005 00000100:00100000:2.0:1746126620.923488:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31435:x1830945721591936:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126620.923493:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126620.923497:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3d9 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923510:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923515:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923520:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126620.923522:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126620.923524:0:15560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126620.923532:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69a00, rc 0) 00000100:00100000:2.0:1746126620.923542:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31435:x1830945721591936:12345-192.168.203.2@tcp:101:cat.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126620.923546:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9005 00010000:00010000:3.0:1746126620.959528:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959550:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126620.959553:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746126620.959557:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959567:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959574:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959580:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959586:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959592:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126620.959630:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.959643:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721420032:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126620.959746:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 222 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126620.959759:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721420160:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126620.959776:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000001:00080000:0.0:1746126620.960311:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943190 is committed 00000001:00080000:0.0:1746126620.960321:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943187 is committed 00000001:00080000:0.0:1746126620.960327:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943191 is committed 00000004:00080000:0.0:1746126620.960331:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2068 committed 00000004:00080000:0.0:1746126620.960343:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2185 committed 00000004:00080000:0.0:1746126620.960349:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2184 committed 00000004:00080000:0.0:1746126620.960351:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2067 committed 00000004:00080000:0.0:1746126620.960352:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2183 committed 00000004:00080000:0.0:1746126620.960353:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2066 committed 00000004:00080000:0.0:1746126620.960354:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2182 committed 00000004:00080000:0.0:1746126620.960356:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2065 committed 00000004:00080000:0.0:1746126620.960357:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2181 committed 00000004:00080000:0.0:1746126620.960358:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2064 committed 00000004:00080000:0.0:1746126620.960359:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2180 committed 00000004:00080000:0.0:1746126620.960360:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2179 committed 00000004:00080000:0.0:1746126620.960361:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2063 committed 00000004:00080000:0.0:1746126620.960362:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2062 committed 00000004:00080000:0.0:1746126620.960364:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2178 committed 00000004:00080000:0.0:1746126620.960365:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2177 committed 00000004:00080000:0.0:1746126620.960366:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2061 committed 00000100:00100000:0.0:1746126620.960495:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721420672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960552:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721421184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960563:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960577:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126620.960581:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721420288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960594:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960604:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721420800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960615:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960631:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721420416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960655:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721420928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960667:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960677:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126620.960680:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721420544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960697:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960707:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.960719:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126620.960745:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420672 00000100:00100000:0.0:1746126620.960753:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420672 00000100:00100000:0.0:1746126620.960790:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421184 00000100:00100000:0.0:1746126620.960792:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421184 00000100:00100000:0.0:1746126620.960801:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420288 00000100:00100000:0.0:1746126620.960803:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420288 00000100:00100000:0.0:1746126620.960811:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420800 00000100:00100000:0.0:1746126620.960812:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420800 00000100:00100000:0.0:1746126620.960818:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420416 00000100:00100000:0.0:1746126620.960820:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420416 00000100:00100000:0.0:1746126620.960850:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420928 00000100:00100000:0.0:1746126620.960853:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420928 00000100:00100000:0.0:1746126620.960861:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721420544 00000100:00100000:0.0:1746126620.960862:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721420544 00000100:00100000:0.0:1746126620.960867:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421056 00000100:00100000:0.0:1746126620.960869:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421056 00000100:00100000:0.0:1746126620.960879:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13834 00000100:00100000:0.0:1746126620.960885:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3294:x1830945721420672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.961100:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721420672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (565us total) trans 17179873253 rc 0/0 00000100:00100000:0.0:1746126620.961106:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13834 00000100:00100000:0.0:1746126620.961121:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13835 00000100:00100000:0.0:1746126620.961125:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3294:x1830945721421184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.961208:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721421184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (643us total) trans 17179873254 rc 0/0 00000100:00100000:0.0:1746126620.961212:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13835 00000100:00100000:0.0:1746126620.961221:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13836 00000100:00100000:0.0:1746126620.961225:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3294:x1830945721420288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126620.961295:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126620.961298:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126620.961300:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126620.961302:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126620.961304:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126620.961324:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721420288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (729us total) trans 17179873255 rc 0/0 00000100:00100000:0.0:1746126620.961329:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13836 00000100:00100000:0.0:1746126620.961339:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13837 00000100:00100000:0.0:1746126620.961342:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3294:x1830945721420800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.961383:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13838 00000100:00100000:2.0:1746126620.961390:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3296:x1830945721420416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.961402:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13839 00000100:00100000:2.0:1746126620.961406:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721420928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126620.961413:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126620.961415:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126620.961416:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126620.961418:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126620.961419:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126620.961438:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721420800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (820us total) trans 17179873256 rc 0/0 00000100:00100000:0.0:1746126620.961443:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13837 00000100:00100000:0.0:1746126620.961451:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13840 00000100:00100000:0.0:1746126620.961455:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3296:x1830945721420544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.961468:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13841 00000100:00100000:0.0:1746126620.961472:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721421056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.961494:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721420928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (825us total) trans 17179873257 rc 0/0 00000100:00100000:2.0:1746126620.961499:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13839 00000100:00100000:0.0:1746126620.961542:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721421056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (821us total) trans 17179873258 rc 0/0 00000100:00100000:0.0:1746126620.961546:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13841 00002000:00010000:2.0:1746126620.961571:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126620.961573:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:2.0:1746126620.961575:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.961577:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:2.0:1746126620.961579:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:0.0:1746126620.961580:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11d180/2, rc 0, transno 17179873255 00000100:00100000:0.0:1746126620.961586:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721420288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126620.961591:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009220b800/2, rc 0, transno 17179873256 00000100:00100000:0.0:1746126620.961594:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721420800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.961597:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830945721420416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (951us total) trans 17179873259 rc 0/0 00000004:00080000:0.0:1746126620.961599:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009220b100/2, rc 0, transno 17179873253 00000100:00100000:2.0:1746126620.961601:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13838 00000100:00100000:0.0:1746126620.961601:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009220b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721420672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126620.961606:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d5c00/2, rc 0, transno 17179873254 00000100:00100000:0.0:1746126620.961609:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721421184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126620.961622:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d6680/2, rc 0, transno 17179873258 00000100:00100000:2.0:1746126620.961625:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126620.961632:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f11d880/2, rc 0, transno 17179873259 00000100:00100000:0.0:1746126620.961634:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746126620.961635:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721420416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.961638:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721421312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126620.961643:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d7800/2, rc 0, transno 17179873257 00000100:00100000:2.0:1746126620.961646:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721420928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.961653:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746126620.961887:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746126620.961889:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:2.0:1746126620.961891:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.961892:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:2.0:1746126620.961894:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746126620.961907:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421312 00000100:00100000:1.0:1746126620.961910:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421312 00000100:00100000:2.0:1746126620.961914:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3296:x1830945721420544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 458us (1215us total) trans 17179873260 rc 0/0 00000100:00100000:2.0:1746126620.961919:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13840 00000100:00100000:1.0:1746126620.961927:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13842 00000100:00100000:1.0:1746126620.961931:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721421312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126620.962018:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721421312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (363us total) trans 17179873261 rc 0/0 00000100:00100000:1.0:1746126620.962023:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13842 00000100:00100000:2.0:1746126620.962043:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721421824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962065:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962090:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721422336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962116:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962129:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746126620.962133:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721421696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962155:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962182:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421824 00000100:00100000:2.0:1746126620.962184:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421824 00000100:00100000:2.0:1746126620.962198:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422336 00000100:00100000:2.0:1746126620.962199:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422336 00000100:00100000:2.0:1746126620.962208:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421696 00000100:00100000:2.0:1746126620.962210:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421696 00000100:00100000:2.0:1746126620.962217:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422208 00000100:00100000:2.0:1746126620.962219:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422208 00000100:00100000:1.0:1746126620.962222:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13843 00000100:00100000:1.0:1746126620.962227:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3295:x1830945721421824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962230:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13844 00000100:00100000:2.0:1746126620.962234:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1830945721422336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126620.962258:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13845 00000100:00100000:1.0:1746126620.962262:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3295:x1830945721421696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126620.962327:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:1.0:1746126620.962330:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:1.0:1746126620.962332:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126620 -> 1746126620 00002000:00010000:1.0:1746126620.962333:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:1.0:1746126620.962335:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:2.0:1746126620.962342:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3295:x1830945721422336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (224us total) trans 21474840402 rc 0/0 00000100:00100000:2.0:1746126620.962347:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13844 00000100:00100000:1.0:1746126620.962351:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3295:x1830945721421696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (204us total) trans 21474840403 rc 0/0 00000100:00100000:1.0:1746126620.962355:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13845 00000100:00100000:2.0:1746126620.962360:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13846 00000100:00100000:2.0:1746126620.962364:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1830945721422208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126620.962419:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1830945721421824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (354us total) trans 21474840404 rc 0/0 00000100:00100000:1.0:1746126620.962423:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13843 00000100:00100000:2.0:1746126620.962446:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3295:x1830945721422208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (276us total) trans 21474840405 rc 0/0 00000100:00100000:2.0:1746126620.962450:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13846 00000100:00100000:2.0:1746126620.962466:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962477:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962485:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962495:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746126620.962506:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092209500/2, rc 0, transno 17179873260 00000100:00100000:2.0:1746126620.962509:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721420544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126620.962514:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746126620.962517:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962527:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962534:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962543:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126620.962554:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421440 00000100:00100000:2.0:1746126620.962556:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421440 00000100:00100000:2.0:1746126620.962565:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421952 00000100:00100000:2.0:1746126620.962566:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421952 00000100:00100000:2.0:1746126620.962572:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721421568 00000100:00100000:2.0:1746126620.962573:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721421568 00000100:00100000:2.0:1746126620.962579:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721422080 00000100:00100000:2.0:1746126620.962581:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721422080 00000100:00100000:2.0:1746126620.962586:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13847 00000100:00100000:2.0:1746126620.962590:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3296:x1830945721421440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126620.962649:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746126620.962651:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.962653:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.962655:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.962657:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:2.0:1746126620.962673:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830945721421440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (195us total) trans 21474840406 rc 0/0 00000100:00100000:2.0:1746126620.962677:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13847 00000100:00100000:2.0:1746126620.962684:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13848 00000100:00100000:2.0:1746126620.962687:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3296:x1830945721421952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962741:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830945721421952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (245us total) trans 21474840407 rc 0/0 00000100:00100000:2.0:1746126620.962745:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13848 00000100:00100000:2.0:1746126620.962752:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13849 00000100:00100000:2.0:1746126620.962755:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3296:x1830945721421568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126620.962803:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126620.962805:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.962820:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126618 -> 1746126618 00002000:00010000:2.0:1746126620.962822:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126619 -> 1746126619 00002000:00010000:2.0:1746126620.962824:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746126620.962856:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830945721421568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (327us total) trans 21474840408 rc 0/0 00000100:00100000:2.0:1746126620.962860:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13849 00000100:00100000:2.0:1746126620.962868:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13850 00000100:00100000:2.0:1746126620.962872:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3296:x1830945721422080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126620.962941:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830945721422080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (396us total) trans 21474840409 rc 0/0 00000100:00100000:2.0:1746126620.962946:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13850 00000004:00080000:2.0:1746126620.962967:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f7800/2, rc 0, transno 21474840403 00000100:00100000:2.0:1746126620.962971:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721421696:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.962977:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5500/2, rc 0, transno 21474840405 00000100:00100000:2.0:1746126620.962979:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721422208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.962985:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5f80/2, rc 0, transno 21474840404 00000100:00100000:2.0:1746126620.962987:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721421824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.962992:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6300/2, rc 0, transno 21474840402 00000100:00100000:2.0:1746126620.962994:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721422336:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.963004:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4e00/2, rc 0, transno 21474840408 00000100:00100000:2.0:1746126620.963006:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421568:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.963011:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f5880/2, rc 0, transno 21474840409 00000100:00100000:2.0:1746126620.963013:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721422080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.963017:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f4700/2, rc 0, transno 21474840406 00000100:00100000:2.0:1746126620.963020:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421440:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126620.963025:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e3f6680/2, rc 0, transno 21474840407 00000100:00100000:2.0:1746126620.963028:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721421952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126620.964421:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801367e9180/2, rc 0, transno 17179873261 00000100:00100000:0.0:1746126620.964429:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721421312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126620.969609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126620.969680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126620.969989:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721420032:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126620.970004:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721420160:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126620.970041:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721592064 00000100:00100000:1.0:1746126620.970049:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721592064 00010000:00010000:3.0:1746126620.970059:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae42200/0xb50e825867614415 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 11 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746126620.970080:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126620.970086:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721592192 00000100:00100000:1.0:1746126620.970088:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721592192 00000100:00100000:1.0:1746126620.970108:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3818 00000100:00100000:1.0:1746126620.970115:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31435:x1830945721592064:12345-192.168.203.2@tcp:49:cat.0 00010000:00010000:3.0:1746126620.970116:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43200, rc 0) 00000100:00100000:3.0:1746126620.970167:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31432:x1830945721590528:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 87628us (88390us total) trans 8589943191 rc 0/0 00000100:00100000:3.0:1746126620.970175:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9003 00000100:00100000:1.0:1746126620.970183:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31435:x1830945721592064:12345-192.168.203.2@tcp:49:cat.0 Request processed in 69us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.970188:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3818 00000100:00100000:1.0:1746126620.970197:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3819 00000100:00100000:1.0:1746126620.970200:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+222:31428:x1830945721592192:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:1.0:1746126620.970222:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+222:31428:x1830945721592192:12345-192.168.203.2@tcp:49:cat.0 Request processed in 21us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126620.970226:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3819 00000100:00100000:0.0:1746126621.001663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.001709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.001779:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721592320 00000100:00100000:2.0:1746126621.001788:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721592320 00000100:00100000:2.0:1746126621.001842:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3820 00000100:00100000:2.0:1746126621.001849:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31432:x1830945721592320:12345-192.168.203.2@tcp:49:multiop.0 00000100:00100000:1.0:1746126621.001942:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721592576 00000100:00100000:1.0:1746126621.001953:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721592576 00002000:00100000:1.0:1746126621.001994:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012b161500 x1830945721592576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.002002:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161500 with x1830945721592576 ext(0->1048575) 00002000:00010000:1.0:1746126621.002008:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b161500 00000100:00100000:1.0:1746126621.002053:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7898 00000100:00100000:1.0:1746126621.002059:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721592576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126621.002625:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31432:x1830945721592320:12345-192.168.203.2@tcp:49:multiop.0 Request processed in 774us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.002632:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3820 00000100:00100000:0.0:1746126621.003562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.003618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.003671:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721592832 00000100:00100000:2.0:1746126621.003676:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721592832 00002000:00100000:2.0:1746126621.003699:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012b161c00 x1830945721592832/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.003707:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161c00 with x1830945721592832 ext(1048576->2097151) 00000100:00100000:3.0:1746126621.003753:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721593088 00000100:00100000:3.0:1746126621.003758:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721593088 00002000:00100000:3.0:1746126621.003775:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012b162d80 x1830945721593088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.003784:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b162d80 with x1830945721593088 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.003788:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b162d80 00000100:00100000:3.0:1746126621.003801:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7899 00000100:00100000:3.0:1746126621.003805:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721593088:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:2.0:1746126621.003942:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b161c00 00000100:00100000:2.0:1746126621.003957:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7900 00000100:00100000:2.0:1746126621.003963:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721592832:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126621.005378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.006204:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721593472 00000100:00100000:2.0:1746126621.006211:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721593472 00002000:00100000:2.0:1746126621.006248:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009f02dc00 x1830945721593472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.006256:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02dc00 with x1830945721593472 ext(1048576->2097151) 00002000:00010000:2.0:1746126621.006262:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02dc00 00000100:00100000:2.0:1746126621.006278:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7901 00000100:00100000:2.0:1746126621.006284:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721593472:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.008635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.009226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.009581:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721593600 00000100:00100000:1.0:1746126621.009589:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721593600 00002000:00100000:1.0:1746126621.009624:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880135bcd500 x1830945721593600/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.009633:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcd500 with x1830945721593600 ext(1048576->2097151) 00002000:00010000:1.0:1746126621.009639:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcd500 00000100:00100000:1.0:1746126621.009656:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7902 00000100:00100000:1.0:1746126621.009662:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721593600:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.010956:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721593728 00000100:00100000:0.0:1746126621.010966:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721593728 00000100:00100000:0.0:1746126621.011005:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13851 00000100:00100000:0.0:1746126621.011011:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31430:x1830945721593728:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126621.011026:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.011051:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3e0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.011077:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.011085:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.011095:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.011096:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.011099:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [540672->1048575] (req 540672->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.011125:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.011134:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 31 pid: 17475 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126621.011143:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721422464:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126621.011223:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.011230:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 25 pid: 8438 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126621.011237:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721422592:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.011251:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.012006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.012024:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721593856 00000100:00100000:0.0:1746126621.012027:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721593856 00000100:00100000:0.0:1746126621.012056:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13852 00000100:00100000:0.0:1746126621.012061:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+32:31432:x1830945721593856:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126621.012072:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.012080:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3e7 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.012094:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 25 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.012101:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 33 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.012106:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.012107:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.012109:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1376256->1671167] (req 1376256->1671167) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.012122:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 33 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.012128:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 33 pid: 20294 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126621.012135:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721422720:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126621.012160:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 25 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.012167:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 25 pid: 4642 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126621.012178:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721422848:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.012187:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.016419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.017506:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721422464:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.017954:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721593984 00000100:00100000:1.0:1746126621.017962:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721593984 00010000:00010000:1.0:1746126621.017997:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 26 pid: 8438 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126621.018021:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7232 00000100:00100000:1.0:1746126621.018027:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721593984:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.018051:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.018068:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 26 pid: 8438 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.018077:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 26 pid: 8438 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.018098:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.019525:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721593984:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1491us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.019533:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7232 00000100:00100000:2.0:1746126621.019899:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721422720:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126621.020062:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11800/0xb50e825867614382 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e354 expref: 25 pid: 8438 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746126621.020084:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721422592:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126621.020113:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [540672->1048575] (req 540672->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.020128:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a02e00, rc 0) 00000100:00100000:0.0:1746126621.021484:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31430:x1830945721593728:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10467us (12253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126621.021493:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13851 00000100:00100000:1.0:1746126621.021848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.021875:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721594112 00000100:00100000:1.0:1746126621.021882:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721594112 00000100:00100000:2.0:1746126621.021902:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721422848:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.021909:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 24 pid: 4642 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126621.021929:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1376256->1671167] (req 1376256->1671167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.021938:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7233 00010000:00010000:2.0:1746126621.021941:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c892200, rc 0) 00000100:00100000:1.0:1746126621.021945:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721594112:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.021956:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126621.021970:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+33:31432:x1830945721593856:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9909us (9966us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126621.021972:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 24 pid: 4642 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126621.021976:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13852 00010000:00010000:1.0:1746126621.021981:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 24 pid: 4642 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.021998:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e825867614397 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e369 expref: 24 pid: 4642 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.022023:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.022061:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721594112:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 116us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.022066:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7233 00000100:00100000:1.0:1746126621.022526:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1966:x1830945721592576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20466us (20816us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126621.022533:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7898 00002000:00100000:1.0:1746126621.022541:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012b161500 x1830945721592576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.022548:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161500 with x1830945721592576 ext(0->1048575) 00010000:00010000:1.0:1746126621.022554:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 31 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.022567:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 31 pid: 17475 timeout: 842 lvb_type: 1 00002000:00010000:1.0:1746126621.022572:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b161500 00000100:00100000:2.0:1746126621.029729:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721593088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25909us (26097us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.029741:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7899 00002000:00100000:2.0:1746126621.029753:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012b162d80 x1830945721593088/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.029761:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b162d80 with x1830945721593088 ext(1048576->2097151) 00002000:00010000:2.0:1746126621.029767:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b162d80 00000100:00100000:2.0:1746126621.045671:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721593472:12345-192.168.203.2@tcp:3:cat.0 Request processed in 39208us (40118us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.045685:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7901 00002000:00100000:2.0:1746126621.045700:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009f02dc00 x1830945721593472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.045709:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02dc00 with x1830945721593472 ext(1048576->2097151) 00010000:00010000:2.0:1746126621.045720:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126621.045736:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 842 lvb_type: 1 00002000:00010000:2.0:1746126621.045743:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f02dc00 00000100:00100000:0.0:1746126621.057775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.058331:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721593600:12345-192.168.203.2@tcp:3:cat.0 Request processed in 48661us (49696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126621.058344:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7902 00002000:00100000:1.0:1746126621.058357:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880135bcd500 x1830945721593600/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.058367:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcd500 with x1830945721593600 ext(1048576->2097151) 00002000:00010000:1.0:1746126621.058373:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcd500 00000100:00100000:1.0:1746126621.058417:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721594368 00000100:00100000:1.0:1746126621.058425:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721594368 00010000:00010000:1.0:1746126621.058454:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126621.058475:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7234 00000100:00100000:1.0:1746126621.058481:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721594368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.058494:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.058516:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.058525:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.058552:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a05800/0xb50e82586761443f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3bd expref: 29 pid: 20294 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.058566:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.058568:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.058575:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 28 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.058584:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 28 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.058616:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 28 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.058628:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721422976:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126621.058698:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.060225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.060346:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721594240 00000100:00100000:1.0:1746126621.060356:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721594240 00010000:00010000:1.0:1746126621.060393:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 29 pid: 17475 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746126621.060428:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7235 00000100:00100000:1.0:1746126621.060435:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721594240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.060445:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.060462:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 29 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.060479:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 29 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.060496:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c68e00/0xb50e825867614423 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a8 expref: 29 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746126621.060507:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.060508:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.060514:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.060521:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.060542:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.060551:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721423104:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126621.060610:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.060922:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721592832:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 56956us (57357us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.060930:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7900 00002000:00100000:2.0:1746126621.060940:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012b161c00 x1830945721592832/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.060948:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b161c00 with x1830945721592832 ext(1048576->2097151) 00002000:00010000:2.0:1746126621.060955:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b161c00 00000100:00100000:2.0:1746126621.062767:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721422976:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126621.062787:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.062846:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721594368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4345us (5059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.062856:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7234 00000100:00100000:0.0:1746126621.064475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.064550:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721594624 00000100:00100000:2.0:1746126621.064560:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721594624 00002000:00100000:2.0:1746126621.064609:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1376256->1380351) req@ffff88009f02e300 x1830945721594624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.064619:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02e300 with x1830945721594624 ext(1376256->1380351) 00002000:00010000:2.0:1746126621.064624:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02e300 00000100:00100000:2.0:1746126621.067069:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7903 00000100:00100000:2.0:1746126621.067087:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721594624:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126621.067270:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721594624:12345-192.168.203.2@tcp:3:cat.0 Request processed in 190us (2800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126621.067277:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7903 00002000:00100000:2.0:1746126621.067285:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31f:0x0] (1376256->1380351) req@ffff88009f02e300 x1830945721594624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.067294:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02e300 with x1830945721594624 ext(1376256->1380351) 00002000:00010000:2.0:1746126621.067299:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02e300 00000100:00100000:1.0:1746126621.067705:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721423104:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126621.067725:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.067751:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721594240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7317us (7532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.067759:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7235 00000100:00100000:0.0:1746126621.068779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.068823:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721594880 00000100:00100000:2.0:1746126621.069597:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721594880 00002000:00100000:3.0:1746126621.069962:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (540672->544767) req@ffff88009f02d500 x1830945721594880/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.069971:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02d500 with x1830945721594880 ext(540672->544767) 00002000:00010000:3.0:1746126621.069976:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02d500 00000100:00100000:3.0:1746126621.070009:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7904 00000100:00100000:3.0:1746126621.070017:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721594880:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126621.070190:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721594880:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 173us (1416us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126621.070196:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7904 00002000:00100000:3.0:1746126621.070201:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (540672->544767) req@ffff88009f02d500 x1830945721594880/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.070207:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02d500 with x1830945721594880 ext(540672->544767) 00002000:00010000:3.0:1746126621.070210:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02d500 00000100:00100000:0.0:1746126621.076028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.076141:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721595136 00000100:00100000:1.0:1746126621.076153:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721595136 00002000:00100000:1.0:1746126621.076198:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1376255) req@ffff88009f02f800 x1830945721595136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.076208:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02f800 with x1830945721595136 ext(1048576->1376255) 00002000:00010000:1.0:1746126621.076213:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02f800 00000100:00100000:1.0:1746126621.076244:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7905 00000100:00100000:1.0:1746126621.076252:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721595136:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.083890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.084067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.084157:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721595648 00000100:00100000:2.0:1746126621.084161:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721595392 00000100:00100000:0.0:1746126621.084166:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721595648 00000100:00100000:2.0:1746126621.084169:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721595392 00002000:00100000:0.0:1746126621.084198:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880135bcdc00 x1830945721595648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.084212:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcdc00 with x1830945721595648 ext(1048576->2097151) 00002000:00010000:0.0:1746126621.084216:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcdc00 00000100:00100000:0.0:1746126621.084250:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7906 00000100:00100000:0.0:1746126621.084256:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721595648:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126621.084334:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13853 00000100:00100000:2.0:1746126621.084342:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:31430:x1830945721595392:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126621.084357:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.084374:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3ee expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.084401:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 36 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.084409:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 17 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.084415:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.084417:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.084420:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.084452:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 17 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.084464:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 17 pid: 17475 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126621.084475:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721423232:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.084557:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 36 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.084565:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 36 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126621.084573:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721423360:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.084591:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.089872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.090104:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721595776 00000100:00100000:3.0:1746126621.090111:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721595776 00002000:00100000:3.0:1746126621.090145:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1667072->1671167) req@ffff88009f02df80 x1830945721595776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.090153:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02df80 with x1830945721595776 ext(1667072->1671167) 00002000:00010000:3.0:1746126621.090158:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02df80 00000100:00100000:3.0:1746126621.090183:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7907 00000100:00100000:3.0:1746126621.090189:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721595776:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.090205:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1963:x1830945721595136:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13945us (14179us total) trans 0 rc 327680/327680 00000100:00100000:1.0:1746126621.090214:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7905 00002000:00100000:1.0:1746126621.090224:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->1376255) req@ffff88009f02f800 x1830945721595136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 327680/327680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.090232:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02f800 with x1830945721595136 ext(1048576->1376255) 00002000:00010000:1.0:1746126621.090237:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02f800 00000100:00100000:3.0:1746126621.090323:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721595776:12345-192.168.203.2@tcp:3:cat.0 Request processed in 133us (458us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126621.090330:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7907 00002000:00100000:3.0:1746126621.090335:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1667072->1671167) req@ffff88009f02df80 x1830945721595776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.090528:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02df80 with x1830945721595776 ext(1667072->1671167) 00002000:00010000:3.0:1746126621.090531:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02df80 00000100:00100000:0.0:1746126621.094941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.094962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.095008:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721423232:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.095212:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721595904 00000100:00100000:3.0:1746126621.095219:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721595904 00010000:00010000:3.0:1746126621.095246:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 18 pid: 17475 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746126621.095266:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721596032 00000100:00100000:3.0:1746126621.095267:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721596032 00010000:00010000:3.0:1746126621.095276:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 38 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746126621.095298:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7236 00000100:00100000:3.0:1746126621.095304:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721595904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.095313:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.095337:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 18 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746126621.095347:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 18 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746126621.095370:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c69600/0xb50e825867614438 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3af expref: 18 pid: 17475 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746126621.095389:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126621.095460:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7237 00000100:00100000:0.0:1746126621.095466:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+38:1964:x1830945721596032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746126621.095467:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721423360:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126621.095473:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126621.095482:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 38 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746126621.095489:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 38 pid: 10890 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746126621.095525:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 38 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.095539:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721595904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 233us (603us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126621.095541:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c68200, rc 0) 00000100:00100000:3.0:1746126621.095545:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7236 00000100:00100000:2.0:1746126621.095586:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+38:31430:x1830945721595392:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11239us (11698us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126621.095594:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c2ec00/0xb50e825867614389 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e35b expref: 38 pid: 10890 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746126621.095598:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13853 00010000:00010000:0.0:1746126621.095607:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.095608:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.095613:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.095620:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.095646:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.095655:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721423488:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126621.095700:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.100954:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721595648:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16676us (16871us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.100968:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7906 00002000:00100000:2.0:1746126621.100983:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880135bcdc00 x1830945721595648/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.100994:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135bcdc00 with x1830945721595648 ext(1048576->2097151) 00002000:00010000:2.0:1746126621.101000:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135bcdc00 00000100:00100000:1.0:1746126621.101134:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721423488:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126621.101157:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.103434:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721596032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7958us (8460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.103447:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7237 00000100:00100000:1.0:1746126621.104998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.105289:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721596288 00000100:00100000:3.0:1746126621.105300:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721596288 00000100:00100000:3.0:1746126621.105345:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3821 00000100:00100000:3.0:1746126621.105351:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973cd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31432:x1830945721596288:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126621.105625:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973cd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31432:x1830945721596288:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 272us (631us total) trans 8589943192 rc 0/0 00000100:00100000:3.0:1746126621.105632:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3821 00000100:00100000:1.0:1746126621.107004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.107174:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721596544 00000100:00100000:2.0:1746126621.107181:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721596544 00002000:00100000:2.0:1746126621.107222:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1409024->1413119) req@ffff88008dad2680 x1830945721596544/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.107232:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad2680 with x1830945721596544 ext(1409024->1413119) 00002000:00010000:2.0:1746126621.107238:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad2680 00000100:00100000:2.0:1746126621.107269:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7908 00000100:00100000:2.0:1746126621.107275:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721596544:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126621.107417:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721596544:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 142us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126621.107423:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7908 00002000:00100000:2.0:1746126621.107427:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1409024->1413119) req@ffff88008dad2680 x1830945721596544/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.107434:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad2680 with x1830945721596544 ext(1409024->1413119) 00002000:00010000:2.0:1746126621.107437:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad2680 00000100:00100000:0.0:1746126621.114258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.114297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.114332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.114351:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721597184 00000100:00100000:0.0:1746126621.114357:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721597184 00000100:00100000:1.0:1746126621.114377:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721596928 00000100:00100000:1.0:1746126621.114386:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721596928 00000100:00100000:0.0:1746126621.114389:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3822 00000100:00100000:0.0:1746126621.114396:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31430:x1830945721597184:12345-192.168.203.2@tcp:35:multiop.0 00002000:00100000:1.0:1746126621.114428:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1671168->2097151) req@ffff88009f02d180 x1830945721596928/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.114444:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02d180 with x1830945721596928 ext(1671168->2097151) 00002000:00010000:1.0:1746126621.114449:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f02d180 00000100:00100000:1.0:1746126621.114469:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7909 00000100:00100000:1.0:1746126621.114474:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721596928:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.114565:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31430:x1830945721597184:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 169us (231us total) trans 8589943193 rc 0/0 00000100:00100000:0.0:1746126621.114571:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3822 00000100:00100000:3.0:1746126621.116156:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721596672 00000100:00100000:3.0:1746126621.116162:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721596672 00000100:00100000:3.0:1746126621.116193:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13854 00000100:00100000:3.0:1746126621.116199:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+23:31428:x1830945721596672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.116232:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.116250:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3f5 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.116273:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 28 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.116280:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.116282:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.116284:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.116465:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 28 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.116475:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 28 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.116485:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721423616:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.116534:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.131248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.132012:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721596928:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17535us (17711us total) trans 0 rc 425984/425984 00000100:00100000:1.0:1746126621.132022:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7909 00002000:00100000:1.0:1746126621.132039:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1671168->2097151) req@ffff88009f02d180 x1830945721596928/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 425984/425984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.132048:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02d180 with x1830945721596928 ext(1671168->2097151) 00010000:00010000:1.0:1746126621.132057:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.132069:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.132075:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f02d180 00000100:00100000:3.0:1746126621.132203:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721423616:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.132224:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.132237:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921b1800, rc 0) 00000100:00100000:3.0:1746126621.132254:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:31428:x1830945721596672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 16056us (18003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.132260:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13854 00000100:00100000:1.0:1746126621.133451:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721597312 00000100:00100000:1.0:1746126621.133458:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721597312 00002000:00100000:1.0:1746126621.133905:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1376256->1671167) req@ffff88009f02c700 x1830945721597312/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.133914:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02c700 with x1830945721597312 ext(1376256->1671167) 00010000:00010000:1.0:1746126621.133920:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.133933:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.133939:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f02c700 00000100:00100000:1.0:1746126621.133965:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1806 00000100:00100000:1.0:1746126621.133971:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721597312:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126621.143055:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721597312:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9075us (11806us total) trans 21474840410 rc 0/0 00000100:00100000:1.0:1746126621.143065:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1806 00002000:00100000:1.0:1746126621.143075:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31f:0x0] (1376256->1671167) req@ffff88009f02c700 x1830945721597312/t21474840410(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.143083:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02c700 with x1830945721597312 ext(1376256->1671167) 00010000:00010000:1.0:1746126621.143092:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 29 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.143106:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 29 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.143112:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f02c700 00000100:00100000:0.0:1746126621.153206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.153244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.153273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.153304:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721597952 00000100:00100000:0.0:1746126621.153304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.153313:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721597952 00000100:00100000:2.0:1746126621.153326:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721597824 00000100:00100000:2.0:1746126621.153328:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721597824 00000100:00100000:0.0:1746126621.153356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:2.0:1746126621.153361:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009f02fb80 x1830945721597824/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.153370:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02fb80 with x1830945721597824 ext(2097152->3145727) 00002000:00010000:2.0:1746126621.153375:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f02fb80 00000100:00100000:2.0:1746126621.153403:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721598208 00000100:00100000:2.0:1746126621.153405:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721598208 00002000:00100000:2.0:1746126621.153418:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee3a300 x1830945721598208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.153424:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3a300 with x1830945721598208 ext(2097152->3145727) 00002000:00010000:2.0:1746126621.153426:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3a300 00000100:00100000:3.0:1746126621.153429:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721598336 00000100:00100000:3.0:1746126621.153433:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721598336 00000100:00100000:2.0:1746126621.153445:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7910 00000100:00100000:2.0:1746126621.153451:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721597824:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.153584:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721597440 00000100:00100000:1.0:1746126621.153588:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721597440 00010000:00010000:1.0:1746126621.153608:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 31 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.153632:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7238 00000100:00100000:1.0:1746126621.153637:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1964:x1830945721597440:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.153646:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126621.153656:0:7072:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126619 -> 1746126620 00002000:00010000:1.0:1746126621.153659:0:7072:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126619 -> 1746126620 00010000:00010000:1.0:1746126621.153663:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 31 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.153673:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 31 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.153692:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c892200/0xb50e825867614462 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->1671167) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e7 expref: 31 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.153707:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.153708:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.153715:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 23 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.153722:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 23 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.153747:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 23 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.153762:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721423744:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126621.153821:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.154203:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7911 00000100:00100000:3.0:1746126621.154211:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721598208:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:3.0:1746126621.155175:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee38700 x1830945721598336/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.155183:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38700 with x1830945721598336 ext(3145728->4194303) 00002000:00010000:3.0:1746126621.155187:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38700 00000100:00100000:3.0:1746126621.155200:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7912 00000100:00100000:3.0:1746126621.155205:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721598336:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:2.0:1746126621.156249:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009f02c380 x1830945721597952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.156257:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02c380 with x1830945721597952 ext(3145728->4194303) 00002000:00010000:2.0:1746126621.156261:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f02c380 00000100:00100000:2.0:1746126621.156280:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7913 00000100:00100000:2.0:1746126621.156285:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721597952:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.170529:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.170635:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721598720 00000100:00100000:2.0:1746126621.170643:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721598720 00002000:00100000:2.0:1746126621.170679:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ee39180 x1830945721598720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.170689:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39180 with x1830945721598720 ext(1048576->2097151) 00002000:00010000:2.0:1746126621.170694:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee39180 00000100:00100000:2.0:1746126621.170713:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7914 00000100:00100000:2.0:1746126621.170719:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721598720:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126621.173261:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721423744:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126621.173280:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.173316:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1964:x1830945721597440:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 19677us (20116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.173325:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7238 00000100:00100000:3.0:1746126621.174677:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721598208:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20463us (21367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.174685:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7911 00002000:00100000:3.0:1746126621.174693:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee3a300 x1830945721598208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.174701:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3a300 with x1830945721598208 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.174706:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3a300 00000100:00100000:3.0:1746126621.175288:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721597824:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21836us (22012us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.175294:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7910 00002000:00100000:3.0:1746126621.175299:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009f02fb80 x1830945721597824/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.175305:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02fb80 with x1830945721597824 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.175308:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f02fb80 00000100:00100000:3.0:1746126621.180241:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721598336:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25026us (26875us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.180252:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7912 00002000:00100000:3.0:1746126621.180260:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee38700 x1830945721598336/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.180268:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38700 with x1830945721598336 ext(3145728->4194303) 00002000:00010000:3.0:1746126621.180328:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38700 00000100:00100000:2.0:1746126621.187837:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721597952:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31534us (34574us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.187848:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7913 00002000:00100000:2.0:1746126621.187857:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009f02c380 x1830945721597952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.187866:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02c380 with x1830945721597952 ext(3145728->4194303) 00002000:00010000:2.0:1746126621.187871:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f02c380 00000100:00100000:3.0:1746126621.188563:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721598720:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 17841us (18039us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.188571:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7914 00002000:00100000:3.0:1746126621.188577:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009ee39180 x1830945721598720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.188585:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39180 with x1830945721598720 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.188589:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee39180 00000100:00100000:0.0:1746126621.200951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.200990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.201028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.201131:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721598848 00000100:00100000:1.0:1746126621.201138:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721598848 00000100:00100000:1.0:1746126621.201169:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721598976 00000100:00100000:1.0:1746126621.201171:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721598976 00000100:00100000:1.0:1746126621.201182:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721599104 00000100:00100000:1.0:1746126621.201183:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721599104 00000100:00100000:1.0:1746126621.201194:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13855 00000100:00100000:1.0:1746126621.201199:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721598848:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.201213:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.201227:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614477 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e3fc expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.201270:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721423872:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126621.201355:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.201373:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13856 00000100:00100000:1.0:1746126621.201377:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721598976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.201384:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.201393:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1400/0xb50e82586761447e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e403 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.201415:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721424000:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126621.201433:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.201446:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13857 00000100:00100000:1.0:1746126621.201450:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721599104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.201455:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.201462:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e40a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.201472:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.201473:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.201480:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.201492:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.201500:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1200, rc 0) 00000100:00100000:1.0:1746126621.201519:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1964:x1830945721599104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 68us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.201524:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13857 00000100:00100000:0.0:1746126621.204355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:1.0:1746126621.204525:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126619 -> 1746126620 00002000:00010000:1.0:1746126621.204529:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126619 -> 1746126620 00000100:00100000:1.0:1746126621.204545:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721424000:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126621.204569:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1400/0xb50e82586761447e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e403 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.204580:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1400/0xb50e82586761447e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e403 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.204607:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1400, rc 0) 00000100:00100000:1.0:1746126621.204643:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721598976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3264us (3651us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.204651:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13856 00002000:00010000:1.0:1746126621.204682:0:10890:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126619 -> 1746126620 00002000:00010000:1.0:1746126621.204684:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126619 -> 1746126620 00002000:00010000:1.0:1746126621.204686:0:10890:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126619 -> 1746126620 00000100:00100000:1.0:1746126621.204696:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721423872:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126621.204709:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614477 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3fc expref: 30 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.204717:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1000/0xb50e825867614477 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3fc expref: 30 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.204724:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1000, rc 0) 00000100:00100000:1.0:1746126621.204741:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721598848:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3542us (3798us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.204745:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13855 00000100:00100000:3.0:1746126621.204863:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721599360 00000100:00100000:3.0:1746126621.204869:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721599360 00002000:00100000:3.0:1746126621.204896:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee3ad80 x1830945721599360/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.204904:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3ad80 with x1830945721599360 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.204908:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3ad80 00000100:00100000:3.0:1746126621.204921:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7915 00000100:00100000:3.0:1746126621.204927:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721599360:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.206150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.206536:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721599616 00000100:00100000:2.0:1746126621.206541:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721599616 00002000:00100000:2.0:1746126621.206564:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee3aa00 x1830945721599616/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.206572:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3aa00 with x1830945721599616 ext(3145728->4194303) 00002000:00010000:2.0:1746126621.206576:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3aa00 00000100:00100000:2.0:1746126621.206597:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7916 00000100:00100000:2.0:1746126621.206603:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721599616:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.208371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.209168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.209199:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721599872 00000100:00100000:0.0:1746126621.209204:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721599872 00002000:00100000:0.0:1746126621.209235:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ee39c00 x1830945721599872/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.209244:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39c00 with x1830945721599872 ext(2097152->3145727) 00002000:00010000:0.0:1746126621.209249:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee39c00 00000100:00100000:0.0:1746126621.209261:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721600128 00000100:00100000:0.0:1746126621.209263:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721600128 00002000:00100000:0.0:1746126621.209273:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009ee38000 x1830945721600128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.209279:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38000 with x1830945721600128 ext(3145728->4194303) 00002000:00010000:0.0:1746126621.209281:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee38000 00000100:00100000:0.0:1746126621.209297:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7917 00000100:00100000:0.0:1746126621.209303:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721599872:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.210381:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7918 00000100:00100000:0.0:1746126621.210388:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721600128:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.219596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.220283:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721600384 00000100:00100000:3.0:1746126621.220290:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721600384 00002000:00100000:3.0:1746126621.220323:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009ee38e00 x1830945721600384/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.220332:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38e00 with x1830945721600384 ext(4194304->4976639) 00002000:00010000:3.0:1746126621.220336:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38e00 00000100:00100000:3.0:1746126621.221749:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7919 00000100:00100000:3.0:1746126621.221760:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721600384:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.224353:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721599360:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19417us (19996us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.224364:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7915 00002000:00100000:3.0:1746126621.224372:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee3ad80 x1830945721599360/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.224380:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3ad80 with x1830945721599360 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.224385:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3ad80 00000100:00100000:2.0:1746126621.228962:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721599616:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22351us (22806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.228972:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7916 00002000:00100000:2.0:1746126621.228982:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee3aa00 x1830945721599616/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.228991:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3aa00 with x1830945721599616 ext(3145728->4194303) 00002000:00010000:2.0:1746126621.228996:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3aa00 00000100:00100000:2.0:1746126621.244497:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721599872:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35186us (36122us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.244506:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7917 00002000:00100000:2.0:1746126621.244515:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009ee39c00 x1830945721599872/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.244523:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee39c00 with x1830945721599872 ext(2097152->3145727) 00002000:00010000:2.0:1746126621.244528:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee39c00 00000100:00100000:1.0:1746126621.245223:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721600128:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34834us (36053us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126621.245229:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7918 00002000:00100000:1.0:1746126621.245234:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009ee38000 x1830945721600128/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.245241:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38000 with x1830945721600128 ext(3145728->4194303) 00002000:00010000:1.0:1746126621.245244:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee38000 00000100:00100000:3.0:1746126621.250667:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721600384:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28901us (31068us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126621.250678:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7919 00002000:00100000:3.0:1746126621.250689:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009ee38e00 x1830945721600384/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.250698:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38e00 with x1830945721600384 ext(4194304->4976639) 00002000:00010000:3.0:1746126621.250703:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38e00 00000100:00100000:0.0:1746126621.261889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.261932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.261956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.261974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.262166:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721600896 00000100:00100000:2.0:1746126621.262173:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721600896 00002000:00100000:2.0:1746126621.262204:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009ee38a80 x1830945721600896/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.262212:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38a80 with x1830945721600896 ext(4194304->4976639) 00002000:00010000:2.0:1746126621.262217:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38a80 00000100:00100000:2.0:1746126621.262230:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7920 00000100:00100000:2.0:1746126621.262235:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721600896:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.263271:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721601152 00000100:00100000:3.0:1746126621.263277:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721601152 00000100:00100000:3.0:1746126621.263303:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9006 00000100:00100000:3.0:1746126621.263308:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31442:x1830945721601152:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126621.263323:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.263337:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e82586761448c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e41f expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.263410:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263425:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263434:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263444:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263449:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263453:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263538:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263545:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263550:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126621.263557:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126621.263619:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263625:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263630:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263638:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008da01200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126621.263641:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263646:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263654:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126621.263656:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126621.263659:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263662:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263675:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263679:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263683:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263688:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008da01400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126621.263690:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263695:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263700:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe800) 00010000:00010000:3.0:1746126621.263702:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126621.263704:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263708:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e82586761449a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.263738:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e82586761448c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.263748:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 225 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.263754:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.263755:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126621.263757:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01600, rc 0) 00000100:00100000:3.0:1746126621.263781:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31442:x1830945721601152:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 473us (1848us total) trans 8589943194 rc 0/0 00000100:00100000:3.0:1746126621.263786:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9006 00000100:00100000:3.0:1746126621.263817:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721600512 00000100:00100000:3.0:1746126621.263820:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721600512 00000100:00100000:3.0:1746126621.263850:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721600640 00000100:00100000:3.0:1746126621.263852:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721600640 00000100:00100000:3.0:1746126621.263862:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13858 00000100:00100000:3.0:1746126621.263866:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721600512:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.263872:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.263880:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008da01a00/0xb50e8258676144af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e411 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.263909:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721424128:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.263957:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.263970:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13859 00000100:00100000:3.0:1746126621.263974:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721600640:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.263980:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.263988:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676144b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e418 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.264005:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721424256:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.264018:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.273620:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721600896:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11376us (11637us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126621.273630:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7920 00002000:00100000:2.0:1746126621.273638:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009ee38a80 x1830945721600896/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.273651:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38a80 with x1830945721600896 ext(4194304->4976639) 00002000:00010000:2.0:1746126621.273656:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38a80 00000100:00100000:2.0:1746126621.273715:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721424256:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.273739:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676144b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e418 expref: 18 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.273749:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676144b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e418 expref: 18 pid: 20294 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126621.274675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.280875:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721601408 00000100:00100000:3.0:1746126621.280885:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721601408 00000100:00100000:3.0:1746126621.280931:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9007 00000100:00100000:3.0:1746126621.280938:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31443:x1830945721601408:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126621.280957:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.280972:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00200/0xb50e8258676144bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e426 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.281067:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281077:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281084:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281095:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281103:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281107:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281185:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281191:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281197:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126621.281204:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126621.281268:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281274:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281278:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281282:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008da00000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126621.281285:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281290:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281298:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126621.281300:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126621.281303:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281307:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00000/0xb50e8258676144c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281321:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281325:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281329:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281332:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008da00a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126621.281334:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281338:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281342:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe900) 00010000:00010000:3.0:1746126621.281344:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126621.281345:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281348:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00a00/0xb50e8258676144cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.281375:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00200/0xb50e8258676144bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.281389:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.281394:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.281396:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126621.281398:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da00800, rc 0) 00000100:00100000:3.0:1746126621.281451:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31443:x1830945721601408:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 513us (6777us total) trans 8589943195 rc 0/0 00000100:00100000:3.0:1746126621.281456:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9007 00000100:00100000:3.0:1746126621.281508:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721424128:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126621.281528:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008da01a00/0xb50e8258676144af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e411 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.281536:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008da01a00/0xb50e8258676144af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e411 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.281543:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01a00, rc 0) 00000100:00100000:3.0:1746126621.281566:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721600512:12345-192.168.203.2@tcp:101:cat.0 Request processed in 17699us (19683us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126621.281572:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13858 00010000:00010000:2.0:1746126621.282079:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da00c00, rc 0) 00000100:00100000:2.0:1746126621.282119:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721600640:12345-192.168.203.2@tcp:101:cat.0 Request processed in 18143us (20161us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.282125:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13859 00000100:00100000:0.0:1746126621.297873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.297991:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721601536 00000100:00100000:3.0:1746126621.297999:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721601536 00000100:00100000:3.0:1746126621.298044:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9008 00000100:00100000:3.0:1746126621.298050:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31444:x1830945721601536:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126621.298070:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.298084:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00400/0xb50e8258676144e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e42d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.298130:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298140:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298147:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298158:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298163:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298168:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298248:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298255:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298260:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126621.298283:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126621.298287:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126621.298296:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298303:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298309:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298314:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298319:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298324:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008da00600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126621.298327:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298332:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298340:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126621.298343:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126621.298346:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298350:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00600/0xb50e8258676144e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298362:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298367:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298371:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298375:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008da00e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126621.298378:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298382:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298387:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe800) 00010000:00010000:3.0:1746126621.298389:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126621.298391:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298395:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00e00/0xb50e8258676144ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.298415:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00400/0xb50e8258676144e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.298424:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.298429:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.298431:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126621.298433:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01400, rc 0) 00000100:00100000:3.0:1746126621.298469:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31444:x1830945721601536:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 419us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.298474:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9008 00000100:00100000:0.0:1746126621.313586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.317404:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721601664 00000100:00100000:2.0:1746126621.317414:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721601664 00000100:00100000:0.0:1746126621.318703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:1.0:1746126621.318779:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126621.322916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.324184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.324317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.324343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.324382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.324426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.324448:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602048 00000100:00100000:0.0:1746126621.324457:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602048 00000100:00100000:0.0:1746126621.324488:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602176 00000100:00100000:0.0:1746126621.324491:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602176 00000100:00100000:0.0:1746126621.324507:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602304 00000100:00100000:0.0:1746126621.324510:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602304 00000100:00100000:0.0:1746126621.324532:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602432 00000100:00100000:0.0:1746126621.324535:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602432 00000100:00100000:0.0:1746126621.324544:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602560 00000100:00100000:0.0:1746126621.324547:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602560 00000100:00100000:0.0:1746126621.324560:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13860 00000100:00100000:0.0:1746126621.324569:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721601664:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126621.324586:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.324603:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c69000/0xb50e8258676144fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e434 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.324655:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721424384:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126621.324733:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.324758:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13861 00000100:00100000:0.0:1746126621.324765:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721602048:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126621.324774:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.324782:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e449 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.324795:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.324797:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.324805:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.324819:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.324854:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69e00, rc 0) 00000100:00100000:0.0:1746126621.324886:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721602048:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 119us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126621.324892:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13861 00000100:00100000:3.0:1746126621.326461:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13862 00000100:00100000:3.0:1746126621.326474:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721602176:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126621.326485:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.326496:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e450 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.326511:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.326512:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.326517:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.326527:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.326534:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01200, rc 0) 00000100:00100000:3.0:1746126621.326566:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721602176:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 96us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.326571:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13862 00000100:00100000:3.0:1746126621.326584:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13863 00000100:00100000:3.0:1746126621.326588:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721602304:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126621.326595:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.326605:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e457 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.326616:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.326618:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.326628:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.326636:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.326646:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01e00, rc 0) 00000100:00100000:3.0:1746126621.326660:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721602304:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 71us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.326665:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13863 00000100:00100000:3.0:1746126621.326674:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13864 00000100:00100000:3.0:1746126621.326678:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721602432:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.326684:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.326690:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008da00400/0xb50e825867614518 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e45e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.326718:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721424512:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.326754:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.326774:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13865 00000100:00100000:3.0:1746126621.326779:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721602560:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.326786:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.326791:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008da01000/0xb50e82586761451f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e465 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.326812:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721424640:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.326844:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edb40 going to sleep for 11 seconds 00000100:00080000:3.0:1746126621.326888:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746126621.328100:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721601792 00000100:00100000:2.0:1746126621.328107:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721601792 00000100:00100000:2.0:1746126621.328139:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13866 00000100:00100000:2.0:1746126621.328144:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721601792:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126621.328151:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.328160:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135526c00/0xb50e825867614526 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e43b expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.328184:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721424768:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126621.328244:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.328557:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721601920 00000100:00100000:1.0:1746126621.328561:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721601920 00000100:00100000:1.0:1746126621.328581:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13867 00000100:00100000:1.0:1746126621.328586:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721601920:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126621.328592:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.328598:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e442 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.328609:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.328610:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.328615:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.328625:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.328631:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0000, rc 0) 00000100:00100000:1.0:1746126621.328661:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721601920:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 74us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.328666:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13867 00000100:00100000:2.0:1746126621.334440:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721424640:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.334468:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008da01000/0xb50e82586761451f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e465 expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.334480:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008da01000/0xb50e82586761451f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e465 expref: 18 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126621.334483:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721424512:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.334493:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01000, rc 0) 00010000:00010000:3.0:1746126621.334497:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008da00400/0xb50e825867614518 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e45e expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.334504:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008da00400/0xb50e825867614518 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e45e expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.334512:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da00400, rc 0) 00000100:00100000:3.0:1746126621.334527:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721602432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7848us (10145us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.334527:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721602560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7747us (10102us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.334534:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13865 00000100:00100000:2.0:1746126621.334580:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721424768:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.334594:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135526c00/0xb50e825867614526 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e43b expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.334602:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135526c00/0xb50e825867614526 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e43b expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.334609:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526c00, rc 0) 00000100:00100000:2.0:1746126621.334625:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721601792:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6481us (15926us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126621.335094:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13864 00000100:00100000:1.0:1746126621.335111:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721424384:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126621.335126:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c69000/0xb50e8258676144fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e434 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.335134:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c69000/0xb50e8258676144fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e434 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.335151:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69000, rc 0) 00000100:00100000:1.0:1746126621.335169:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721601664:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 10602us (21589us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.335175:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13860 00000100:00100000:2.0:1746126621.335254:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13866 00000100:00100000:3.0:1746126621.338268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.338348:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602688 00000100:00100000:2.0:1746126621.338355:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602688 00000100:00100000:2.0:1746126621.338390:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13868 00000100:00100000:2.0:1746126621.338397:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31443:x1830945721602688:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126621.338410:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.338423:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e46c expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.338445:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.338453:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.338460:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.338466:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.338467:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.338470:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3428352->3784703] (req 3428352->3784703) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 18 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.338495:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.338505:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 18 pid: 8437 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.338516:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721424896:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.340216:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.340233:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 7 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.340244:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721425024:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.341024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.341085:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721602944 00000100:00100000:1.0:1746126621.341091:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721602944 00010000:00010000:2.0:1746126621.341258:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126621.341262:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9009 00010000:00010000:2.0:1746126621.341267:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 33 pid: 4641 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746126621.341268:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31444:x1830945721602944:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:2.0:1746126621.341274:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721425152:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.341280:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.341292:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761453b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e473 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.341303:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746126621.341360:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.341372:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.341378:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.341383:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.341391:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.341408:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.341415:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.341421:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425280:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.341449:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.341455:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 11 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.341462:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425408:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.341484:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.341490:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 224 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.341497:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425536:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.341512:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.345459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.345524:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603072 00000100:00100000:1.0:1746126621.345531:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603072 00010000:00010000:1.0:1746126621.345559:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 8 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746126621.345581:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7239 00000100:00100000:1.0:1746126621.345586:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721603072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.345596:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.345613:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 8 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.345623:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 8 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.345628:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721424896:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.345636:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721425024:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.345639:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008da01e00/0xb50e825867614511 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e457 expref: 8 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.345652:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.345805:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721603072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 217us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.345811:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7239 00000100:00100000:0.0:1746126621.352025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.352052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.352067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.352105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.352218:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603328 00000100:00100000:3.0:1746126621.352225:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603328 00010000:00010000:3.0:1746126621.352252:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 12 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.352278:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603200 00000100:00100000:3.0:1746126621.352280:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603200 00010000:00010000:3.0:1746126621.352288:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 9 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.352296:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603456 00000100:00100000:3.0:1746126621.352298:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603456 00010000:00010000:3.0:1746126621.352306:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 225 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.352312:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603584 00000100:00100000:3.0:1746126621.352314:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603584 00010000:00010000:3.0:1746126621.352321:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 19 pid: 8437 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.352332:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7240 00000100:00100000:3.0:1746126621.352337:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721603328:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.352346:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.352350:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 12 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.352358:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 12 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.352373:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.352377:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352384:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352388:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.352420:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721603328:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.352424:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7240 00000100:00100000:3.0:1746126621.352436:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7241 00000100:00100000:3.0:1746126621.352440:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721603200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.352445:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.352448:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 9 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.352455:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 9 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.352462:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.352465:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352470:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352474:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.352484:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721603200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.352488:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7241 00000100:00100000:3.0:1746126621.352495:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7242 00000100:00100000:3.0:1746126621.352499:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+225:1966:x1830945721603456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.352504:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.352507:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 225 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.352513:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 225 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.352520:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.352522:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352527:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352533:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.352544:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.352553:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+225:1966:x1830945721603456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 54us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.352557:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7242 00000100:00100000:3.0:1746126621.352581:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7243 00000100:00100000:3.0:1746126621.352585:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721603584:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.352590:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.352606:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 19 pid: 8437 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.352613:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 19 pid: 8437 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.352623:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54f9400/0xb50e825867614446 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3cb expref: 19 pid: 8437 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.352637:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.352648:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721603584:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 62us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.352652:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7243 00000100:00100000:3.0:1746126621.352683:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721425152:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.352702:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3428352->3784703] (req 3428352->3784703) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 17 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.352714:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527400, rc 0) 00000100:00100000:3.0:1746126621.352736:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31443:x1830945721602688:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 14336us (14468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.352742:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13868 00010000:00010000:1.0:1746126621.353637:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01400/0xb50e8258676144f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e42d expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.353649:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425280:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.353658:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da00800/0xb50e8258676144d2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e426 expref: 11 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.353669:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425408:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.353677:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01600/0xb50e8258676144a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e41f expref: 224 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.353683:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425536:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.353698:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.353704:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.353709:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126621.353723:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126621.355108:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761453b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.355128:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.355135:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126621.355137:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126621.355140:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1600, rc 0) 00000100:00100000:1.0:1746126621.355204:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31444:x1830945721602944:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13934us (14181us total) trans 8589943196 rc 0/0 00000100:00100000:1.0:1746126621.355210:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9009 00000100:00100000:0.0:1746126621.357347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.358509:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603712 00000100:00100000:2.0:1746126621.358518:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603712 00010000:00010000:2.0:1746126621.358550:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 34 pid: 4641 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.358583:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7244 00000100:00100000:2.0:1746126621.358592:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721603712:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.358606:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.358626:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 34 pid: 4641 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.358643:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 34 pid: 4641 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.358662:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd10600/0xb50e8258676143ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e377 expref: 34 pid: 4641 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.360623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126621.360891:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.360895:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.360905:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.361016:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.361068:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.361083:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721425664:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126621.361157:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.362048:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721603840 00000100:00100000:0.0:1746126621.362055:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721603840 00000100:00100000:0.0:1746126621.362126:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9010 00000100:00100000:0.0:1746126621.362136:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31444:x1830945721603840:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126621.362155:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.362171:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69000/0xb50e825867614550 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e47a expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.362238:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.362251:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.362256:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.362280:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.362291:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 9 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746126621.362299:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425792:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.364275:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.365876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.365967:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721425664:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126621.365986:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.366796:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721603712:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8201us (9447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.366806:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7244 00000100:00100000:3.0:1746126621.367075:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721604096 00000100:00100000:3.0:1746126621.367083:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721604096 00002000:00100000:3.0:1746126621.367122:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3428352->3432447) req@ffff88008e3a8a80 x1830945721604096/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.367131:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8a80 with x1830945721604096 ext(3428352->3432447) 00002000:00010000:3.0:1746126621.367136:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a8a80 00000100:00100000:3.0:1746126621.367157:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7921 00000100:00100000:3.0:1746126621.367165:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721604096:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126621.369183:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721604096:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 2012us (3305us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126621.369192:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7921 00002000:00100000:3.0:1746126621.369200:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3428352->3432447) req@ffff88008e3a8a80 x1830945721604096/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.369209:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8a80 with x1830945721604096 ext(3428352->3432447) 00002000:00010000:3.0:1746126621.369213:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a8a80 00000100:00100000:0.0:1746126621.373244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.374065:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721425792:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.374083:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126621.374540:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721604224 00000100:00100000:3.0:1746126621.374546:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721604224 00010000:00010000:3.0:1746126621.374570:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.374598:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7245 00000100:00100000:3.0:1746126621.374603:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721604224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.374614:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.374619:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.374627:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.374643:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1600/0xb50e825867614542 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e473 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.374662:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.374666:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.374673:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.374678:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.374694:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.374727:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721604224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 123us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.374732:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7245 00010000:00010000:2.0:1746126621.374892:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.374898:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126621.374926:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126621.374929:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126621.374940:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.374963:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69000/0xb50e825867614550 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.374975:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.374981:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.374983:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126621.374985:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c69c00, rc 0) 00000100:00100000:2.0:1746126621.375008:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31444:x1830945721603840:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 12875us (14389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.375013:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9010 00000100:00100000:0.0:1746126621.376027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.377028:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721604480 00000100:00100000:3.0:1746126621.377046:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721604480 00002000:00100000:3.0:1746126621.377079:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3780608->3784703) req@ffff88008e3a9500 x1830945721604480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.377088:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9500 with x1830945721604480 ext(3780608->3784703) 00002000:00010000:3.0:1746126621.377092:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9500 00000100:00100000:3.0:1746126621.377121:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7922 00000100:00100000:3.0:1746126621.377127:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721604480:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126621.377920:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721604480:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 790us (1891us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126621.377926:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7922 00002000:00100000:3.0:1746126621.377932:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3780608->3784703) req@ffff88008e3a9500 x1830945721604480/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.377939:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9500 with x1830945721604480 ext(3780608->3784703) 00002000:00010000:3.0:1746126621.377942:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9500 00000100:00100000:0.0:1746126621.381246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.381277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.381299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.381323:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721604736 00000100:00100000:1.0:1746126621.381330:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721604736 00000100:00100000:0.0:1746126621.381335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.381358:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721604608 00000100:00100000:1.0:1746126621.381360:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721604608 00000100:00100000:0.0:1746126621.381367:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721604864 00000100:00100000:0.0:1746126621.381369:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721604864 00000100:00100000:1.0:1746126621.381374:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13869 00000100:00100000:1.0:1746126621.381379:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721604736:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:0.0:1746126621.381383:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13870 00000100:00100000:0.0:1746126621.381387:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721604608:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126621.381392:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.381392:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.381405:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614565 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e488 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.381405:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c68400/0xb50e82586761455e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e481 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.381442:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721425920:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126621.381442:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721426048:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126621.381495:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721605120 00000100:00100000:2.0:1746126621.381498:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721605120 00000100:00100000:2.0:1746126621.381519:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3823 00000100:00100000:2.0:1746126621.381525:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31443:x1830945721605120:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126621.381750:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13871 00000100:00100000:3.0:1746126621.381756:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721604864:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126621.381762:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.381769:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008da00000/0xb50e82586761456c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e48f expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.381790:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721426176:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126621.382228:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.382617:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.382624:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31443:x1830945721605120:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 1099us (1287us total) trans 8589943197 rc 0/0 00000100:00100000:2.0:1746126621.382630:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3823 00000100:00100000:3.0:1746126621.382689:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.388209:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721426048:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.388238:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c68400/0xb50e82586761455e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e481 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.388248:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c68400/0xb50e82586761455e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e481 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.388256:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c68400, rc 0) 00000100:00100000:2.0:1746126621.388294:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721604608:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6906us (7015us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.388300:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13870 00000100:00100000:1.0:1746126621.389271:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721425920:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126621.389289:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614565 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e488 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.389297:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614565 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e488 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.389309:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0800, rc 0) 00000100:00100000:1.0:1746126621.389332:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721604736:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7953us (8092us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.389339:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13869 00002000:00010000:3.0:1746126621.391540:0:20294:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126620 -> 1746126621 00002000:00010000:3.0:1746126621.391547:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126619 -> 1746126621 00002000:00010000:3.0:1746126621.391549:0:20294:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126620 -> 1746126621 00000100:00100000:3.0:1746126621.391571:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721426176:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126621.391599:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008da00000/0xb50e82586761456c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e48f expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.391611:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008da00000/0xb50e82586761456c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e48f expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.391649:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da00000, rc 0) 00000100:00100000:3.0:1746126621.391715:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721604864:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 9958us (10414us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126621.391722:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13871 00000100:00100000:0.0:1746126621.394957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.394977:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721605376 00000100:00100000:2.0:1746126621.394984:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721605376 00000100:00100000:2.0:1746126621.395037:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9011 00000100:00100000:2.0:1746126621.395043:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31444:x1830945721605376:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126621.395058:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.395072:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135526a00/0xb50e825867614573 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e496 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.395141:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395152:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395162:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395171:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395176:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395181:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395186:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135527a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126621.395189:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395193:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395202:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.395204:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126621.395207:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395212:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527a00/0xb50e82586761457a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.395235:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135526a00/0xb50e825867614573 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e496 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.395242:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135526a00/0xb50e825867614573 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e496 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.395252:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526a00, rc 0) 00000100:00100000:2.0:1746126621.395299:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31444:x1830945721605376:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 256us (348us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.395305:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9011 00000100:00100000:0.0:1746126621.399386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.401233:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721605632 00000100:00100000:2.0:1746126621.401242:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721605632 00000100:00100000:2.0:1746126621.401277:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3824 00000100:00100000:2.0:1746126621.401283:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31444:x1830945721605632:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1746126621.401460:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31444:x1830945721605632:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 177us (2081us total) trans 8589943198 rc 0/0 00000100:00100000:2.0:1746126621.401466:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3824 00000100:00100000:1.0:1746126621.427489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.427489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.427571:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721606016 00000100:00100000:1.0:1746126621.427579:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721606016 00000100:00100000:2.0:1746126621.427609:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721605760 00000100:00100000:2.0:1746126621.427612:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721605760 00000100:00100000:1.0:1746126621.427628:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9012 00000100:00100000:1.0:1746126621.427635:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+224:31451:x1830945721606016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.427654:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.427761:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0400/0xb50e825867614581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4a4 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.427868:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427877:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427885:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427894:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427899:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427903:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427970:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427975:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.427979:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126621.427986:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126621.428053:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428058:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428063:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428067:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a0a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126621.428070:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428074:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428082:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126621.428084:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126621.428086:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428090:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126621.428212:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13872 00000100:00100000:3.0:1746126621.428220:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:31442:x1830945721605760:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126621.428227:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.428236:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e49d expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.428251:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.428258:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.428259:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.428262:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.428277:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428281:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428286:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428289:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a1800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126621.428291:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.428298:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.428299:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 16 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.428304:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008eb98c00) 00010000:00010000:1.0:1746126621.428306:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126621.428308:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.428313:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 16 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.428313:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e82586761458f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126621.428323:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721426304:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.428345:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0400/0xb50e825867614581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 227 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.428353:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 226 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.428357:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126621.428359:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126621.428361:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0200, rc 0) 00000100:00100000:3.0:1746126621.428398:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.428449:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31451:x1830945721606016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 813us (966us total) trans 8589943199 rc 0/0 00000100:00100000:1.0:1746126621.428455:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9012 00000100:00100000:3.0:1746126621.430096:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721426304:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.430115:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.430126:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da00c00, rc 0) 00000100:00100000:3.0:1746126621.430214:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:31442:x1830945721605760:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1994us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.430221:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13872 00000100:00100000:0.0:1746126621.430473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.430577:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721606144 00000100:00100000:2.0:1746126621.430582:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721606144 00002000:00100000:2.0:1746126621.430609:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3428352->3784703) req@ffff8800924c6680 x1830945721606144/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.430616:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6680 with x1830945721606144 ext(3428352->3784703) 00010000:00010000:2.0:1746126621.430621:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 17 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.430630:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 17 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746126621.430635:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924c6680 00000100:00100000:2.0:1746126621.430656:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1807 00000100:00100000:2.0:1746126621.430660:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721606144:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126621.432719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.433201:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721606400 00000100:00100000:2.0:1746126621.433208:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721606400 00000100:00100000:2.0:1746126621.433248:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3825 00000100:00100000:2.0:1746126621.433255:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31451:x1830945721606400:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126621.435952:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+227:31451:x1830945721606400:12345-192.168.203.2@tcp:35:cat.0 Request processed in 2691us (3232us total) trans 8589943200 rc 0/0 00000100:00100000:2.0:1746126621.435960:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3825 00000100:00100000:0.0:1746126621.439427:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721606144:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 8759us (8948us total) trans 17179873262 rc 0/0 00000100:00100000:0.0:1746126621.439437:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1807 00002000:00100000:0.0:1746126621.439445:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3428352->3784703) req@ffff8800924c6680 x1830945721606144/t17179873262(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.439454:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6680 with x1830945721606144 ext(3428352->3784703) 00010000:00010000:0.0:1746126621.439462:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 19 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746126621.439474:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 19 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746126621.439480:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924c6680 00000100:00100000:0.0:1746126621.443431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.445107:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721606528 00000100:00100000:2.0:1746126621.445116:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721606528 00010000:00010000:2.0:1746126621.445147:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 19 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.445184:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7246 00000100:00100000:2.0:1746126621.445191:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721606528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.445202:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.445220:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 19 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.445230:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 19 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.445249:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135527400/0xb50e825867614534 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3784703) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e46c expref: 19 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.445266:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.445268:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.445275:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.445283:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.445308:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.445319:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721426432:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126621.445390:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.445474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.445617:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721606656 00000100:00100000:3.0:1746126621.445621:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721606656 00000100:00100000:3.0:1746126621.445641:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13873 00000100:00100000:3.0:1746126621.445645:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721606656:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.445655:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.445663:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008da00a00/0xb50e8258676145ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4ab expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.445685:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721426560:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.445712:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.459864:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721426432:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126621.459880:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.459915:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721606528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 14724us (16489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.459923:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7246 00000100:00100000:3.0:1746126621.460020:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721426560:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126621.460052:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008da00a00/0xb50e8258676145ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ab expref: 35 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.460063:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008da00a00/0xb50e8258676145ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ab expref: 35 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.460200:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da00a00, rc 0) 00000100:00100000:3.0:1746126621.460697:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721606656:12345-192.168.203.2@tcp:101:cat.0 Request processed in 15049us (15221us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126621.460703:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13873 00000100:00100000:1.0:1746126621.461987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.462118:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721606912 00000100:00100000:0.0:1746126621.462125:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721606912 00002000:00100000:0.0:1746126621.462157:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3923968->3928063) req@ffff88008dad3100 x1830945721606912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.462165:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3100 with x1830945721606912 ext(3923968->3928063) 00002000:00010000:0.0:1746126621.462170:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad3100 00000100:00100000:0.0:1746126621.462408:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7923 00000100:00100000:0.0:1746126621.462415:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721606912:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126621.462545:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721606912:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 130us (558us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126621.462551:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7923 00002000:00100000:0.0:1746126621.462556:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3923968->3928063) req@ffff88008dad3100 x1830945721606912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.462563:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad3100 with x1830945721606912 ext(3923968->3928063) 00002000:00010000:0.0:1746126621.462566:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad3100 00000100:00100000:0.0:1746126621.468678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.468717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.468905:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721607168 00000100:00100000:3.0:1746126621.468912:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721607168 00002000:00100000:3.0:1746126621.468944:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->540671) req@ffff8800924c4380 x1830945721607168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.468953:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4380 with x1830945721607168 ext(0->540671) 00002000:00010000:3.0:1746126621.468957:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c4380 00000100:00100000:3.0:1746126621.468978:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721607424 00000100:00100000:3.0:1746126621.468980:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721607424 00002000:00100000:3.0:1746126621.468989:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1413120->2097151) req@ffff8800924c4000 x1830945721607424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.468995:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4000 with x1830945721607424 ext(1413120->2097151) 00002000:00010000:3.0:1746126621.468997:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4000 00000100:00100000:3.0:1746126621.469006:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7924 00000100:00100000:3.0:1746126621.469011:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721607168:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.470106:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7925 00000100:00100000:1.0:1746126621.470115:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721607424:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.473141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.475285:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721607552 00000100:00100000:3.0:1746126621.475295:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721607552 00000100:00100000:3.0:1746126621.475345:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13874 00000100:00100000:3.0:1746126621.475353:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+26:31442:x1830945721607552:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126621.475366:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.475379:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4b2 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.475403:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 27 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.475410:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.475416:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.475421:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.475422:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.475424:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4784127] (req 4194304->4784127) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.475449:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 28 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.475459:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 28 pid: 10890 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.475469:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721426688:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.475560:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.475568:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 6 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.475575:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721426816:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.475596:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 27 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.475602:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 27 pid: 10890 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.475607:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721426944:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.475619:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.480576:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721607168:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11556us (11897us total) trans 0 rc 540672/540672 00000100:00100000:3.0:1746126621.480591:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7924 00002000:00100000:3.0:1746126621.480600:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->540671) req@ffff8800924c4380 x1830945721607168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.480609:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4380 with x1830945721607168 ext(0->540671) 00002000:00010000:3.0:1746126621.480613:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c4380 00000100:00100000:1.0:1746126621.480807:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721607424:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10693us (12088us total) trans 0 rc 684032/684032 00000100:00100000:1.0:1746126621.480816:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7925 00002000:00100000:1.0:1746126621.480821:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1413120->2097151) req@ffff8800924c4000 x1830945721607424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.480842:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4000 with x1830945721607424 ext(1413120->2097151) 00002000:00010000:1.0:1746126621.480845:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4000 00000100:00100000:3.0:1746126621.481294:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721426688:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.482902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.483017:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721426816:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.483025:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721426944:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.483060:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4784127] (req 4194304->4784127) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 25 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.483073:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01000, rc 0) 00000100:00100000:3.0:1746126621.483101:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+25:31442:x1830945721607552:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7750us (9967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.483107:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13874 00000100:00100000:2.0:1746126621.483194:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721607680 00000100:00100000:2.0:1746126621.483200:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721607680 00010000:00010000:2.0:1746126621.483221:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 7 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.483347:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7247 00000100:00100000:2.0:1746126621.483354:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721607680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.483365:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.483380:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 7 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.483389:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 7 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.483407:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e82586761450a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e450 expref: 7 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.483420:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.483439:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721607680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 86us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.483444:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7247 00000100:00100000:0.0:1746126621.489285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.489336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.489426:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721607808 00000100:00100000:3.0:1746126621.489434:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721607808 00010000:00010000:3.0:1746126621.489466:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 25 pid: 10890 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.489487:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721607936 00000100:00100000:3.0:1746126621.489489:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721607936 00010000:00010000:3.0:1746126621.489498:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 29 pid: 10890 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.489511:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7248 00000100:00100000:3.0:1746126621.489518:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721607808:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.489528:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.489545:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 25 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.489554:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 25 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.489576:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c2e000/0xb50e82586761439e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e370 expref: 25 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.489591:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126621.489775:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7249 00000100:00100000:0.0:1746126621.489782:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721607936:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126621.489789:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126621.489798:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 29 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746126621.489807:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 29 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746126621.489818:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7d000/0xb50e825867614431 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3c4 expref: 29 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746126621.489852:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.489854:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126621.489859:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.489866:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.489892:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.489903:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721427072:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126621.489963:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721607808:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 444us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.489968:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7248 00000100:00100000:0.0:1746126621.490447:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.494804:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721427072:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126621.494822:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126621.494894:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721607936:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5111us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126621.494904:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7249 00000100:00100000:0.0:1746126621.501424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.501510:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721608192 00000100:00100000:1.0:1746126621.501518:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721608192 00002000:00100000:1.0:1746126621.501556:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4780032->4784127) req@ffff8800a448dc00 x1830945721608192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.501565:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448dc00 with x1830945721608192 ext(4780032->4784127) 00002000:00010000:1.0:1746126621.501570:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448dc00 00000100:00100000:1.0:1746126621.501599:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7926 00000100:00100000:1.0:1746126621.501605:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721608192:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.501757:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721608192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 152us (340us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126621.501763:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7926 00002000:00100000:1.0:1746126621.501768:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4780032->4784127) req@ffff8800a448dc00 x1830945721608192/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.501774:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448dc00 with x1830945721608192 ext(4780032->4784127) 00002000:00010000:1.0:1746126621.501777:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448dc00 00000100:00100000:0.0:1746126621.507688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.508011:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721608448 00000100:00100000:2.0:1746126621.508019:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721608448 00000100:00100000:2.0:1746126621.508062:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3826 00000100:00100000:2.0:1746126621.508069:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+227:31442:x1830945721608448:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126621.509199:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+228:31442:x1830945721608448:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 1128us (1515us total) trans 8589943201 rc 0/0 00000100:00100000:2.0:1746126621.509207:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3826 00000100:00100000:0.0:1746126621.527674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.527720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.527739:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721608960 00000100:00100000:1.0:1746126621.527748:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721608960 00000100:00100000:0.0:1746126621.527748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.527762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.527794:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9013 00000100:00100000:1.0:1746126621.527801:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31453:x1830945721608960:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126621.527823:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.527857:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e8258676145b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4b9 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.527939:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.527953:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.527961:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.527970:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.527975:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.527979:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528059:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528065:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528070:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746126621.528076:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126621.528133:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528141:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528146:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528150:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a1a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126621.528153:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528157:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528164:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126621.528166:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126621.528169:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528173:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1a00/0xb50e8258676145c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528184:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528187:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528191:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528194:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a1e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126621.528196:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528203:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528207:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f1d5600) 00010000:00010000:1.0:1746126621.528209:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126621.528211:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528214:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.528238:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e8258676145b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.528246:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.528250:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126621.528252:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126621.528253:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0800, rc 0) 00000100:00100000:1.0:1746126621.528286:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31453:x1830945721608960:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 486us (620us total) trans 8589943202 rc 0/0 00000100:00100000:1.0:1746126621.528292:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9013 00000100:00100000:0.0:1746126621.528432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.528602:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721608704 00000100:00100000:1.0:1746126621.528606:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721608704 00000100:00100000:2.0:1746126621.528614:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721609216 00000100:00100000:2.0:1746126621.528617:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721609216 00002000:00100000:2.0:1746126621.528629:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a448ed80 x1830945721609216/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.528629:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a448c380 x1830945721608704/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.528637:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ed80 with x1830945721609216 ext(3145728->4194303) 00002000:00100000:1.0:1746126621.528637:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448c380 with x1830945721608704 ext(2097152->3145727) 00002000:00010000:2.0:1746126621.528642:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ed80 00002000:00010000:1.0:1746126621.528642:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448c380 00000100:00100000:2.0:1746126621.528652:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721609472 00000100:00100000:2.0:1746126621.528654:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721609472 00002000:00100000:2.0:1746126621.528663:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a448e680 x1830945721609472/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746126621.528664:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7927 00002000:00100000:2.0:1746126621.528669:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448e680 with x1830945721609472 ext(2097152->3145727) 00000100:00100000:3.0:1746126621.528671:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721609216:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:2.0:1746126621.528672:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448e680 00000100:00100000:1.0:1746126621.529140:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721609728 00000100:00100000:1.0:1746126621.529144:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721609728 00002000:00100000:1.0:1746126621.529156:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3923967) req@ffff8800a448ea00 x1830945721609728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.529161:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ea00 with x1830945721609728 ext(3145728->3923967) 00002000:00010000:1.0:1746126621.529163:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448ea00 00000100:00100000:1.0:1746126621.529174:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7928 00000100:00100000:1.0:1746126621.529179:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721608704:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.530626:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7929 00000100:00100000:3.0:1746126621.530635:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721609472:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.532985:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7930 00000100:00100000:3.0:1746126621.532998:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721609728:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.554243:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721609472:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23600us (26468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.554255:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7929 00002000:00100000:3.0:1746126621.554265:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a448e680 x1830945721609472/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.554274:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448e680 with x1830945721609472 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.554279:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448e680 00000100:00100000:3.0:1746126621.563895:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721609216:12345-192.168.203.2@tcp:3:cat.0 Request processed in 35213us (36134us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.563910:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7927 00002000:00100000:3.0:1746126621.563921:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800a448ed80 x1830945721609216/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.563930:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ed80 with x1830945721609216 ext(3145728->4194303) 00002000:00010000:3.0:1746126621.563936:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ed80 00000100:00100000:3.0:1746126621.570094:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721609728:12345-192.168.203.2@tcp:3:cat.0 Request processed in 37088us (41648us total) trans 0 rc 778240/778240 00000100:00100000:3.0:1746126621.570103:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7930 00002000:00100000:3.0:1746126621.570113:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3923967) req@ffff8800a448ea00 x1830945721609728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.570121:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ea00 with x1830945721609728 ext(3145728->3923967) 00002000:00010000:3.0:1746126621.570126:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448ea00 00000100:00100000:1.0:1746126621.572938:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721608704:12345-192.168.203.2@tcp:3:cat.0 Request processed in 43750us (45209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126621.572948:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7928 00002000:00100000:1.0:1746126621.572957:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a448c380 x1830945721608704/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.572965:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448c380 with x1830945721608704 ext(2097152->3145727) 00002000:00010000:1.0:1746126621.572970:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448c380 00000100:00100000:0.0:1746126621.589618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.589662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.589689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.589703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.589817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.589949:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721609856 00000100:00100000:3.0:1746126621.589957:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721609856 00000100:00100000:3.0:1746126621.589999:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721609984 00000100:00100000:3.0:1746126621.590001:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721609984 00000100:00100000:3.0:1746126621.590013:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721610112 00000100:00100000:3.0:1746126621.590014:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721610112 00000100:00100000:3.0:1746126621.590041:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721610240 00000100:00100000:3.0:1746126621.590043:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721610240 00000100:00100000:3.0:1746126621.590058:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13875 00000100:00100000:3.0:1746126621.590064:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721609856:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.590078:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.590092:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c400/0xb50e8258676145dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4c0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.590137:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721427200:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.590210:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.590227:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13876 00000100:00100000:3.0:1746126621.590232:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721609984:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.590239:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.590247:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d400/0xb50e8258676145e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4c7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.590269:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721427328:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.590287:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.590298:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13877 00000100:00100000:3.0:1746126621.590308:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721610112:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.590314:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.590320:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e8258676145ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4ce expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.590338:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721427456:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.590354:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.590377:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13878 00000100:00100000:3.0:1746126621.590382:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721610240:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.590387:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.590393:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e8258676145f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4d5 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.590418:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721427584:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.590435:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.590682:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721610496 00000100:00100000:1.0:1746126621.590687:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721610496 00002000:00100000:1.0:1746126621.590710:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4784128->4976639) req@ffff8800a448c700 x1830945721610496/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.590719:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448c700 with x1830945721610496 ext(4784128->4976639) 00002000:00010000:1.0:1746126621.590723:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448c700 00000100:00100000:1.0:1746126621.590748:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7931 00000100:00100000:1.0:1746126621.590754:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721610496:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.594999:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721610496:12345-192.168.203.2@tcp:3:cat.0 Request processed in 4237us (5173us total) trans 0 rc 192512/192512 00000100:00100000:1.0:1746126621.595009:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7931 00002000:00100000:1.0:1746126621.595019:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4784128->4976639) req@ffff8800a448c700 x1830945721610496/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 192512/192512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.595027:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448c700 with x1830945721610496 ext(4784128->4976639) 00002000:00010000:1.0:1746126621.595041:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448c700 00002000:00010000:2.0:1746126621.597080:0:20294:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime: 1746126620 -> 1746126621 00002000:00010000:2.0:1746126621.597085:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126620 -> 1746126621 00002000:00010000:2.0:1746126621.597086:0:20294:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime: 1746126620 -> 1746126621 00000100:00100000:2.0:1746126621.597103:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721427456:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.597128:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e8258676145ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ce expref: 31 pid: 20294 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126621.597132:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721427584:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.597140:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e8258676145ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ce expref: 31 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.597152:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e8258676145f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4d5 expref: 21 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.597161:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7c600/0xb50e8258676145f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4d5 expref: 21 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.597167:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7ca00, rc 0) 00010000:00010000:3.0:1746126621.597180:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c600, rc 0) 00000100:00100000:3.0:1746126621.597207:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721610240:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6824us (7502us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.597208:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721610112:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6904us (7517us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126621.597215:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13878 00002000:00010000:3.0:1746126621.597253:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126620 -> 1746126621 00002000:00010000:3.0:1746126621.597255:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126620 -> 1746126621 00002000:00010000:3.0:1746126621.597257:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126620 -> 1746126621 00000100:00100000:3.0:1746126621.597264:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721427328:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126621.597276:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d400/0xb50e8258676145e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4c7 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.597283:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d400/0xb50e8258676145e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4c7 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.597289:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7d400, rc 0) 00000100:00100000:3.0:1746126621.597302:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721609984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7071us (7641us total) trans 0 rc 301/301 00002000:00010000:0.0:1746126621.598901:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126620 -> 1746126621 00002000:00010000:0.0:1746126621.598906:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126620 -> 1746126621 00002000:00010000:0.0:1746126621.598907:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126620 -> 1746126621 00000100:00100000:0.0:1746126621.598920:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721427200:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126621.598938:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c400/0xb50e8258676145dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4c0 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.598948:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c400/0xb50e8258676145dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4c0 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.598968:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c400, rc 0) 00000100:00100000:0.0:1746126621.598995:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721609856:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8931us (9386us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.599110:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13877 00000100:00100000:3.0:1746126621.599165:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13876 00000100:00100000:0.0:1746126621.599254:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13875 00000100:00100000:0.0:1746126621.612394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.612454:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721610624 00000100:00100000:1.0:1746126621.612462:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721610624 00000100:00100000:1.0:1746126621.612579:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13879 00000100:00100000:1.0:1746126621.612588:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31457:x1830945721610624:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.612603:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.614644:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4dc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.614677:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.614684:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126621.614686:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126621.614689:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.614716:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.614730:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 23 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.614742:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721427712:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.615930:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.620084:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721427712:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.621998:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.622018:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1e00, rc 0) 00000100:00100000:0.0:1746126621.622906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.622991:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:31457:x1830945721610624:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10402us (10602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.622999:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13879 00000100:00100000:1.0:1746126621.623042:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721610752 00000100:00100000:1.0:1746126621.623049:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721610752 00002000:00100000:1.0:1746126621.623078:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (540672->1048575) req@ffff8800a448d500 x1830945721610752/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.623086:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448d500 with x1830945721610752 ext(540672->1048575) 00010000:00010000:1.0:1746126621.623093:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 24 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.623103:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 24 pid: 8437 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.623112:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448d500 00000100:00100000:1.0:1746126621.624894:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1808 00000100:00100000:1.0:1746126621.624910:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721610752:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126621.636751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.636855:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611008 00000100:00100000:2.0:1746126621.636863:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611008 00000100:00100000:2.0:1746126621.637575:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9014 00000100:00100000:2.0:1746126621.637583:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+228:31460:x1830945721611008:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126621.637601:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.637616:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae42200/0xb50e8258676145ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4e3 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.637682:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.637692:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.637698:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 229 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.637704:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.637709:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.637731:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.637739:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 13 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.637749:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721427840:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.638078:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 229 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.638086:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 229 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.638098:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721427968:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.638127:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.638134:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 8 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.638140:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721428096:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.638153:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.639888:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721610752:12345-192.168.203.2@tcp:4:cat.0 Request processed in 14981us (16979us total) trans 21474840411 rc 0/0 00000100:00100000:1.0:1746126621.639897:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1808 00002000:00100000:1.0:1746126621.639905:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (540672->1048575) req@ffff8800a448d500 x1830945721610752/t21474840411(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.639913:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448d500 with x1830945721610752 ext(540672->1048575) 00010000:00010000:1.0:1746126621.639921:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 26 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.639931:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 26 pid: 8437 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.639937:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448d500 00000100:00100000:3.0:1746126621.641115:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721427840:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.645134:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721427968:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.645145:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721428096:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.645168:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126621.645413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.645449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.645474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.645548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.645731:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611136 00000100:00100000:3.0:1746126621.645736:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611136 00010000:00010000:3.0:1746126621.645763:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 14 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.645784:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611392 00000100:00100000:3.0:1746126621.645786:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611392 00010000:00010000:3.0:1746126621.645794:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 9 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.645805:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611264 00000100:00100000:3.0:1746126621.645807:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611264 00010000:00010000:3.0:1746126621.645815:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 230 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.645851:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7250 00000100:00100000:3.0:1746126621.645858:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721611136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.645870:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.645875:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 14 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.645883:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 14 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.645900:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e8258676145ce lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b9 expref: 14 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.645913:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.645917:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.645923:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.645928:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.645959:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721611136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.645965:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7250 00000100:00100000:3.0:1746126621.645976:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7251 00000100:00100000:3.0:1746126621.645980:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721611392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.645985:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.645988:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 9 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.645994:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 9 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.646003:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69c00/0xb50e825867614557 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e47a expref: 9 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.646009:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.646012:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.646016:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.646019:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.646040:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721611392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 59us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.646044:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7251 00000100:00100000:3.0:1746126621.646052:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7252 00000100:00100000:3.0:1746126621.646055:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:1963:x1830945721611264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.646060:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.646063:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 230 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.646069:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 230 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.646078:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0200/0xb50e825867614596 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4a4 expref: 230 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.646084:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.646086:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.646092:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.646098:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.646113:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.646126:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721611264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.646130:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7252 00010000:00010000:3.0:1746126621.646150:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.646155:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126621.646167:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126621.646265:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae42200/0xb50e8258676145ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 230 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.646277:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 229 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.646283:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.646285:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126621.646286:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43e00, rc 0) 00000100:00100000:3.0:1746126621.646309:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+229:31460:x1830945721611008:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8727us (9631us total) trans 8589943203 rc 0/0 00000100:00100000:3.0:1746126621.646314:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9014 00000100:00100000:1.0:1746126621.646383:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611520 00000100:00100000:1.0:1746126621.646387:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611520 00000100:00100000:1.0:1746126621.646419:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13880 00000100:00100000:1.0:1746126621.646424:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31453:x1830945721611520:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126621.646434:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.646444:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4ea expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.646465:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.646470:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126621.646472:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126621.646475:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.646494:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 33 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.646502:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 33 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.646512:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721428224:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.646563:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.648127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.648206:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611648 00000100:00100000:2.0:1746126621.648212:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611648 00010000:00010000:2.0:1746126621.648232:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 26 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.648263:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7253 00000100:00100000:2.0:1746126621.648269:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721611648:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.648278:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.648295:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 26 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.648304:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 26 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.648319:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a02e00/0xb50e82586761445b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 540672->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3e0 expref: 26 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.648501:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721428224:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.648518:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.648530:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1a00, rc 0) 00010000:00010000:2.0:1746126621.648898:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.648900:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.648906:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.648913:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.648935:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.648944:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721428352:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126621.649115:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31453:x1830945721611520:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2690us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.649121:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13880 00000100:00100000:2.0:1746126621.649568:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.649735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.650348:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721611776 00000100:00100000:2.0:1746126621.650353:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721611776 00002000:00100000:2.0:1746126621.650380:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3923968->4194303) req@ffff88008dad2a00 x1830945721611776/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.650388:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad2a00 with x1830945721611776 ext(3923968->4194303) 00010000:00010000:2.0:1746126621.650395:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 34 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.650405:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 34 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746126621.650411:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dad2a00 00000100:00100000:2.0:1746126621.650532:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1809 00000100:00100000:2.0:1746126621.650538:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721611776:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126621.654435:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721428352:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126621.654454:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.654553:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721611648:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6281us (6426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.654563:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7253 00000100:00100000:2.0:1746126621.655502:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721611776:12345-192.168.203.2@tcp:4:cat.0 Request processed in 4962us (5766us total) trans 17179873263 rc 0/0 00000100:00100000:2.0:1746126621.655511:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1809 00002000:00100000:2.0:1746126621.655519:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3923968->4194303) req@ffff88008dad2a00 x1830945721611776/t17179873263(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.655528:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad2a00 with x1830945721611776 ext(3923968->4194303) 00010000:00010000:2.0:1746126621.655536:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 36 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.655548:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 36 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746126621.655553:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dad2a00 00000100:00100000:0.0:1746126621.660569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.660617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.660680:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612032 00000100:00100000:2.0:1746126621.660690:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612032 00002000:00100000:2.0:1746126621.660731:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddaea00 x1830945721612032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.660740:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaea00 with x1830945721612032 ext(0->1048575) 00002000:00010000:2.0:1746126621.660745:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddaea00 00000100:00100000:2.0:1746126621.660769:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7932 00000100:00100000:2.0:1746126621.660775:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721612032:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126621.661931:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612160 00000100:00100000:3.0:1746126621.661936:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612160 00010000:00010000:3.0:1746126621.661959:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 36 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.661990:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7254 00000100:00100000:3.0:1746126621.661994:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721612160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.662004:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.662018:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 36 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.662041:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 36 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.662058:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008da00c00/0xb50e8258676145a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e49d expref: 36 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.662079:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.662080:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.662085:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.662092:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.662120:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.662133:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721428480:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126621.662486:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.672899:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721428480:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126621.672920:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.672973:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721612160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10977us (12354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.672982:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7254 00000100:00100000:0.0:1746126621.673139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.675165:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612416 00000100:00100000:2.0:1746126621.675176:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612416 00002000:00100000:2.0:1746126621.675217:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3809280->3813375) req@ffff88012ddaca80 x1830945721612416/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.675226:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaca80 with x1830945721612416 ext(3809280->3813375) 00002000:00010000:2.0:1746126621.675231:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddaca80 00000100:00100000:2.0:1746126621.675269:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7933 00000100:00100000:2.0:1746126621.675276:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721612416:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126621.676160:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721612416:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 881us (3023us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126621.676166:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7933 00002000:00100000:2.0:1746126621.676173:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3809280->3813375) req@ffff88012ddaca80 x1830945721612416/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.676180:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaca80 with x1830945721612416 ext(3809280->3813375) 00002000:00010000:2.0:1746126621.676183:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddaca80 00000100:00100000:2.0:1746126621.683333:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721612032:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 22550us (22766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.683344:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7932 00002000:00100000:2.0:1746126621.683355:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88012ddaea00 x1830945721612032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.683364:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaea00 with x1830945721612032 ext(0->1048575) 00002000:00010000:2.0:1746126621.683369:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddaea00 00000100:00100000:0.0:1746126621.683860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.684131:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612544 00000100:00100000:2.0:1746126621.684137:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612544 00000100:00100000:2.0:1746126621.684546:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13881 00000100:00100000:2.0:1746126621.684554:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+29:31453:x1830945721612544:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126621.684567:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.684580:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4f1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.684602:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.684610:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126621.684612:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126621.684614:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->4509695] (req 4194304->4509695) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.684638:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 24 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.684648:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 24 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.684658:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721428608:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.685301:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.688424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.688657:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721428608:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.688681:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->4509695] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.688695:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7c000, rc 0) 00000100:00100000:2.0:1746126621.688859:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+30:31453:x1830945721612544:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4305us (4999us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.688867:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13881 00000100:00100000:3.0:1746126621.690198:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612672 00000100:00100000:3.0:1746126621.690204:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612672 00002000:00100000:3.0:1746126621.690237:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4784127) req@ffff88012ddadf80 x1830945721612672/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.690246:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddadf80 with x1830945721612672 ext(4194304->4784127) 00010000:00010000:3.0:1746126621.690254:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 25 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.690265:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 25 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746126621.690271:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ddadf80 00000100:00100000:3.0:1746126621.690294:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1810 00000100:00100000:3.0:1746126621.690300:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721612672:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126621.703061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.704210:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612800 00000100:00100000:2.0:1746126621.704219:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612800 00000100:00100000:2.0:1746126621.704264:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13882 00000100:00100000:2.0:1746126621.704271:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31457:x1830945721612800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126621.704285:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.704299:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4f8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.704325:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.704332:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126621.704334:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126621.704336:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.704362:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.704370:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 34 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.704381:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721428736:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.705155:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.710968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.711000:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721428736:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.711008:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721612928 00000100:00100000:1.0:1746126621.711014:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721612928 00002000:00100000:1.0:1746126621.711057:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1413119) req@ffff88008dad0a80 x1830945721612928/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.711066:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0a80 with x1830945721612928 ext(1048576->1413119) 00010000:00010000:1.0:1746126621.711075:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 35 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.711086:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 35 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.711092:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dad0a80 00000100:00100000:1.0:1746126621.711113:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1811 00000100:00100000:1.0:1746126621.711120:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721612928:12345-192.168.203.2@tcp:4:cat.0 00010000:00010000:2.0:1746126621.711443:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.711895:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7d000, rc 0) 00000100:00100000:2.0:1746126621.711933:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31457:x1830945721612800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7662us (8878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.711942:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13882 00000100:00100000:3.0:1746126621.715501:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721612672:12345-192.168.203.2@tcp:4:cat.0 Request processed in 25193us (27076us total) trans 21474840412 rc 0/0 00000100:00100000:3.0:1746126621.715511:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1810 00002000:00100000:3.0:1746126621.715521:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4784127) req@ffff88012ddadf80 x1830945721612672/t21474840412(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.715530:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddadf80 with x1830945721612672 ext(4194304->4784127) 00010000:00010000:3.0:1746126621.715539:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.715550:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746126621.715556:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ddadf80 00000100:00100000:1.0:1746126621.723901:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721612928:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12773us (12932us total) trans 17179873264 rc 0/0 00000100:00100000:1.0:1746126621.723910:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1811 00002000:00100000:1.0:1746126621.723920:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1413119) req@ffff88008dad0a80 x1830945721612928/t17179873264(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.723927:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad0a80 with x1830945721612928 ext(1048576->1413119) 00010000:00010000:1.0:1746126621.723936:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 37 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.723946:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 37 pid: 20294 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.723953:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dad0a80 00000100:00100000:0.0:1746126621.727261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.727438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.727505:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721613056 00000100:00100000:1.0:1746126621.727512:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721613056 00010000:00010000:1.0:1746126621.727542:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.727578:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721613184 00000100:00100000:1.0:1746126621.727580:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721613184 00010000:00010000:1.0:1746126621.727591:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 37 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.727605:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7255 00000100:00100000:1.0:1746126621.727611:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721613056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.727622:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.727639:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.727649:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.727655:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7256 00000100:00100000:3.0:1746126621.727663:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721613184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.727667:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008da01000/0xb50e8258676145b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4784127) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4b2 expref: 27 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.727671:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.727684:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 37 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.727691:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.727693:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 37 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.727693:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.727699:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.727706:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.727707:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c68200/0xb50e825867614469 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3ee expref: 37 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.727725:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.727726:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.727730:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.727733:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.727737:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.727743:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721428864:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126621.727756:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.727764:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721428992:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126621.727808:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.727816:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211600 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.731615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.731635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.731783:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721613312 00000100:00100000:3.0:1746126621.731790:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721613312 00000100:00100000:3.0:1746126621.731857:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13883 00000100:00100000:3.0:1746126621.731864:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:31460:x1830945721613312:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126621.731878:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.731894:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e4ff expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.731916:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.731923:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.731924:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.731928:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [155648->712703] (req 155648->712703) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.731952:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.731962:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 29 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.731972:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721429120:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.732068:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.732106:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721428864:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126621.732119:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.732137:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721613056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4527us (4883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.732145:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7255 00000100:00100000:2.0:1746126621.732225:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721428992:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126621.732238:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.732255:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721613184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4594us (4817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.732261:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7256 00000100:00100000:1.0:1746126621.732750:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721613568 00000100:00100000:1.0:1746126621.732754:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721613568 00002000:00100000:1.0:1746126621.732777:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4505600->4509695) req@ffff88012ddae300 x1830945721613568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.732785:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddae300 with x1830945721613568 ext(4505600->4509695) 00002000:00010000:1.0:1746126621.732788:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddae300 00000100:00100000:1.0:1746126621.732808:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7934 00000100:00100000:1.0:1746126621.732812:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721613568:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126621.732942:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721613568:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 129us (1306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126621.732947:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7934 00002000:00100000:1.0:1746126621.732951:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4505600->4509695) req@ffff88012ddae300 x1830945721613568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.732957:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddae300 with x1830945721613568 ext(4505600->4509695) 00002000:00010000:1.0:1746126621.732960:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddae300 00000100:00100000:0.0:1746126621.736048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.736088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.738112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.738133:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721614336 00000100:00100000:2.0:1746126621.738139:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721614336 00000100:00100000:2.0:1746126621.738174:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3827 00000100:00100000:2.0:1746126621.738180:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31453:x1830945721614336:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126621.738341:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31453:x1830945721614336:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 161us (232us total) trans 8589943204 rc 0/0 00000100:00100000:2.0:1746126621.738347:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3827 00000100:00100000:3.0:1746126621.739083:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721614080 00000100:00100000:3.0:1746126621.739089:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721614080 00002000:00100000:3.0:1746126621.739113:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012ddad880 x1830945721614080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.739121:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad880 with x1830945721614080 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.739125:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddad880 00000100:00100000:3.0:1746126621.739149:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721613952 00000100:00100000:3.0:1746126621.739152:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721613952 00002000:00100000:3.0:1746126621.739164:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012ddaf480 x1830945721613952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.739170:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaf480 with x1830945721613952 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.739173:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddaf480 00000100:00100000:3.0:1746126621.739183:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7935 00000100:00100000:3.0:1746126621.739188:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721614080:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126621.740375:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7936 00000100:00100000:1.0:1746126621.740385:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721613952:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126621.751723:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721429120:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.751751:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [155648->712703] (req 155648->712703) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.751765:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008da01200, rc 0) 00000100:00100000:3.0:1746126621.751804:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+27:31460:x1830945721613312:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 19940us (20194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.751811:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13883 00000100:00100000:0.0:1746126621.754717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.755949:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721614464 00000100:00100000:3.0:1746126621.755957:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721614464 00010000:00010000:3.0:1746126621.755986:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 32 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.756600:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7257 00000100:00100000:3.0:1746126621.756607:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721614464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.756617:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.756634:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 32 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.756644:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 32 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.756662:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1e00/0xb50e8258676145f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4dc expref: 32 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.756680:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.756681:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.756686:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.756694:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.756717:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.756726:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721429248:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126621.759070:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.762064:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721614080:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 22868us (26016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.762074:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7935 00002000:00100000:3.0:1746126621.762082:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88012ddad880 x1830945721614080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.762089:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad880 with x1830945721614080 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.762094:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddad880 00000100:00100000:0.0:1746126621.767693:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721613952:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 27302us (31595us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126621.767705:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7936 00002000:00100000:0.0:1746126621.767717:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012ddaf480 x1830945721613952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.767726:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaf480 with x1830945721613952 ext(1048576->2097151) 00002000:00010000:0.0:1746126621.767731:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddaf480 00000100:00100000:3.0:1746126621.768045:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721429248:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126621.768060:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.768091:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721614464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 11485us (13380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.768101:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7257 00000100:00100000:0.0:1746126621.773003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.773110:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721614720 00000100:00100000:1.0:1746126621.773118:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721614720 00002000:00100000:1.0:1746126621.773155:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (708608->712703) req@ffff88012ddac700 x1830945721614720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.773164:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac700 with x1830945721614720 ext(708608->712703) 00002000:00010000:1.0:1746126621.773168:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac700 00000100:00100000:1.0:1746126621.773195:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7937 00000100:00100000:1.0:1746126621.773202:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721614720:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126621.773333:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721614720:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 131us (338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126621.773338:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7937 00002000:00100000:1.0:1746126621.773344:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (708608->712703) req@ffff88012ddac700 x1830945721614720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/4536 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.773350:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac700 with x1830945721614720 ext(708608->712703) 00002000:00010000:1.0:1746126621.773353:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac700 00000100:00100000:0.0:1746126621.800251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.800287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.800311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.801703:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721614976 00000100:00100000:3.0:1746126621.801712:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721614976 00002000:00100000:3.0:1746126621.801751:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88012ddad180 x1830945721614976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746126621.801751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00100000:3.0:1746126621.801760:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad180 with x1830945721614976 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.801765:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddad180 00000100:00100000:0.0:1746126621.801765:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721615232 00000100:00100000:0.0:1746126621.801769:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721615232 00000100:00100000:3.0:1746126621.801778:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721615488 00000100:00100000:3.0:1746126621.801780:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721615488 00002000:00100000:0.0:1746126621.801785:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012ddadc00 x1830945721615232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.801791:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012ddac380 x1830945721615488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126621.801793:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddadc00 with x1830945721615232 ext(3145728->4194303) 00002000:00010000:0.0:1746126621.801796:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddadc00 00002000:00100000:3.0:1746126621.801797:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac380 with x1830945721615488 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.801800:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddac380 00000100:00100000:3.0:1746126621.801821:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721615744 00000100:00100000:3.0:1746126621.801823:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721615744 00002000:00100000:3.0:1746126621.801847:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3809279) req@ffff88012ddafb80 x1830945721615744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.801853:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddafb80 with x1830945721615744 ext(3145728->3809279) 00002000:00010000:3.0:1746126621.801855:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddafb80 00000100:00100000:3.0:1746126621.801866:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7938 00000100:00100000:3.0:1746126621.801872:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721614976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126621.801884:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7939 00000100:00100000:2.0:1746126621.801891:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721615232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126621.802960:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7940 00000100:00100000:2.0:1746126621.802968:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721615488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.803808:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7941 00000100:00100000:0.0:1746126621.803815:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721615744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126621.826879:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721615232:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24980us (26582us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.826889:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7939 00002000:00100000:2.0:1746126621.826898:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012ddadc00 x1830945721615232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.826906:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddadc00 with x1830945721615232 ext(3145728->4194303) 00002000:00010000:2.0:1746126621.826911:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddadc00 00000100:00100000:3.0:1746126621.827928:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721614976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26053us (27682us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.827936:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7938 00002000:00100000:3.0:1746126621.827941:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88012ddad180 x1830945721614976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.827949:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddad180 with x1830945721614976 ext(2097152->3145727) 00002000:00010000:3.0:1746126621.827952:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddad180 00000100:00100000:1.0:1746126621.828912:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721615744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25093us (27158us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746126621.828919:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7941 00002000:00100000:1.0:1746126621.828925:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3809279) req@ffff88012ddafb80 x1830945721615744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.828932:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddafb80 with x1830945721615744 ext(3145728->3809279) 00002000:00010000:1.0:1746126621.828935:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddafb80 00000100:00100000:2.0:1746126621.840099:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721615488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 37125us (39780us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.840109:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7940 00002000:00100000:2.0:1746126621.840119:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012ddac380 x1830945721615488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.840127:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac380 with x1830945721615488 ext(2097152->3145727) 00002000:00010000:2.0:1746126621.840132:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ddac380 00000100:00100000:0.0:1746126621.841227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.841286:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721615872 00000100:00100000:3.0:1746126621.841293:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721615872 00000100:00100000:0.0:1746126621.841367:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9015 00000100:00100000:0.0:1746126621.841374:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31463:x1830945721615872:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126621.841391:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.841406:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e506 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.841447:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841457:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841464:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841473:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841478:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841483:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841554:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841561:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 228 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.841566:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.841587:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 228 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.841597:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 228 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746126621.841606:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721429376:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.845613:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.848645:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721429376:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.848667:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126621.848747:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126621.849167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.849457:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721616000 00000100:00100000:3.0:1746126621.849464:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721616000 00000100:00100000:3.0:1746126621.849508:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13884 00000100:00100000:3.0:1746126621.849514:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721616000:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.849527:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.849540:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b22d800/0xb50e82586761464c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e50d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.849577:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721429504:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.849635:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.849893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.849928:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721616256 00000100:00100000:2.0:1746126621.849932:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721616256 00000100:00100000:2.0:1746126621.849963:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3828 00000100:00100000:2.0:1746126621.849967:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:26823:x1830945721616256:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746126621.850116:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:26823:x1830945721616256:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 147us (222us total) trans 8589943205 rc 0/0 00000100:00100000:2.0:1746126621.850125:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3828 00000100:00100000:3.0:1746126621.852287:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721429504:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126621.852311:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b22d800/0xb50e82586761464c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e50d expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.852322:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b22d800/0xb50e82586761464c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e50d expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.852344:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b22d800, rc 0) 00000100:00100000:3.0:1746126621.853793:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721616000:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4274us (4622us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126621.853806:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13884 00000100:00100000:1.0:1746126621.854571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.854658:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721616384 00000100:00100000:3.0:1746126621.854664:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721616384 00010000:00010000:3.0:1746126621.854687:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 230 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.854716:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7258 00000100:00100000:3.0:1746126621.854721:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1963:x1830945721616384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.854730:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.854735:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 230 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.854743:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 230 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.854759:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43e00/0xb50e825867614606 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4e3 expref: 230 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.854770:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.854774:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.854781:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.854786:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126621.854808:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.854856:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721616384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 134us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.854862:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7258 00010000:00010000:2.0:1746126621.855417:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855424:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126621.855456:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126621.855459:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126621.855472:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855481:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855488:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855494:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855498:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855503:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e39aa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126621.855506:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855511:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855519:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126621.855521:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126621.855524:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855528:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39aa00/0xb50e825867614637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855536:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855541:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855545:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855548:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126621.855550:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855554:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855558:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4100) 00010000:00010000:2.0:1746126621.855560:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126621.855562:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855566:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e000/0xb50e82586761463e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.855590:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.855598:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.855604:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.855606:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126621.855608:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2ec00, rc 0) 00000100:00100000:2.0:1746126621.855644:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31463:x1830945721615872:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 14271us (14419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.855650:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9015 00000100:00100000:1.0:1746126621.859277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.859315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.859345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.859366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.859400:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721616512 00000100:00100000:1.0:1746126621.859407:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721616512 00000100:00100000:1.0:1746126621.859434:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721616640 00000100:00100000:1.0:1746126621.859435:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721616640 00000100:00100000:1.0:1746126621.859444:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721616768 00000100:00100000:1.0:1746126621.859446:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721616768 00000100:00100000:1.0:1746126621.859455:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13885 00000100:00100000:1.0:1746126621.859461:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721616512:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126621.859473:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.859487:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1600/0xb50e825867614653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e514 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.859527:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721429632:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126621.859589:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.859602:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721617024 00000100:00100000:1.0:1746126621.859605:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721617024 00000100:00100000:1.0:1746126621.859623:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13886 00000100:00100000:1.0:1746126621.859628:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721616640:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126621.859635:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.859643:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e51b expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.859654:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.859655:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.859662:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.859673:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.859680:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0200, rc 0) 00000100:00100000:1.0:1746126621.859699:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721616640:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 71us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.859704:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13886 00000100:00100000:1.0:1746126621.859715:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13887 00000100:00100000:1.0:1746126621.859718:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721616768:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126621.859723:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.859728:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0e00/0xb50e825867614661 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e522 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.859745:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721429760:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126621.859762:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.859775:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13888 00000100:00100000:1.0:1746126621.859779:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721617024:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126621.859784:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.859790:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0c00/0xb50e825867614668 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e529 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.859809:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721429888:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126621.859843:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.860418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.860455:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721617152 00000100:00100000:2.0:1746126621.860462:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721617152 00000100:00100000:2.0:1746126621.860494:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9016 00000100:00100000:2.0:1746126621.860498:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+229:31466:x1830945721617152:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126621.860510:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.860519:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7dc00/0xb50e82586761466f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e530 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.860601:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860611:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860622:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860632:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860637:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860645:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860732:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860739:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860744:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126621.860751:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126621.860812:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860817:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860822:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860857:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7c200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126621.860860:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860865:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860874:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126621.860876:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126621.860879:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860887:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c200/0xb50e825867614676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860896:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860901:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860905:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860909:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7c800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126621.860911:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860914:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860919:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5810900) 00010000:00010000:2.0:1746126621.860920:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126621.860922:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860926:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7c800/0xb50e82586761467d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126621.860955:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7dc00/0xb50e82586761466f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 232 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.860964:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 231 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.860974:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.860975:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126621.860977:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7d200, rc 0) 00000100:00100000:2.0:1746126621.861012:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+231:31466:x1830945721617152:12345-192.168.203.2@tcp:101:cat.0 Request processed in 513us (594us total) trans 8589943206 rc 0/0 00000100:00100000:2.0:1746126621.861017:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9016 00000100:00100000:1.0:1746126621.861759:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721429632:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126621.861778:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1600/0xb50e825867614653 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e514 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.861788:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1600/0xb50e825867614653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e514 expref: 9 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.861798:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1600, rc 0) 00000100:00100000:1.0:1746126621.862083:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721616512:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 2621us (2811us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.862088:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13885 00000100:00100000:1.0:1746126621.862204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.862522:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721429760:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126621.862536:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0e00/0xb50e825867614661 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e522 expref: 7 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.862544:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0e00/0xb50e825867614661 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e522 expref: 7 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126621.862554:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0e00, rc 0) 00000100:00100000:0.0:1746126621.862575:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721616768:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 2855us (3229us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126621.862580:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13887 00000100:00100000:3.0:1746126621.862781:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721617408 00000100:00100000:3.0:1746126621.862785:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721617408 00002000:00100000:3.0:1746126621.862812:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4509696->4976639) req@ffff88009bb2df80 x1830945721617408/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.862821:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2df80 with x1830945721617408 ext(4509696->4976639) 00002000:00010000:3.0:1746126621.862825:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2df80 00000100:00100000:3.0:1746126621.862870:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7942 00000100:00100000:3.0:1746126621.862876:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721617408:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.863570:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721429888:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126621.863576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1746126621.863585:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0c00/0xb50e825867614668 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e529 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.863594:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0c00/0xb50e825867614668 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e529 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.863601:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0c00, rc 0) 00000100:00100000:1.0:1746126621.863628:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721617024:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3848us (4261us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.863636:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13888 00000100:00100000:3.0:1746126621.865096:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721617664 00000100:00100000:3.0:1746126621.865104:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721617664 00000100:00100000:3.0:1746126621.865150:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3829 00000100:00100000:3.0:1746126621.865156:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:31466:x1830945721617664:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126621.865314:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+232:31466:x1830945721617664:12345-192.168.203.2@tcp:35:cat.0 Request processed in 158us (1737us total) trans 8589943207 rc 0/0 00000100:00100000:3.0:1746126621.865320:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3829 00000100:00100000:0.0:1746126621.870811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.870868:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721617920 00000100:00100000:0.0:1746126621.870875:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721617920 00000100:00100000:0.0:1746126621.870908:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9017 00000100:00100000:0.0:1746126621.870915:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31463:x1830945721617920:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126621.870940:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.870957:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e825867614692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e537 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.871037:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126621.871048:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.871055:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 231 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.871060:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126621.871084:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 231 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.871096:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 231 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746126621.871106:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721430016:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126621.871180:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.871187:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746126621.871193:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721430144:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.871210:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195d240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.872291:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1963:x1830945721617408:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9413us (10084us total) trans 0 rc 466944/466944 00000100:00100000:3.0:1746126621.872300:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7942 00002000:00100000:3.0:1746126621.872309:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4509696->4976639) req@ffff88009bb2df80 x1830945721617408/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.872316:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2df80 with x1830945721617408 ext(4509696->4976639) 00002000:00010000:3.0:1746126621.872320:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2df80 00000100:00100000:0.0:1746126621.873278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.873326:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618048 00000100:00100000:1.0:1746126621.873339:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618048 00000100:00100000:1.0:1746126621.873373:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13889 00000100:00100000:1.0:1746126621.873380:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721618048:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.873391:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.873403:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e53e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.873418:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.873420:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.873427:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 37 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.873440:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 37 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.873450:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0a00, rc 0) 00000100:00100000:1.0:1746126621.873470:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721618048:12345-192.168.203.2@tcp:101:cat.0 Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.873476:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13889 00000100:00100000:2.0:1746126621.873766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.873792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.873843:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618176 00000100:00100000:1.0:1746126621.873846:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618176 00000100:00100000:1.0:1746126621.873867:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618304 00000100:00100000:1.0:1746126621.873869:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618304 00000100:00100000:1.0:1746126621.873892:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13890 00000100:00100000:1.0:1746126621.873898:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721618176:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.873905:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.873913:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0400/0xb50e8258676146a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e545 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.873924:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13891 00000100:00100000:2.0:1746126621.873930:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945721618304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126621.873935:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.873941:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7cc00/0xb50e8258676146ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e54c expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.873945:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721430272:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126621.873959:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721430400:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126621.873996:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833180 going to sleep for 11 seconds 00000100:00100000:1.0:1746126621.874051:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.878789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.878818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.878874:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618432 00000100:00100000:3.0:1746126621.878881:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618432 00010000:00010000:3.0:1746126621.878909:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 232 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.878929:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618560 00000100:00100000:3.0:1746126621.878931:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618560 00010000:00010000:3.0:1746126621.878939:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 11 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.878954:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7259 00000100:00100000:3.0:1746126621.878960:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:1964:x1830945721618432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.878970:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.878975:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 232 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.878985:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 232 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.879002:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.879006:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126621.879010:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7260 00010000:00010000:3.0:1746126621.879013:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.879017:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.879017:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721618560:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.879023:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.879037:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 11 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.879045:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 11 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.879054:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.879057:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126621.879061:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+232:1964:x1830945721618432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 101us (277us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126621.879063:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126621.879066:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7259 00010000:00010000:2.0:1746126621.879068:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.879080:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.879095:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1963:x1830945721618560:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.879100:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7260 00010000:00010000:2.0:1746126621.879130:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7d200/0xb50e825867614684 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e530 expref: 231 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.879141:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721430016:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.879149:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ec00/0xb50e825867614645 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e506 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.879155:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721430144:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.879169:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.879175:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.879179:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126621.879192:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126621.879295:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fa00/0xb50e825867614692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e537 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.879306:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e537 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.879311:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.879313:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126621.879315:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2e400, rc 0) 00000100:00100000:2.0:1746126621.879335:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31463:x1830945721617920:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 8421us (8531us total) trans 8589943208 rc 0/0 00000100:00100000:2.0:1746126621.879339:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9017 00000100:00100000:0.0:1746126621.879436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.879452:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618688 00000100:00100000:0.0:1746126621.879454:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618688 00000100:00100000:0.0:1746126621.879478:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13892 00000100:00100000:0.0:1746126621.879482:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721618688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126621.879492:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.879501:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e8258676146bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e553 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.879530:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721430528:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126621.879570:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b195de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.882899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.882959:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721618944 00000100:00100000:3.0:1746126621.883047:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721618944 00000100:00100000:3.0:1746126621.883080:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9018 00000100:00100000:3.0:1746126621.883086:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31463:x1830945721618944:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:0.0:1746126621.883102:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721430528:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126621.883103:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.883106:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746126621.883122:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e8258676146bc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e553 expref: 30 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.883123:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e400/0xb50e825867614699 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e537 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.883131:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c2ee00/0xb50e8258676146bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e553 expref: 30 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.883135:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.883138:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126621.883139:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2ee00, rc 0) 00010000:00010000:3.0:1746126621.883146:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d400/0xb50e8258676146c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e55a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.883168:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721618688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3684us (3731us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126621.883173:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13892 00010000:00010000:3.0:1746126621.883207:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.883217:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.883224:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126621.883233:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126621.883317:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d400/0xb50e8258676146c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.883327:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.883332:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.883334:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126621.883336:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b22d200, rc 0) 00000100:00100000:3.0:1746126621.883360:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31463:x1830945721618944:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 274us (468us total) trans 8589943209 rc 0/0 00000100:00100000:3.0:1746126621.883365:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9018 00000100:00100000:1.0:1746126621.883485:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721430272:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126621.883501:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0400/0xb50e8258676146a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e545 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.883509:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0400/0xb50e8258676146a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e545 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126621.883520:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0400, rc 0) 00000100:00100000:1.0:1746126621.883538:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721618176:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9641us (9773us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126621.883543:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13890 00000100:00100000:2.0:1746126621.884011:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20294:1830945721430400:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.884034:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7cc00/0xb50e8258676146ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e54c expref: 38 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.884043:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7cc00/0xb50e8258676146ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e54c expref: 38 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.884050:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7cc00, rc 0) 00000100:00100000:2.0:1746126621.884078:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945721618304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10148us (10285us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.884083:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13891 00000100:00100000:0.0:1746126621.885328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.885980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.886052:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619072 00000100:00100000:2.0:1746126621.886058:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619072 00000100:00100000:2.0:1746126621.886084:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13893 00000100:00100000:2.0:1746126621.886089:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721619072:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126621.886101:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126621.886111:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e8258676146d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e561 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.886146:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721430656:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126621.886193:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619200 00000100:00100000:3.0:1746126621.886196:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619200 00000100:00100000:3.0:1746126621.886309:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9019 00000100:00100000:3.0:1746126621.886314:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31463:x1830945721619200:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126621.886324:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.886333:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22cc00/0xb50e8258676146df lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e568 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.886369:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22cc00/0xb50e8258676146df lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e568 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.886378:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22cc00/0xb50e8258676146df lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e568 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.886388:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.886390:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126621.886392:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b22cc00, rc 0) 00000100:00100000:3.0:1746126621.886421:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31463:x1830945721619200:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 106us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.886426:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9019 00000100:00100000:2.0:1746126621.886949:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833180 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.889744:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.889777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.889792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.889816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.890050:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721430656:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126621.890077:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e8258676146d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e561 expref: 30 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.890089:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7ca00/0xb50e8258676146d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e561 expref: 30 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.890099:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7ca00, rc 0) 00000100:00100000:2.0:1746126621.890135:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721619072:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4045us (4808us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126621.890142:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13893 00000100:00100000:0.0:1746126621.890513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.890718:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619328 00000100:00100000:2.0:1746126621.890723:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619328 00000100:00100000:2.0:1746126621.890742:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619584 00000100:00100000:2.0:1746126621.890744:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619584 00000100:00100000:2.0:1746126621.890751:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619456 00000100:00100000:2.0:1746126621.890753:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619456 00000100:00100000:2.0:1746126621.890759:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619712 00000100:00100000:2.0:1746126621.890760:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619712 00000100:00100000:2.0:1746126621.890771:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13894 00000100:00100000:2.0:1746126621.890775:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721619328:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126621.890799:0:20294:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.890811:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.890817:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126621.890819:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126621.890821:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.890857:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.890866:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 26 pid: 8436 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.890876:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721430784:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.890912:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833180 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.890924:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13895 00000100:00100000:2.0:1746126621.890928:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721619584:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126621.890942:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.890950:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 36 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.890956:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.890962:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 19 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.890966:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.890967:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.890969:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.890980:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 19 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.890986:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 19 pid: 17475 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.890993:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721430912:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.891012:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.891018:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 9 pid: 10890 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.891024:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721431040:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.891052:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 36 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.891058:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 36 pid: 4642 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.891064:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721431168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.891073:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48333c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.891084:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13896 00000100:00100000:2.0:1746126621.891088:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721619456:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126621.891100:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.891107:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.891113:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.891118:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.891123:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.891124:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.891125:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.891140:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.891146:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 9 pid: 9686 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.891152:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721431296:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.891177:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126621.891183:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.891190:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721431424:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126621.891221:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.891229:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 19 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.891236:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721431552:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126621.891250:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.891649:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619840 00000100:00100000:3.0:1746126621.891653:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619840 00000100:00100000:3.0:1746126621.891672:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13897 00000100:00100000:3.0:1746126621.891677:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721619712:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:3.0:1746126621.891690:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891698:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891704:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 8 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.891710:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.891714:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.891715:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.891717:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891729:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.891735:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 28 pid: 8436 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.891741:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721431680:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.891765:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 8 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126621.891776:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 8 pid: 9686 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.891782:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721431808:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.891794:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891800:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 26 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.891805:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721431936:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.891814:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.891851:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13898 00000100:00100000:3.0:1746126621.891855:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721619840:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:3.0:1746126621.891867:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891875:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891880:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.891881:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.891882:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891897:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.891903:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 28 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.891909:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721432064:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.891931:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.892116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.892185:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721619968 00000100:00100000:1.0:1746126621.892189:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721619968 00000100:00100000:1.0:1746126621.892204:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13899 00000100:00100000:1.0:1746126621.892209:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721619968:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126621.892223:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.892232:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.892240:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126621.892241:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126621.892243:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.892256:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.892264:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.892271:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721432192:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.892293:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126621.902061:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721430784:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126621.902061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.902078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126621.902081:0:20294:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.902162:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721430912:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.902170:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721431040:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.902175:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721431168:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.902192:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.902209:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721620096 00000100:00100000:3.0:1746126621.902214:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721620096 00002000:00100000:3.0:1746126621.902243:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (155648->712703) req@ffff880091da1500 x1830945721620096/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.902251:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1500 with x1830945721620096 ext(155648->712703) 00010000:00010000:3.0:1746126621.902257:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 27 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.902265:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 27 pid: 8436 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746126621.902275:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da1500 00000100:00100000:0.0:1746126621.903514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.903543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.903562:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721620352 00000100:00100000:2.0:1746126621.903567:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721620352 00010000:00010000:2.0:1746126621.903588:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 20 pid: 17475 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.903606:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721620224 00000100:00100000:2.0:1746126621.903608:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721620224 00010000:00010000:2.0:1746126621.903620:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 11 pid: 10890 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.903633:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7261 00000100:00100000:2.0:1746126621.903638:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721620352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.903649:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.903666:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 20 pid: 17475 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.903674:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 20 pid: 17475 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.903692:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c69400/0xb50e82586761442a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3b6 expref: 20 pid: 17475 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.903708:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.903743:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721620352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.903749:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7261 00000100:00100000:2.0:1746126621.903763:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7262 00000100:00100000:2.0:1746126621.903767:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721620224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.903773:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.903779:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 11 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.903786:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 11 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.903796:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0000/0xb50e82586761452d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e442 expref: 11 pid: 10890 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.903803:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.903821:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721620224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.903840:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7262 00000100:00100000:3.0:1746126621.907512:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721620736 00000100:00100000:3.0:1746126621.907522:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721620736 00002000:00100000:3.0:1746126621.907557:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a4f54a80 x1830945721620736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.907565:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f54a80 with x1830945721620736 ext(1048576->2097151) 00010000:00010000:3.0:1746126621.907573:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 37 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.907584:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 37 pid: 8438 timeout: 843 lvb_type: 1 00002000:00010000:3.0:1746126621.907589:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f54a80 00000100:00100000:3.0:1746126621.907608:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1812 00000100:00100000:3.0:1746126621.907614:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721620096:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126621.907902:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1813 00000100:00100000:2.0:1746126621.907910:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721620736:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126621.908293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.908326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.908340:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721620992 00000100:00100000:1.0:1746126621.908343:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721620992 00010000:00010000:1.0:1746126621.908357:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 38 pid: 4642 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746126621.908374:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7263 00000100:00100000:1.0:1746126621.908379:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+38:1965:x1830945721620992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.908386:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.908398:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 38 pid: 4642 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.908412:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 38 pid: 4642 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.908428:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d800/0xb50e825867614390 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e362 expref: 38 pid: 4642 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.908442:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.908444:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.908448:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.908454:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.908471:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.908489:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721620992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 110us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.908494:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7263 00000100:00100000:1.0:1746126621.908594:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721431296:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.908630:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721431424:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.908657:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721431552:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.908672:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.908757:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721432192:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126621.908766:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.908788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.908797:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621120 00000100:00100000:1.0:1746126621.908799:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621120 00010000:00010000:1.0:1746126621.908809:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 10 pid: 9686 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746126621.908821:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7264 00000100:00100000:1.0:1746126621.908840:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721621120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.908846:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.908853:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 10 pid: 9686 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.908861:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 10 pid: 9686 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.908871:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0200/0xb50e82586761465a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e51b expref: 10 pid: 9686 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.908879:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.908897:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721621120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.908902:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7264 00000100:00100000:1.0:1746126621.908927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.908937:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621376 00000100:00100000:1.0:1746126621.908940:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621376 00010000:00010000:1.0:1746126621.908952:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 29 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.908963:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7265 00000100:00100000:1.0:1746126621.908967:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721621376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.908973:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.908982:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 29 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.908990:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 29 pid: 20294 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.909001:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.909015:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721621376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.909020:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7265 00000100:00100000:1.0:1746126621.909059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.909075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.909084:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621248 00000100:00100000:1.0:1746126621.909087:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621248 00010000:00010000:1.0:1746126621.909096:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 9 pid: 9686 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746126621.909107:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7266 00000100:00100000:1.0:1746126621.909112:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721621248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126621.909117:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126621.909124:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 9 pid: 9686 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.909131:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 9 pid: 9686 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746126621.909141:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126621.909155:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721621248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.909159:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7266 00000100:00100000:1.0:1746126621.909173:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721620864 00000100:00100000:1.0:1746126621.909175:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721620864 00002000:00100000:1.0:1746126621.909189:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009bb2d880 x1830945721620864/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 504/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.909195:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830945721620864 ext(0->1048575) 00010000:00010000:1.0:1746126621.909200:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 29 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.909206:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 29 pid: 8436 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.909211:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb2d880 00000100:00100000:1.0:1746126621.909223:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621632 00000100:00100000:1.0:1746126621.909225:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621632 00002000:00100000:1.0:1746126621.909235:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3809280->4194303) req@ffff88009bb2dc00 x1830945721621632/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.909241:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830945721621632 ext(3809280->4194303) 00010000:00010000:1.0:1746126621.909244:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.909251:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 19 pid: 8437 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.909256:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2dc00 00000100:00100000:1.0:1746126621.909266:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1814 00000100:00100000:1.0:1746126621.909270:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721620864:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126621.909424:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1815 00000100:00100000:3.0:1746126621.909430:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1966:x1830945721621632:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126621.909771:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721432064:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.909782:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909796:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909806:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909820:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909846:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909852:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909857:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7d600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126621.909860:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909867:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.909867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126621.909876:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.909881:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d600/0xb50e8258676146ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.909921:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721619584:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 18992us (20143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.909928:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13895 00000100:00100000:3.0:1746126621.909957:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721431680:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.909965:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c69e00/0xb50e825867614503 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e449 expref: 8 pid: 9686 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.909973:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721431808:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.909981:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921b1800/0xb50e825867614470 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3f5 expref: 30 pid: 20294 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.909988:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721431936:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.909999:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.910807:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621504 00000100:00100000:2.0:1746126621.910811:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621504 00002000:00100000:2.0:1746126621.910846:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4509695) req@ffff88009bb2d500 x1830945721621504/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.910852:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830945721621504 ext(4194304->4509695) 00010000:00010000:2.0:1746126621.910857:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 29 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.910869:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 29 pid: 8437 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746126621.910875:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb2d500 00000100:00100000:2.0:1746126621.910898:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1816 00000100:00100000:2.0:1746126621.910904:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721621504:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126621.912803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.912863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.912881:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621888 00000100:00100000:2.0:1746126621.912885:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621888 00010000:00010000:2.0:1746126621.912906:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 21 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.912924:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721621760 00000100:00100000:2.0:1746126621.912926:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721621760 00010000:00010000:2.0:1746126621.912934:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 31 pid: 8436 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746126621.912945:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7267 00000100:00100000:2.0:1746126621.912949:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721621888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.912959:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.912973:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 21 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.912981:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 21 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.912998:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce7d000/0xb50e825867614622 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f8 expref: 21 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.913011:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.913038:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721621888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.913044:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7267 00000100:00100000:2.0:1746126621.913056:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7268 00000100:00100000:2.0:1746126621.913060:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721621760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.913067:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.913076:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 31 pid: 8436 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.913084:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 31 pid: 8436 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.913095:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a1200/0xb50e825867614485 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e40a expref: 31 pid: 8436 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.913103:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.913104:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.913107:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.913114:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.913131:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.913146:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945721621760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.913150:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7268 00010000:00010000:3.0:1746126621.913315:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913323:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913339:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913344:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913354:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913358:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b22ca00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126621.913361:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913367:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913375:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.913380:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b22ca00/0xb50e8258676146fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126621.913420:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721619712:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 21742us (23602us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.913426:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13897 00000100:00100000:1.0:1746126621.923041:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721620864:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13750us (14731us total) trans 0 rc 491520/491520 00000100:00100000:1.0:1746126621.923052:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1814 00002000:00100000:1.0:1746126621.923062:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009bb2d880 x1830945721620864/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 504/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126621.923069:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830945721620864 ext(0->1048575) 00010000:00010000:1.0:1746126621.923079:0:21462:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126621.923093:0:21462:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746126621.923099:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb2d880 00000100:00100000:2.0:1746126621.924331:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721620736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16419us (20783us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126621.924338:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1813 00002000:00100000:2.0:1746126621.924344:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a4f54a80 x1830945721620736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.924351:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f54a80 with x1830945721620736 ext(1048576->2097151) 00010000:00010000:2.0:1746126621.924358:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746126621.924366:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00002000:00010000:2.0:1746126621.924371:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4f54a80 00000100:00100000:2.0:1746126621.932980:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721621632:12345-192.168.203.2@tcp:4:cat.0 Request processed in 23540us (23910us total) trans 17179873265 rc 0/0 00000100:00100000:2.0:1746126621.932991:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1815 00002000:00100000:2.0:1746126621.933002:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (3809280->4194303) req@ffff88009bb2dc00 x1830945721621632/t17179873265(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126621.933011:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830945721621632 ext(3809280->4194303) 00010000:00010000:2.0:1746126621.933019:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 20 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.933039:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 20 pid: 8437 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746126621.933045:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2dc00 00000100:00100000:3.0:1746126621.934558:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721620096:12345-192.168.203.2@tcp:4:cat.0 Request processed in 26938us (32497us total) trans 21474840413 rc 0/0 00000100:00100000:3.0:1746126621.934567:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1812 00002000:00100000:3.0:1746126621.934575:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (155648->712703) req@ffff880091da1500 x1830945721620096/t21474840413(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.934582:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1500 with x1830945721620096 ext(155648->712703) 00010000:00010000:3.0:1746126621.934590:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.934598:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746126621.934603:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da1500 00000100:00100000:0.0:1746126621.935494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.935514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.936681:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721621504:12345-192.168.203.2@tcp:4:cat.0 Request processed in 25774us (26810us total) trans 21474840414 rc 0/0 00000100:00100000:3.0:1746126621.936689:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1816 00002000:00100000:3.0:1746126621.936696:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4509695) req@ffff88009bb2d500 x1830945721621504/t21474840414(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:382/0 lens 488/448 e 0 to 0 dl 1746126632 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.936703:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830945721621504 ext(4194304->4509695) 00010000:00010000:3.0:1746126621.936711:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126621.936719:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746126621.936724:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb2d500 00000100:00100000:3.0:1746126621.936748:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721622144 00000100:00100000:3.0:1746126621.936754:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721622144 00010000:00010000:3.0:1746126621.936772:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746126621.936797:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7269 00000100:00100000:3.0:1746126621.936803:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721622144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126621.936813:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.936851:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.936860:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.936878:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0a00/0xb50e8258676146a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e53e expref: 36 pid: 8438 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746126621.936892:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.936894:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126621.936897:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.936904:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.936930:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126621.936947:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721622144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 144us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.936952:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7269 00000100:00100000:3.0:1746126621.936977:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721622016 00000100:00100000:3.0:1746126621.936980:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721622016 00000100:00100000:3.0:1746126621.936992:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13900 00000100:00100000:3.0:1746126621.936996:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+35:31466:x1830945721622016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126621.937006:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126621.937016:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e56f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.937037:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.937042:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.937043:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126621.937046:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.937054:0:8436:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.937063:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.937070:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b390e00, rc 0) 00000100:00100000:3.0:1746126621.937085:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+36:31466:x1830945721622016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 88us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.937089:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13900 00010000:00010000:1.0:1746126621.937390:0:4640:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937401:0:4640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937416:0:4640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937422:0:4640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937428:0:4640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937433:0:4640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e3c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126621.937436:0:4640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937441:0:4640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937449:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.937450:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.937453:0:4640:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937458:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.937483:0:4640:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.937492:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721432320:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126621.937539:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae900 going to sleep for 11 seconds 00000100:00100000:0.0:1746126621.940500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.941715:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721622272 00000100:00100000:2.0:1746126621.941723:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721622272 00010000:00010000:2.0:1746126621.941755:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 20 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.942195:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7270 00000100:00100000:2.0:1746126621.942203:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721622272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.942214:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.942229:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 20 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.942239:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 20 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.942258:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1a00/0xb50e825867614614 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ea expref: 20 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746126621.942392:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721432320:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126621.942409:0:4640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.942415:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e3c00/0xb50e8258676146f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.942563:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721619456:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 51473us (52769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126621.942569:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13896 00010000:00010000:2.0:1746126621.942619:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.942621:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.942625:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.942636:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.942873:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.942890:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721622272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 688us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.942895:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7270 00010000:00010000:1.0:1746126621.943147:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943154:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943173:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943179:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943184:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943188:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a0800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126621.943190:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943195:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943206:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.943210:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0800/0xb50e825867614709 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126621.943250:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721619968:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 51040us (51135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.943255:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13899 00000100:00100000:0.0:1746126621.945053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.945474:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721622528 00000100:00100000:2.0:1746126621.945482:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721622528 00010000:00010000:2.0:1746126621.945510:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.945759:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7271 00000100:00100000:2.0:1746126621.945766:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721622528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.945777:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.945941:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.945953:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.945970:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008da01200/0xb50e825867614629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 155648->712703) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4ff expref: 28 pid: 8436 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.945982:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.945984:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.945987:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.945994:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.946020:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126621.946138:0:20294:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946146:0:20294:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946161:0:20294:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946166:0:20294:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946171:0:20294:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946175:0:20294:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce7dc00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126621.946177:0:20294:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946182:0:20294:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946190:0:20294:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.946194:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7dc00/0xb50e8258676146e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126621.946349:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721622528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 583us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.946355:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7271 00000100:00100000:3.0:1746126621.946428:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721619328:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 55651us (56689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126621.946436:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13894 00000100:00100000:0.0:1746126621.948355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.950683:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721622400 00000100:00100000:2.0:1746126621.950694:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721622400 00010000:00010000:2.0:1746126621.950727:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.950770:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7272 00000100:00100000:2.0:1746126621.950777:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1966:x1830945721622400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.950789:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.950804:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.950814:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.950858:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce7c000/0xb50e82586761461b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4509695) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e4f1 expref: 30 pid: 8437 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.950876:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.950877:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126621.950880:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.950887:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126621.950910:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.950963:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721622400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 186us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.950969:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7272 00010000:00010000:0.0:1746126621.951211:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951218:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951236:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951242:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951249:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951259:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b22da00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126621.951263:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951269:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951279:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.951285:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b22da00/0xb50e825867614702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126621.951324:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1964:x1830945721619840:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 59467us (60811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126621.951331:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13898 00000100:00100000:1.0:1746126621.951548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.951698:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721622784 00000100:00100000:3.0:1746126621.951702:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721622784 00002000:00100000:3.0:1746126621.951729:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad1180 x1830945721622784/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/0 e 0 to 0 dl 1746126632 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.951742:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1180 with x1830945721622784 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.951746:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad1180 00000100:00100000:3.0:1746126621.951768:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7943 00000100:00100000:3.0:1746126621.951773:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721622784:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126621.956512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126621.956575:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623040 00000100:00100000:3.0:1746126621.956582:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623040 00000100:00100000:3.0:1746126621.956707:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9020 00000100:00100000:3.0:1746126621.956714:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31463:x1830945721623040:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:3.0:1746126621.957009:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126621.957043:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22cc00/0xb50e8258676146df lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e568 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957056:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126621.957060:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126621.957084:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.957093:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957099:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 230 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957104:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957114:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.957145:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 13 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957154:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 13 pid: 15560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.957165:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d918380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721432448:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.957585:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 230 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957592:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 230 pid: 15560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.957599:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d91aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721432576:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.957623:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126621.957629:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 13 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.957635:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721432704:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126621.957649:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126621.962405:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721622784:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10623us (10848us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126621.962416:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7943 00002000:00100000:3.0:1746126621.962425:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008dad1180 x1830945721622784/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:382/0 lens 488/440 e 0 to 0 dl 1746126632 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126621.962433:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1180 with x1830945721622784 ext(1048576->2097151) 00002000:00010000:3.0:1746126621.962438:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dad1180 00000100:00100000:0.0:1746126621.963876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.963903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.963924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126621.964004:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623168 00000100:00100000:2.0:1746126621.964010:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623168 00010000:00010000:2.0:1746126621.964043:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 14 pid: 15560 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.964061:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623424 00000100:00100000:2.0:1746126621.964063:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623424 00010000:00010000:2.0:1746126621.964070:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 15 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.964079:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623296 00000100:00100000:2.0:1746126621.964081:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623296 00010000:00010000:2.0:1746126621.964089:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 231 pid: 15560 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126621.964099:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7273 00000100:00100000:2.0:1746126621.964105:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721623168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.964115:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.964120:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 15 pid: 15560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.964128:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 15 pid: 15560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.964145:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.964149:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.964156:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.964177:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721623168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.964182:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7273 00000100:00100000:2.0:1746126621.964196:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7274 00000100:00100000:2.0:1746126621.964201:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721623424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.964207:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.964210:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 14 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.964216:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 14 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.964225:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.964227:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.964232:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.964244:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721623424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 43us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.964248:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7274 00000100:00100000:2.0:1746126621.964257:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7275 00000100:00100000:2.0:1746126621.964261:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+231:1963:x1830945721623296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126621.964266:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126621.964270:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 231 pid: 15560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.964277:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 231 pid: 15560 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126621.964285:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126621.964288:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.964293:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.964299:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126621.964311:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126621.964324:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+231:1963:x1830945721623296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 62us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126621.964329:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7275 00010000:00010000:3.0:1746126621.965489:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c69a00/0xb50e825867614454 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d9 expref: 13 pid: 15560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.965517:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d918380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721432448:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.965527:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c68a00/0xb50e82586761444d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3d2 expref: 230 pid: 15560 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.965535:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d91aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721432576:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.965542:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae43200/0xb50e82586761441c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e3a1 expref: 12 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126621.965549:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721432704:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126621.965566:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.965572:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126621.965576:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000040:00080000:3.0:1746126621.966280:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2684, 88 off228048 00000004:00080000:3.0:1746126621.966286:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743880458425ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966879:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2805, 88 off238800 00000004:00080000:3.0:1746126621.966885:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881057505ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966904:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2806, 88 off238888 00000004:00080000:3.0:1746126621.966907:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881079591ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966914:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2685, 88 off228136 00000004:00080000:3.0:1746126621.966916:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881088281ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966921:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2686, 88 off228224 00000004:00080000:3.0:1746126621.966923:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881095198ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966928:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2807, 88 off238976 00000004:00080000:3.0:1746126621.966930:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881102238ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966934:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2808, 88 off239064 00000004:00080000:3.0:1746126621.966936:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881108758ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966941:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2687, 88 off228312 00000004:00080000:3.0:1746126621.966942:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881115063ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966947:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2809, 88 off239152 00000004:00080000:3.0:1746126621.966949:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881121480ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966953:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2688, 88 off228400 00000004:00080000:3.0:1746126621.966955:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881127651ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966960:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2810, 88 off239240 00000004:00080000:3.0:1746126621.966961:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881133893ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966966:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2689, 88 off228488 00000004:00080000:3.0:1746126621.966967:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881140071ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966972:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2811, 88 off239328 00000004:00080000:3.0:1746126621.966974:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881146628ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966979:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2690, 88 off228576 00000004:00080000:3.0:1746126621.966981:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881153163ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126621.966986:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2812, 88 off239416 00000004:00080000:3.0:1746126621.966988:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881160443ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966992:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2813, 88 off239504 00000004:00080000:3.0:1746126621.966994:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743881166768ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126621.966999:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2691, 88 off228664 00000004:00080000:3.0:1746126621.967000:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743881172933ns, next at 687927188999ns, rc = 0 00000100:00100000:1.0:1746126621.976357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126621.976598:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623680 00000100:00100000:0.0:1746126621.976606:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623680 00000100:00100000:0.0:1746126621.976646:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9021 00000100:00100000:0.0:1746126621.976653:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:31469:x1830945721623680:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126621.976670:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126621.976687:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fe00/0xb50e82586761471e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e576 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126621.976767:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.976777:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.976786:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.976796:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.976801:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126621.976806:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126621.988309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.988384:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623808 00000100:00100000:1.0:1746126621.988393:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623808 00000100:00100000:1.0:1746126621.988426:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13901 00000100:00100000:1.0:1746126621.988432:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:31466:x1830945721623808:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.988445:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.988465:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e57d expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126621.988483:0:23766:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71b, ctime: 0x6813c71c, blocks: 0x821 00010000:00010000:1.0:1746126621.988501:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.988504:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126621.988510:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 37 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.988523:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 37 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.988533:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0400, rc 0) 00000100:00100000:1.0:1746126621.988570:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+37:31466:x1830945721623808:12345-192.168.203.2@tcp:101:cat.0 Request processed in 138us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.988627:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13901 00000100:00100000:1.0:1746126621.993471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.993495:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721623936 00000100:00100000:1.0:1746126621.993501:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721623936 00000100:00100000:1.0:1746126621.993531:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9022 00000100:00100000:1.0:1746126621.993537:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+232:31466:x1830945721623936:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126621.993550:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.993565:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e584 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.993606:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126621.993613:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.993626:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126621.993635:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.993644:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126621.993647:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126621.993651:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.993656:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1e00, rc 0) 00000100:00100000:1.0:1746126621.993689:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+233:31466:x1830945721623936:12345-192.168.203.2@tcp:101:cat.0 Request processed in 152us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126621.993694:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9022 00000100:00100000:0.0:1746126621.995133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126621.995273:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624192 00000100:00100000:1.0:1746126621.995278:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624192 00000100:00100000:1.0:1746126621.995302:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9023 00000100:00100000:1.0:1746126621.995307:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31471:x1830945721624192:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126621.995319:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126621.995330:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e825867614741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e58b expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.995400:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.995411:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.995420:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.995428:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.995433:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.995437:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00010000:2.0:1746126621.999439:0:14548:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a4f57480 reply state ffff88008ecbf800 transno 8589943210 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126621.999450:0:14548:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746126621.999545:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31463:x1830945721623040:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 42828us (43035us total) trans 8589943210 rc 0/0 00000100:00100000:2.0:1746126621.999553:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9020 00010000:00010000:1.0:1746126621.999634:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.999646:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.999652:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126621.999680:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126621.999691:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 12 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746126621.999703:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721432832:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126621.999752:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2b40 going to sleep for 11 seconds 00000001:00080000:0.0:1746126621.999948:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943193 is committed 00000001:00080000:0.0:1746126621.999958:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943202 is committed 00000001:00080000:0.0:1746126621.999961:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943199 is committed 00000001:00080000:0.0:1746126621.999964:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943196 is committed 00000001:00080000:0.0:1746126621.999968:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943208 is committed 00000001:00080000:0.0:1746126621.999971:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943206 is committed 00000001:00080000:0.0:1746126621.999976:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943204 is committed 00000001:00080000:0.0:1746126621.999992:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943210 is committed 00000004:00080000:0.0:1746126621.999995:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2076 committed 00000004:00080000:0.0:1746126621.999999:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2194 committed 00000004:00080000:0.0:1746126622.000005:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2193 committed 00000004:00080000:0.0:1746126622.000006:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2075 committed 00000004:00080000:0.0:1746126622.000008:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2192 committed 00000004:00080000:0.0:1746126622.000009:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2074 committed 00000004:00080000:0.0:1746126622.000011:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2191 committed 00000004:00080000:0.0:1746126622.000012:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2073 committed 00000004:00080000:0.0:1746126622.000014:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2190 committed 00000004:00080000:0.0:1746126622.000015:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2072 committed 00000004:00080000:0.0:1746126622.000016:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2189 committed 00000004:00080000:0.0:1746126622.000017:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2188 committed 00000004:00080000:0.0:1746126622.000018:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2071 committed 00000004:00080000:0.0:1746126622.000019:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2070 committed 00000004:00080000:0.0:1746126622.000020:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2187 committed 00000004:00080000:0.0:1746126622.000022:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2186 committed 00000004:00080000:0.0:1746126622.000023:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2069 committed 00000001:00080000:0.0:1746126622.000037:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943207 is committed 00010000:00010000:0.0:1746126622.000058:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.000064:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.000070:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746126622.000147:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000180:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000197:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000210:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000223:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746126622.000227:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721432960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000239:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000248:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000258:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000271:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000292:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000310:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126622.000314:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000332:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.000359:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433088 00000100:00100000:0.0:1746126622.000364:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433088 00000100:00100000:0.0:1746126622.000384:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433600 00000100:00100000:0.0:1746126622.000386:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433600 00000100:00100000:0.0:1746126622.000395:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721432960 00000100:00100000:0.0:1746126622.000396:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721432960 00000100:00100000:0.0:1746126622.000404:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433472 00000100:00100000:0.0:1746126622.000405:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433472 00000100:00100000:0.0:1746126622.000411:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433216 00000100:00100000:0.0:1746126622.000413:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433216 00000100:00100000:0.0:1746126622.000418:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433728 00000100:00100000:0.0:1746126622.000420:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433728 00000100:00100000:0.0:1746126622.000425:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433344 00000100:00100000:0.0:1746126622.000426:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433344 00000100:00100000:0.0:1746126622.000431:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433856 00000100:00100000:0.0:1746126622.000433:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433856 00000100:00100000:0.0:1746126622.000440:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13902 00000100:00100000:0.0:1746126622.000445:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3297:x1830945721433088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126622.000587:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126622.000589:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.000591:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126622.000593:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.000594:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126622.000617:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721433088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (436us total) trans 17179873266 rc 0/0 00000100:00100000:0.0:1746126622.000622:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13902 00000100:00100000:0.0:1746126622.000632:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13903 00000100:00100000:0.0:1746126622.000636:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3297:x1830945721433600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.000714:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721433600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (501us total) trans 17179873267 rc 0/0 00000100:00100000:0.0:1746126622.000718:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13903 00000100:00100000:0.0:1746126622.000727:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13904 00000100:00100000:0.0:1746126622.000731:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3297:x1830945721432960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126622.000794:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126622.000797:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.000798:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.000800:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126621 -> 1746126620 00002000:00010000:0.0:1746126622.000801:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746126622.000820:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721432960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (580us total) trans 17179873268 rc 0/0 00000100:00100000:0.0:1746126622.000849:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13904 00000100:00100000:0.0:1746126622.000859:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13905 00000100:00100000:0.0:1746126622.000870:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3297:x1830945721433472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126622.000934:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126622.000937:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126622.000938:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126622.000940:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126622.000941:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126622.000960:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721433472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (701us total) trans 17179873269 rc 0/0 00000100:00100000:0.0:1746126622.000964:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13905 00000100:00100000:0.0:1746126622.000973:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13906 00000100:00100000:0.0:1746126622.000977:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721433216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001065:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721433216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (780us total) trans 17179873270 rc 0/0 00000100:00100000:0.0:1746126622.001069:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13906 00000100:00100000:0.0:1746126622.001077:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13907 00000100:00100000:0.0:1746126622.001080:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721433728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001148:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721433728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (844us total) trans 17179873271 rc 0/0 00000100:00100000:0.0:1746126622.001152:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13907 00000100:00100000:0.0:1746126622.001162:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13908 00000100:00100000:0.0:1746126622.001165:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721433344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001240:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721433344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (914us total) trans 17179873272 rc 0/0 00000100:00100000:0.0:1746126622.001244:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13908 00000100:00100000:0.0:1746126622.001252:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13909 00000100:00100000:0.0:1746126622.001256:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721433856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001326:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721433856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (982us total) trans 17179873273 rc 0/0 00000100:00100000:0.0:1746126622.001331:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13909 00000004:00080000:0.0:1746126622.001367:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55f80/2, rc 0, transno 17179873272 00000100:00100000:0.0:1746126622.001374:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001381:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f257480/2, rc 0, transno 17179873273 00000100:00100000:0.0:1746126622.001384:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001389:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54380/2, rc 0, transno 17179873270 00000100:00100000:0.0:1746126622.001392:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001397:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f254e00/2, rc 0, transno 17179873271 00000100:00100000:0.0:1746126622.001399:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721433728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001432:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54700/2, rc 0, transno 17179873268 00000100:00100000:0.0:1746126622.001435:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721432960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001440:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56300/2, rc 0, transno 17179873269 00000100:00100000:0.0:1746126622.001443:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001448:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54000/2, rc 0, transno 17179873266 00000100:00100000:0.0:1746126622.001450:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.001455:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55500/2, rc 0, transno 17179873267 00000100:00100000:0.0:1746126622.001458:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001462:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746126622.001465:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001483:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.001500:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721433984 00000100:00100000:0.0:1746126622.001503:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721433984 00000100:00100000:0.0:1746126622.001518:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13910 00000100:00100000:0.0:1746126622.001522:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721433984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.001599:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721433984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (114us total) trans 17179873274 rc 0/0 00000100:00100000:0.0:1746126622.001603:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13910 00000004:00080000:0.0:1746126622.001621:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f255500/2, rc 0, transno 17179873274 00000100:00100000:0.0:1746126622.001624:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721433984:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746126622.001954:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746126622.002096:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.002104:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.002109:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.002114:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b22dc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.002118:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.002123:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.002134:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.002137:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126622.002142:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 223 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.002151:0:3281:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 223 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.002157:0:3281:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 223 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.002182:0:3281:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 223 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.002190:0:3281:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721435136:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.002246:0:3281:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d65300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126622.002256:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721434496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002277:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002288:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721435008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002301:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002310:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746126622.002313:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721434112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002324:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002331:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721434624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002358:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002380:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002406:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746126622.002410:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002422:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002429:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002441:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.002457:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434496 00000100:00100000:2.0:1746126622.002460:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434496 00000100:00100000:2.0:1746126622.002476:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435008 00000100:00100000:2.0:1746126622.002478:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435008 00000100:00100000:2.0:1746126622.002485:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434112 00000100:00100000:2.0:1746126622.002487:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434112 00000100:00100000:2.0:1746126622.002492:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434624 00000100:00100000:2.0:1746126622.002494:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434624 00000100:00100000:2.0:1746126622.002499:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434368 00000100:00100000:2.0:1746126622.002500:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434368 00000100:00100000:2.0:1746126622.002505:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434880 00000100:00100000:2.0:1746126622.002507:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434880 00000100:00100000:2.0:1746126622.002511:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434240 00000100:00100000:2.0:1746126622.002513:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434240 00000100:00100000:2.0:1746126622.002517:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721434752 00000100:00100000:2.0:1746126622.002519:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721434752 00000100:00100000:2.0:1746126622.002526:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13911 00000100:00100000:2.0:1746126622.002530:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721434496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002649:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721434496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (370us total) trans 21474840415 rc 0/0 00000100:00100000:2.0:1746126622.002654:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13911 00000100:00100000:2.0:1746126622.002666:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13912 00000100:00100000:2.0:1746126622.002670:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721435008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002740:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721435008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (437us total) trans 21474840416 rc 0/0 00000100:00100000:2.0:1746126622.002745:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13912 00000100:00100000:2.0:1746126622.002755:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13913 00000100:00100000:2.0:1746126622.002759:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721434112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002862:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721434112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (536us total) trans 21474840417 rc 0/0 00000100:00100000:2.0:1746126622.002868:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13913 00000100:00100000:2.0:1746126622.002877:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13914 00000100:00100000:2.0:1746126622.002880:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721434624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.002942:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830945721434624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (598us total) trans 21474840418 rc 0/0 00000100:00100000:2.0:1746126622.002946:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13914 00000100:00100000:2.0:1746126622.002953:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13915 00000100:00100000:2.0:1746126622.002957:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830945721434368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.003037:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721434368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (655us total) trans 21474840419 rc 0/0 00000100:00100000:2.0:1746126622.003042:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13915 00000100:00100000:2.0:1746126622.003050:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13916 00000100:00100000:2.0:1746126622.003054:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830945721434880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.003122:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721434880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (724us total) trans 21474840420 rc 0/0 00000100:00100000:2.0:1746126622.003126:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13916 00000100:00100000:2.0:1746126622.003132:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13917 00000100:00100000:2.0:1746126622.003135:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830945721434240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.003191:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721434240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (768us total) trans 21474840421 rc 0/0 00000100:00100000:2.0:1746126622.003194:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13917 00000100:00100000:2.0:1746126622.003200:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13918 00000100:00100000:2.0:1746126622.003203:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830945721434752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.003255:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721434752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (813us total) trans 21474840422 rc 0/0 00000100:00100000:2.0:1746126622.003260:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13918 00000100:00080000:2.0:1746126622.003271:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746126622.003286:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fc000/2, rc 0, transno 21474840421 00000100:00100000:2.0:1746126622.003289:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434240:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003294:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fea00/2, rc 0, transno 21474840422 00000100:00100000:2.0:1746126622.003297:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434752:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003301:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ff800/2, rc 0, transno 21474840419 00000100:00100000:2.0:1746126622.003303:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434368:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003307:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fd880/2, rc 0, transno 21474840420 00000100:00100000:2.0:1746126622.003309:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721434880:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003318:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fe680/2, rc 0, transno 21474840417 00000100:00100000:2.0:1746126622.003320:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721434112:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003324:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ffb80/2, rc 0, transno 21474840418 00000100:00100000:2.0:1746126622.003326:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721434624:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003330:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fd180/2, rc 0, transno 21474840415 00000100:00100000:2.0:1746126622.003332:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721434496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.003336:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fdc00/2, rc 0, transno 21474840416 00000100:00100000:2.0:1746126622.003338:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721435008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.005368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.005637:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624320 00000100:00100000:2.0:1746126622.005645:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624320 00000100:00080000:0.0:1746126622.005731:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126622.005783:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9024 00000100:00100000:2.0:1746126622.005791:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31463:x1830945721624320:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126622.005810:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.005824:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e592 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.005896:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.005907:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.005921:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.005924:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126622.005926:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce14400, rc 0) 00000100:00100000:2.0:1746126622.007469:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31463:x1830945721624320:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 1673us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.007476:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9024 00000100:00100000:1.0:1746126622.008262:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721432832:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126622.008281:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126622.008490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.008649:0:3281:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3281:1830945721435136:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.008669:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.008675:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22dc00/0xb50e825867614717 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126622.008808:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624448 00000100:00100000:3.0:1746126622.008813:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624448 00000100:00100000:3.0:1746126622.008868:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3830 00000100:00100000:3.0:1746126622.008874:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:31466:x1830945721624448:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:3.0:1746126622.008963:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:31466:x1830945721624448:12345-192.168.203.2@tcp:49:cat.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.008969:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3830 00000100:00080000:0.0:1746126622.009248:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126622.011070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.011298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.011382:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624576 00000100:00100000:3.0:1746126622.011388:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624576 00010000:00010000:3.0:1746126622.011414:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126622.011436:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7276 00000100:00100000:3.0:1746126622.011441:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721624576:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.011451:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.011455:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126622.011465:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126622.011486:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b22d200/0xb50e8258676146ca lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e55a expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126622.011508:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.011512:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.011520:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.011525:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.011532:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.011536:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.011540:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.011558:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.011589:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721624576:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 147us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.011594:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7276 00000100:00100000:2.0:1746126622.011790:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624704 00000100:00100000:2.0:1746126622.011794:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624704 00000100:00100000:2.0:1746126622.011814:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9025 00000100:00100000:2.0:1746126622.011819:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31463:x1830945721624704:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126622.011858:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.011869:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15e00/0xb50e82586761476b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e599 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.011924:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.011932:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.011939:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126622.011958:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126622.011962:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126622.011972:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126622.011990:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15e00/0xb50e82586761476b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.012004:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.012010:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.012012:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126622.012014:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce14600, rc 0) 00000100:00100000:2.0:1746126622.012046:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31463:x1830945721624704:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 226us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.012051:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9025 00010000:00010000:1.0:1746126622.012150:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012156:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126622.012165:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126622.012271:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012278:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012283:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012287:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a0000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126622.012290:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012295:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012302:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126622.012304:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126622.012306:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012310:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0000/0xb50e825867614756 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012321:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012325:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012329:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012333:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a0c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126622.012335:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012342:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012347:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126622.012349:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126622.012351:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012355:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0c00/0xb50e825867614748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012362:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012366:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012369:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012373:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a0e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126622.012375:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012379:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012383:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0a1700) 00010000:00010000:1.0:1746126622.012385:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126622.012387:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012391:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0e00/0xb50e82586761474f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.012413:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e825867614741 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e58b expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.012419:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0800/0xb50e825867614741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e58b expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.012425:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0800, rc 0) 00000100:00100000:1.0:1746126622.012446:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31471:x1830945721624192:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 17140us (17316us total) trans 8589943211 rc 301/301 00000100:00100000:1.0:1746126622.012452:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9023 00010000:00010000:0.0:1746126622.012924:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.012931:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746126622.012940:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126622.012984:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.012990:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.012995:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013001:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2f600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126622.013004:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013008:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013015:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126622.013017:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126622.013019:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013023:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f600/0xb50e82586761475d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013047:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013052:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013057:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013060:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2ea00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126622.013062:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013066:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013072:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126622.013074:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126622.013077:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013080:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2ea00/0xb50e825867614725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013087:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013091:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013095:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013099:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134c2f400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126622.013101:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013105:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013110:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0a1700) 00010000:00010000:0.0:1746126622.013111:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126622.013113:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013117:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f400/0xb50e82586761472c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.013141:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fe00/0xb50e82586761471e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e576 expref: 224 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.013147:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2fe00/0xb50e82586761471e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e576 expref: 224 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.013154:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2fe00, rc 0) 00000100:00100000:0.0:1746126622.013176:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31469:x1830945721623680:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 36524us (36825us total) trans 8589943212 rc 301/301 00000100:00100000:0.0:1746126622.013181:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9021 00000100:00100000:0.0:1746126622.016081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.016253:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624960 00000100:00100000:0.0:1746126622.016259:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624960 00000100:00100000:0.0:1746126622.016286:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721625216 00000100:00100000:0.0:1746126622.016288:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721625216 00000100:00100000:0.0:1746126622.016298:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721625472 00000100:00100000:0.0:1746126622.016300:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721625472 00000100:00100000:0.0:1746126622.016307:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721625088 00000100:00100000:0.0:1746126622.016309:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721625088 00000100:00100000:0.0:1746126622.016315:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721625344 00000100:00100000:0.0:1746126622.016317:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721625344 00000100:00100000:0.0:1746126622.016324:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721625600 00000100:00100000:0.0:1746126622.016325:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721625600 00000100:00100000:0.0:1746126622.016334:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13919 00000100:00100000:0.0:1746126622.016340:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721624960:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126622.016354:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126622.016355:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13920 00000100:00100000:1.0:1746126622.016363:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721625216:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126622.016368:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5a7 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.016370:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.016380:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5b5 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126622.016391:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c71d, atime: 0x6813c71d, ctime: 0x6813c71d, blocks: 0x79f 00010000:00010000:1.0:1746126622.016397:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016399:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.016401:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.016402:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016405:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.016406:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.016416:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.016417:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.016424:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75bc00, rc 0) 00010000:00010000:0.0:1746126622.016424:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a03a00, rc 0) 00000100:00100000:1.0:1746126622.016458:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721625216:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.016464:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13920 00000100:00100000:1.0:1746126622.016476:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13921 00000100:00100000:1.0:1746126622.016481:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721625472:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126622.016486:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.016494:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5c3 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126622.016505:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c71d, atime: 0x6813c71d, ctime: 0x6813c71d, blocks: 0x163d 00010000:00010000:1.0:1746126622.016512:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016513:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016516:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.016523:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.016529:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75be00, rc 0) 00000100:00100000:2.0:1746126622.016539:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13922 00000100:00100000:2.0:1746126622.016546:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721625088:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:1.0:1746126622.016548:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721625472:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.016552:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13921 00010000:00010000:2.0:1746126622.016554:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.016561:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5ae expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126622.016561:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13923 00000100:00100000:1.0:1746126622.016566:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721625344:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126622.016571:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016571:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.016572:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.016577:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.016578:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5bc expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.016585:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.016591:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce15c00, rc 0) 00002000:00010000:1.0:1746126622.016592:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71a, ctime: 0x6813c71c, blocks: 0x81d 00010000:00010000:1.0:1746126622.016598:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016599:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.016603:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126622.016609:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721625088:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 64us (456us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126622.016611:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126622.016614:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13922 00010000:00010000:1.0:1746126622.016617:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75ba00, rc 0) 00000100:00100000:2.0:1746126622.016624:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13924 00000100:00100000:2.0:1746126622.016629:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721625600:12345-192.168.203.2@tcp:101:mirror_io.0 00000100:00100000:1.0:1746126622.016633:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721625344:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 67us (458us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126622.016634:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126622.016637:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13923 00010000:00010000:2.0:1746126622.016641:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5ca expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126622.016653:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c71d, atime: 0x6813c71d, ctime: 0x6813c71d, blocks: 0x102b 00010000:00010000:2.0:1746126622.016660:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.016661:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.016665:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.017014:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.017020:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce14e00, rc 0) 00000100:00100000:2.0:1746126622.017062:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721625600:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 432us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.017068:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13924 00000100:00100000:2.0:1746126622.017083:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721624832 00000100:00100000:2.0:1746126622.017086:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721624832 00000100:00100000:2.0:1746126622.017112:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9026 00000100:00100000:2.0:1746126622.017117:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31471:x1830945721624832:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126622.017126:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.017651:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5a0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.017690:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.017699:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.017711:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.017713:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126622.017715:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce14a00, rc 0) 00000100:00100000:2.0:1746126622.019747:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31471:x1830945721624832:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2623us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.019758:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9026 00000100:00100000:0.0:1746126622.019992:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721624960:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3651us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.019999:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13919 00000100:00080000:0.0:1746126622.020121:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126622.020751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.021071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.021665:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721625856 00000100:00100000:2.0:1746126622.021671:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721625856 00000100:00100000:2.0:1746126622.021708:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9027 00000100:00100000:2.0:1746126622.021713:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31469:x1830945721625856:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126622.021732:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.021735:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126622.021756:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1e00/0xb50e82586761473a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e584 expref: 223 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.021769:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.021772:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126622.021780:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15200/0xb50e8258676147b8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5d1 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.021817:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126622.021847:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.021854:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.021859:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.021865:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126622.021889:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.021899:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126622.021908:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721435264:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.023406:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721626112 00000100:00100000:3.0:1746126622.023413:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721626112 00002000:00100000:3.0:1746126622.023453:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880092b17480 x1830945721626112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.023466:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17480 with x1830945721626112 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.023470:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b17480 00000100:00100000:3.0:1746126622.023485:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7944 00000100:00100000:3.0:1746126622.023490:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945721626112:12345-192.168.203.2@tcp:3:multiop.0 00000100:00080000:1.0:1746126622.023814:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746126622.024089:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.024100:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 8 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126622.024109:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721435392:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.029133:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.029147:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126622.029157:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721435520:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.029185:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126622.033039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.033066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.033084:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721626496 00000100:00100000:1.0:1746126622.033090:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721626496 00000100:00100000:1.0:1746126622.033133:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9028 00000100:00100000:1.0:1746126622.033139:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31471:x1830945721626496:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126622.033153:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.033156:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746126622.033166:0:20362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 9 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746126622.033185:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126622.033190:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.033196:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.033202:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126622.033211:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75aa00/0xb50e8258676147c6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5d8 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.033259:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.033267:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.033273:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126622.033286:0:20362:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.033293:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126622.033397:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721626240 00000100:00100000:0.0:1746126622.033401:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721626240 00010000:00010000:0.0:1746126622.033416:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746126622.033431:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7277 00000100:00100000:0.0:1746126622.033435:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721626240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126622.033442:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126622.033445:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746126622.033457:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 8 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746126622.033466:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126622.033469:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.033473:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126622.033477:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126622.033509:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721626240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 73us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.033515:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7277 00010000:00010000:2.0:1746126622.033973:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14600/0xb50e825867614772 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e599 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126622.033985:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721435264:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.036773:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945721626112:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 13274us (15693us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.036783:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7944 00002000:00100000:3.0:1746126622.036792:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880092b17480 x1830945721626112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.036800:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b17480 with x1830945721626112 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.036806:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b17480 00000100:00100000:0.0:1746126622.042150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126622.042385:0:14547:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from blocking AST (req@ffff88009bb2f800 x1830945721435392) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746126622.042401:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14a00/0xb50e8258676147b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a0 expref: 10 pid: 14547 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746126622.042429:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721435392:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.042442:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721435520:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126622.042467:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.042471:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.042482:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.042489:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746126622.042548:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721626624 00000100:00100000:2.0:1746126622.042554:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721626624 00010000:00010000:2.0:1746126622.042580:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746126622.042602:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7278 00000100:00100000:2.0:1746126622.042608:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721626624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.042619:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.042623:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126622.042632:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126622.042647:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14400/0xb50e825867614764 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e592 expref: 7 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746126622.042655:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.042658:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126622.042664:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126622.042669:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126622.042674:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126622.042679:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126622.042690:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.042727:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721626624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 118us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.042733:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7278 00000100:00100000:0.0:1746126622.042963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.042981:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721626752 00000100:00100000:0.0:1746126622.042985:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721626752 00000100:00100000:0.0:1746126622.043009:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13925 00000100:00100000:0.0:1746126622.043014:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+27:31466:x1830945721626752:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.043035:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.043047:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5df expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.043062:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.043064:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.043069:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.043084:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.043092:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a03800, rc 0) 00000100:00100000:0.0:1746126622.043111:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:31466:x1830945721626752:12345-192.168.203.2@tcp:101:cat.0 Request processed in 97us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.043116:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13925 00000100:00080000:1.0:1746126622.043214:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746126622.043360:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.043366:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000040:00080000:3.0:1746126622.043898:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2692, 88 off228752 00000004:00080000:3.0:1746126622.043905:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958077457ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044574:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2814, 88 off239592 00000004:00080000:3.0:1746126622.044580:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958752682ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044605:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2815, 88 off239680 00000004:00080000:3.0:1746126622.044608:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958780502ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044616:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2693, 88 off228840 00000004:00080000:3.0:1746126622.044619:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958791311ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044625:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2694, 88 off228928 00000004:00080000:3.0:1746126622.044627:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958799785ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044633:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2816, 88 off239768 00000004:00080000:3.0:1746126622.044635:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958808066ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044641:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2817, 88 off239856 00000004:00080000:3.0:1746126622.044644:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958816285ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044649:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2695, 88 off229016 00000004:00080000:3.0:1746126622.044652:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958825115ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044659:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2818, 88 off239944 00000004:00080000:3.0:1746126622.044662:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958834467ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044668:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2696, 88 off229104 00000004:00080000:3.0:1746126622.044670:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958843003ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044676:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2819, 88 off240032 00000004:00080000:3.0:1746126622.044679:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958851537ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044685:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2697, 88 off229192 00000004:00080000:3.0:1746126622.044687:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958859417ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044693:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2820, 88 off240120 00000004:00080000:3.0:1746126622.044695:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958867973ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044702:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2698, 88 off229280 00000004:00080000:3.0:1746126622.044704:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958876487ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126622.044710:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2821, 88 off240208 00000004:00080000:3.0:1746126622.044712:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958884791ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044719:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2822, 88 off240296 00000004:00080000:3.0:1746126622.044721:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743958893130ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126622.044753:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2700, 88 off229464 00000004:00080000:3.0:1746126622.044757:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958929367ns, next at 687927188999ns, rc = 0 00000100:00100000:0.0:1746126622.048209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.048541:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721626880 00000100:00100000:3.0:1746126622.048548:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721626880 00000100:00100000:3.0:1746126622.048581:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9029 00000100:00100000:3.0:1746126622.048587:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+225:31466:x1830945721626880:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.048603:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.048617:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5e6 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.048659:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.048670:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 226 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.048683:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.048693:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 226 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.048702:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.048705:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126622.048707:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.048712:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce14000, rc 0) 00000100:00100000:3.0:1746126622.048750:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:31466:x1830945721626880:12345-192.168.203.2@tcp:101:cat.0 Request processed in 162us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.048755:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9029 00000001:00080000:0.0:1746126622.108862:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943212 is committed 00000001:00080000:0.0:1746126622.108873:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943211 is committed 00000001:00080000:0.0:1746126622.108878:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943213 is committed 00000004:00080000:0.0:1746126622.108881:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2084 committed 00000004:00080000:0.0:1746126622.108886:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2203 committed 00000004:00080000:0.0:1746126622.108889:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2202 committed 00000004:00080000:0.0:1746126622.108891:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2083 committed 00000004:00080000:0.0:1746126622.108892:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2201 committed 00000004:00080000:0.0:1746126622.108893:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2082 committed 00000004:00080000:0.0:1746126622.108895:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2200 committed 00000004:00080000:0.0:1746126622.108896:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2081 committed 00000004:00080000:0.0:1746126622.108897:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2199 committed 00000004:00080000:0.0:1746126622.108898:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2080 committed 00000004:00080000:0.0:1746126622.108899:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2198 committed 00000004:00080000:0.0:1746126622.108901:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2197 committed 00000004:00080000:0.0:1746126622.108902:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2079 committed 00000004:00080000:0.0:1746126622.108903:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2078 committed 00000004:00080000:0.0:1746126622.108905:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2196 committed 00000004:00080000:0.0:1746126622.108906:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2195 committed 00000004:00080000:0.0:1746126622.108908:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2077 committed 00000100:00100000:0.0:1746126622.108990:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721435648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.109051:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.109085:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.109100:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.109117:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746126622.109120:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.109133:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746126622.109140:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 224 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126622.109142:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436544:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746126622.109151:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:0.0:1746126622.109153:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746126622.109154:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746126622.109157:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126622.109164:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 224 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126622.109168:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721435776:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746126622.109174:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126622.109180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.109189:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721436288:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746126622.109195:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 224 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126622.109199:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746126622.109205:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 224 pid: 14547 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.109207:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126622.109211:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721435904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126622.109214:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721436672:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126622.109221:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126622.109256:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b70cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.110038:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721437056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.110062:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.110091:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721437184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.110148:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.113993:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435648 00000100:00100000:3.0:1746126622.114002:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435648 00000100:00100000:0.0:1746126622.114021:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436160 00000100:00100000:0.0:1746126622.114035:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436160 00000100:00100000:3.0:1746126622.114056:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436032 00000100:00100000:3.0:1746126622.114058:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436032 00000100:00100000:3.0:1746126622.114067:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436544 00000100:00100000:3.0:1746126622.114070:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436544 00000100:00100000:3.0:1746126622.114077:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435776 00000100:00100000:3.0:1746126622.114079:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435776 00000100:00100000:3.0:1746126622.114085:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436288 00000100:00100000:3.0:1746126622.114087:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436288 00000100:00100000:3.0:1746126622.114092:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721435904 00000100:00100000:3.0:1746126622.114094:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721435904 00000100:00100000:0.0:1746126622.114094:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437056 00000100:00100000:0.0:1746126622.114096:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437056 00000100:00100000:3.0:1746126622.114104:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13926 00000100:00100000:3.0:1746126622.114186:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3297:x1830945721435648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126622.114382:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126622.114385:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:3.0:1746126622.114386:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:3.0:1746126622.114389:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126622.114390:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746126622.114433:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3297:x1830945721435648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 322us (5381us total) trans 17179873275 rc 0/0 00000100:00100000:0.0:1746126622.114518:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13927 00000100:00100000:0.0:1746126622.114525:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3297:x1830945721436032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.114630:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721436032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (5494us total) trans 17179873276 rc 0/0 00000100:00100000:0.0:1746126622.114636:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13927 00000100:00100000:0.0:1746126622.114648:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13928 00000100:00100000:0.0:1746126622.114652:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3297:x1830945721436544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.114725:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721436544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (5570us total) trans 17179873277 rc 0/0 00000100:00100000:0.0:1746126622.114730:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13928 00000100:00100000:0.0:1746126622.114738:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13929 00000100:00100000:0.0:1746126622.114742:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3294:x1830945721435776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126622.114817:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126622.114820:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.114822:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:0.0:1746126622.114823:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.114842:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126622.114857:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13930 00000100:00100000:0.0:1746126622.114862:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830945721436288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.114939:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3294:x1830945721436288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (5739us total) trans 17179873279 rc 0/0 00000100:00100000:0.0:1746126622.114944:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13930 00000100:00100000:0.0:1746126622.114953:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13931 00000100:00100000:0.0:1746126622.114956:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3297:x1830945721436160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126622.115023:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746126622.115039:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126622.115041:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126622.115042:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:0.0:1746126622.115044:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126622.115063:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3297:x1830945721436160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (5961us total) trans 17179873280 rc 0/0 00000100:00100000:0.0:1746126622.115068:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13931 00000100:00100000:0.0:1746126622.115077:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13932 00000100:00100000:0.0:1746126622.115081:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830945721435904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126622.115150:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126622.115152:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.115154:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.115155:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.115157:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746126622.115174:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3294:x1830945721435904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (5951us total) trans 17179873281 rc 0/0 00000100:00100000:0.0:1746126622.115179:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13932 00000100:00100000:0.0:1746126622.115187:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13933 00000100:00100000:0.0:1746126622.115192:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3295:x1830945721437056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126622.115270:0:9686:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126622.115273:0:9686:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.115274:0:9686:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.115276:0:9686:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.115277:0:9686:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:0.0:1746126622.115294:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3295:x1830945721437056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (5232us total) trans 21474840423 rc 0/0 00000100:00100000:0.0:1746126622.115299:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13933 00000004:00080000:0.0:1746126622.115396:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14700/2, rc 0, transno 17179873281 00000100:00100000:0.0:1746126622.115404:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721435904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.115413:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721436416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.115436:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126622.115451:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b17800/2, rc 0, transno 17179873279 00000100:00100000:0.0:1746126622.115455:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721436288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.115464:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721436928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.115478:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.115488:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721437440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.115499:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.115514:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436416 00000100:00100000:0.0:1746126622.115518:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436416 00000100:00100000:0.0:1746126622.115528:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436928 00000100:00100000:0.0:1746126622.115530:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436928 00000100:00100000:0.0:1746126622.115536:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437440 00000100:00100000:0.0:1746126622.115538:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437440 00000100:00100000:0.0:1746126622.115545:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13934 00000100:00100000:0.0:1746126622.115549:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3294:x1830945721436416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.115632:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3294:x1830945721436416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (194us total) trans 17179873282 rc 0/0 00000100:00100000:0.0:1746126622.115637:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13934 00000100:00100000:0.0:1746126622.115647:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13935 00000100:00100000:0.0:1746126622.115650:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721436928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126622.115708:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126622.115710:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.115712:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126618 -> 1746126618 00002000:00010000:0.0:1746126622.115714:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.115716:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746126622.115731:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721436928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (251us total) trans 21474840424 rc 0/0 00000100:00100000:0.0:1746126622.115735:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13935 00000100:00100000:0.0:1746126622.115742:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13936 00000100:00100000:0.0:1746126622.115746:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721437440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.115801:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721437440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (301us total) trans 21474840425 rc 0/0 00000100:00100000:0.0:1746126622.115806:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13936 00000100:00100000:0.0:1746126622.115868:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3294:x1830945721435776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1126us (6687us total) trans 17179873278 rc 0/0 00000100:00100000:0.0:1746126622.115872:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13929 00000004:00080000:0.0:1746126622.115888:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fd500/2, rc 0, transno 21474840423 00000100:00100000:0.0:1746126622.115891:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721437056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.115895:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721437568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.115908:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.115921:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437568 00000100:00100000:0.0:1746126622.115923:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437568 00000100:00100000:0.0:1746126622.115931:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13937 00000100:00100000:0.0:1746126622.115935:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3295:x1830945721437568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.115999:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3295:x1830945721437568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (90us total) trans 21474840426 rc 0/0 00000100:00100000:0.0:1746126622.116004:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13937 00000004:00080000:0.0:1746126622.116018:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ff480/2, rc 0, transno 21474840424 00000100:00100000:0.0:1746126622.116020:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721436928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126622.116040:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fdf80/2, rc 0, transno 21474840425 00000100:00100000:0.0:1746126622.116043:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721437440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126622.116048:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14380/2, rc 0, transno 17179873282 00000100:00100000:0.0:1746126622.116050:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721436416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.116054:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15180/2, rc 0, transno 17179873278 00000100:00100000:0.0:1746126622.116056:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721435776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.116065:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9ff100/2, rc 0, transno 21474840426 00000100:00100000:0.0:1746126622.116068:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721437568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.116149:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13926 00000100:00100000:1.0:1746126622.116886:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.116907:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721437696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.116929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126622.117913:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437184 00000100:00100000:3.0:1746126622.117918:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437184 00000100:00100000:1.0:1746126622.117926:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126622.117931:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721437824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126622.117938:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437696 00000100:00100000:3.0:1746126622.117940:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437696 00000100:00100000:3.0:1746126622.117950:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13938 00000100:00100000:3.0:1746126622.117955:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3296:x1830945721437184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.117955:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.117973:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437824 00000100:00100000:1.0:1746126622.117976:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437824 00000100:00100000:1.0:1746126622.117991:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13939 00000100:00100000:1.0:1746126622.117995:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3296:x1830945721437696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.118077:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721436672:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126622.118104:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15200/0xb50e8258676147b8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 224 pid: 14547 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746126622.118124:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 223 pid: 14547 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.118131:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 223 pid: 14547 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.118151:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce15000, rc 0) 00000100:00100000:3.0:1746126622.118193:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31469:x1830945721625856:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 96479us (97443us total) trans 8589943213 rc 0/0 00000100:00100000:3.0:1746126622.118199:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9027 00000100:00100000:1.0:1746126622.118501:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13940 00000100:00100000:1.0:1746126622.118506:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830945721437824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126622.118619:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3296:x1830945721437824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (662us total) trans 17179873283 rc 0/0 00000100:00100000:1.0:1746126622.118624:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13940 00000004:00080000:0.0:1746126622.121547:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091da0380/2, rc 0, transno 17179873283 00000100:00100000:0.0:1746126622.121555:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721437824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.121571:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.121604:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721437312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.121612:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721436800 00000100:00100000:3.0:1746126622.121618:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721436800 00000100:00100000:0.0:1746126622.121643:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126622.121645:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13941 00000100:00100000:3.0:1746126622.121651:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721436800:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126622.121660:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15500/2, rc 0, transno 17179873276 00000100:00100000:0.0:1746126622.121663:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126622.121664:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721437312 00000100:00100000:3.0:1746126622.121666:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721437312 00000004:00080000:0.0:1746126622.121669:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b14e00/2, rc 0, transno 17179873277 00000100:00100000:0.0:1746126622.121672:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126622.121678:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13942 00000100:00100000:3.0:1746126622.121682:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3297:x1830945721437312:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126622.121682:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15c00/2, rc 0, transno 17179873275 00000100:00100000:0.0:1746126622.121685:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721435648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126622.121691:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b15f80/2, rc 0, transno 17179873280 00000100:00100000:0.0:1746126622.121694:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.123751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.123773:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721627008 00000100:00100000:0.0:1746126622.123779:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721627008 00010000:00010000:0.0:1746126622.123802:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 223 pid: 14547 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.123819:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7279 00000100:00100000:0.0:1746126622.123824:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:1963:x1830945721627008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126622.123852:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126622.123857:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 223 pid: 14547 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.123865:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 223 pid: 14547 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.123883:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce15000/0xb50e8258676147bf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d1 expref: 223 pid: 14547 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.123898:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126622.123903:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126622.123910:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126622.124004:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126622.124012:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 222 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.124040:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126622.124069:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:1963:x1830945721627008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 245us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.124074:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7279 00010000:00010000:0.0:1746126622.124092:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126622.124097:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00000040:00080000:0.0:1746126622.124581:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2701, 88 off229552 00000004:00080000:0.0:1746126622.124586:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038758536ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124636:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2823, 88 off240384 00000004:00080000:0.0:1746126622.124639:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038811968ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124650:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2824, 88 off240472 00000004:00080000:0.0:1746126622.124653:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038825641ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124660:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2702, 88 off229640 00000004:00080000:0.0:1746126622.124662:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038834611ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124668:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2703, 88 off229728 00000004:00080000:0.0:1746126622.124670:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038842439ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124675:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2825, 88 off240560 00000004:00080000:0.0:1746126622.124677:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038849988ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124683:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2826, 88 off240648 00000004:00080000:0.0:1746126622.124685:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038857804ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124691:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2704, 88 off229816 00000004:00080000:0.0:1746126622.124693:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038865676ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124699:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2827, 88 off240736 00000004:00080000:0.0:1746126622.124701:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038873767ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124707:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2705, 88 off229904 00000004:00080000:0.0:1746126622.124709:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038881918ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124715:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2828, 88 off240824 00000004:00080000:0.0:1746126622.124717:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038889604ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124722:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2706, 88 off229992 00000004:00080000:0.0:1746126622.124724:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038896797ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124730:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2829, 88 off240912 00000004:00080000:0.0:1746126622.124732:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038904989ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124738:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2707, 88 off230080 00000004:00080000:0.0:1746126622.124740:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038912669ns, next at 687927188999ns, rc = 0 00000040:00080000:0.0:1746126622.124745:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2830, 88 off241000 00000004:00080000:0.0:1746126622.124748:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038920224ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124753:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2831, 88 off241088 00000004:00080000:0.0:1746126622.124755:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744038927793ns, next at 687959345514ns, rc = 0 00000040:00080000:0.0:1746126622.124760:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2708, 88 off230168 00000004:00080000:0.0:1746126622.124762:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744038934897ns, next at 687927188999ns, rc = 0 00000100:00100000:1.0:1746126622.129420:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3296:x1830945721437184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 11457us (12529us total) trans 21474840427 rc 0/0 00000100:00100000:1.0:1746126622.129430:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13938 00000004:00080000:1.0:1746126622.129475:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fc380/2, rc 0, transno 21474840427 00000100:00100000:1.0:1746126622.129484:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721437184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.129541:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3296:x1830945721437696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 11546us (12610us total) trans 21474840428 rc 0/0 00000100:00100000:1.0:1746126622.129547:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13939 00000004:00080000:1.0:1746126622.129565:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fce00/2, rc 0, transno 21474840428 00000100:00100000:1.0:1746126622.129569:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721437696:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126622.129697:0:4642:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126622.129700:0:4642:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:1.0:1746126622.129702:0:4642:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:1.0:1746126622.129703:0:4642:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126621 -> 1746126621 00002000:00010000:1.0:1746126622.129705:0:4642:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:1.0:1746126622.129727:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721436800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8076us (8155us total) trans 21474840429 rc 0/0 00000100:00100000:1.0:1746126622.129732:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13941 00000004:00080000:1.0:1746126622.129751:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fe300/2, rc 0, transno 21474840429 00000100:00100000:1.0:1746126622.129756:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721436800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.129854:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3297:x1830945721437312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8171us (8209us total) trans 21474840430 rc 0/0 00000100:00100000:1.0:1746126622.129859:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13942 00000004:00080000:1.0:1746126622.129876:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fca80/2, rc 0, transno 21474840430 00000100:00100000:1.0:1746126622.129879:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721437312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.144067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.144143:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721627264 00000100:00100000:3.0:1746126622.144150:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721627264 00000100:00100000:3.0:1746126622.144184:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9030 00000100:00100000:3.0:1746126622.144190:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31474:x1830945721627264:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.144206:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.144220:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32ce00/0xb50e8258676147e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5ed expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.144293:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144303:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144310:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144318:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144322:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144327:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144402:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144409:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.144414:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126622.144910:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126622.145061:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145067:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145072:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145078:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a32de00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.145081:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145086:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145097:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.145099:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126622.145102:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145106:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32de00/0xb50e8258676147f7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145120:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145125:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145129:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145132:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a32d400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.145134:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145138:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145143:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126622.145145:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.145147:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145151:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32d400/0xb50e8258676147e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145157:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145161:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145165:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145169:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a32c200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.145171:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145176:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145181:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1000) 00010000:00010000:3.0:1746126622.145183:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.145184:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145188:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32c200/0xb50e8258676147f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.145217:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32ce00/0xb50e8258676147e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ed expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.145223:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a32ce00/0xb50e8258676147e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ed expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.145230:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a32ce00, rc 0) 00000100:00100000:3.0:1746126622.145269:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31474:x1830945721627264:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1079us (1206us total) trans 8589943215 rc 301/301 00000100:00100000:3.0:1746126622.145276:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9030 00000100:00100000:1.0:1746126622.150655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.150733:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721627520 00000100:00100000:3.0:1746126622.150741:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721627520 00000100:00100000:3.0:1746126622.150775:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3831 00000100:00100000:3.0:1746126622.150782:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31474:x1830945721627520:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1746126622.151758:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31474:x1830945721627520:12345-192.168.203.2@tcp:35:cat.0 Request processed in 974us (1107us total) trans 8589943216 rc 0/0 00000100:00100000:3.0:1746126622.151767:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3831 00000100:00100000:3.0:1746126622.157040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.157076:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721627648 00000100:00100000:3.0:1746126622.157083:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721627648 00000100:00100000:3.0:1746126622.157114:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9031 00000100:00100000:3.0:1746126622.157120:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31474:x1830945721627648:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.157136:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.157152:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614805 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5f4 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.157224:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.157234:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.157241:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.174873:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.174886:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126622.174889:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746126622.174891:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.174898:0:20362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.174903:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126622.174910:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 221 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.174920:0:20362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 221 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.174926:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 221 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.174957:0:20362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 221 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126622.174969:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721437952:192.168.203.2@tcp:105: 00000001:00080000:0.0:1746126622.174975:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943214 is committed 00000004:00080000:0.0:1746126622.174981:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2092 committed 00000004:00080000:0.0:1746126622.174987:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2212 committed 00000004:00080000:0.0:1746126622.174991:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2211 committed 00000004:00080000:0.0:1746126622.174992:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2091 committed 00000004:00080000:0.0:1746126622.174993:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2210 committed 00000004:00080000:0.0:1746126622.174995:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2090 committed 00000004:00080000:0.0:1746126622.174996:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2209 committed 00000004:00080000:0.0:1746126622.174998:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2089 committed 00000004:00080000:0.0:1746126622.174999:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2208 committed 00000004:00080000:0.0:1746126622.175000:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2088 committed 00000004:00080000:0.0:1746126622.175001:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2207 committed 00000004:00080000:0.0:1746126622.175003:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2206 committed 00000004:00080000:0.0:1746126622.175004:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746126622.175006:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2086 committed 00000004:00080000:0.0:1746126622.175007:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2205 committed 00000004:00080000:0.0:1746126622.175008:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2204 committed 00000004:00080000:0.0:1746126622.175010:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2085 committed 00000100:00100000:0.0:1746126622.175095:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721438080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126622.175205:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126622.175259:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721438336:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746126622.175295:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.175303:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746126622.175333:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126622.175337:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126622.175348:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126622.175372:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008da01200/0xb50e825867614805 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.175385:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.175391:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.175393:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746126622.175395:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2e200, rc 0) 00000100:00100000:3.0:1746126622.176152:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31474:x1830945721627648:12345-192.168.203.2@tcp:101:cat.0 Request processed in 19030us (19125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.176159:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9031 00000100:00100000:0.0:1746126622.176236:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721438208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.176268:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.176715:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721438464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.176854:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721438720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126622.176856:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.176871:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721438976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.176874:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.176888:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.176888:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.176899:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721439488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.176904:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126622.176914:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.176916:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.176926:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721440000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.176928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.176959:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746126622.176963:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.176966:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438208 00000100:00100000:3.0:1746126622.176971:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438208 00000100:00100000:0.0:1746126622.176978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.176988:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.176995:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438464 00000100:00100000:3.0:1746126622.176997:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438464 00000100:00100000:0.0:1746126622.177000:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126622.177006:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438720 00000100:00100000:3.0:1746126622.177008:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438720 00000100:00100000:3.0:1746126622.177014:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438976 00000100:00100000:3.0:1746126622.177015:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438976 00000100:00100000:3.0:1746126622.177021:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439488 00000100:00100000:0.0:1746126622.177021:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439232 00000100:00100000:3.0:1746126622.177022:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439488 00000100:00100000:0.0:1746126622.177036:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439232 00000100:00100000:3.0:1746126622.177039:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439744 00000100:00100000:3.0:1746126622.177040:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439744 00000100:00100000:3.0:1746126622.177045:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439104 00000100:00100000:3.0:1746126622.177047:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439104 00000100:00100000:3.0:1746126622.177051:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439616 00000100:00100000:3.0:1746126622.177053:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439616 00000100:00100000:3.0:1746126622.177060:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13943 00000100:00100000:3.0:1746126622.177066:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721438208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126622.177200:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126622.177203:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126622.177205:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126619 -> 1746126619 00002000:00010000:3.0:1746126622.177207:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126622.177209:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746126622.177234:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3295:x1830945721438208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (965us total) trans 17179873284 rc 0/0 00000100:00100000:3.0:1746126622.177239:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13943 00000100:00100000:3.0:1746126622.177248:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13944 00000100:00100000:3.0:1746126622.177252:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3297:x1830945721438464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126622.177263:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.177279:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721438848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126622.177295:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.177302:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721439360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.177313:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.177319:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721439872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.177331:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.178213:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438336 00000100:00100000:0.0:1746126622.178218:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438336 00000100:00100000:0.0:1746126622.178230:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438848 00000100:00100000:0.0:1746126622.178231:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438848 00000100:00100000:0.0:1746126622.178236:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439360 00000100:00100000:0.0:1746126622.178237:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439360 00000100:00100000:0.0:1746126622.178243:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721439872 00000100:00100000:0.0:1746126622.178244:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721439872 00000100:00100000:0.0:1746126622.178253:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13945 00000100:00100000:0.0:1746126622.178259:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3295:x1830945721438720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126622.178295:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13946 00000100:00100000:3.0:1746126622.178302:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3297:x1830945721438976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.178371:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3295:x1830945721438720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (1495us total) trans 17179873285 rc 0/0 00000100:00100000:0.0:1746126622.178377:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13945 00000100:00100000:0.0:1746126622.178388:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13947 00000100:00100000:3.0:1746126622.178389:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3297:x1830945721438976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1498us total) trans 17179873286 rc 0/0 00000100:00100000:0.0:1746126622.178393:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3297:x1830945721439488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.178395:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13946 00000100:00100000:3.0:1746126622.178405:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13948 00000100:00100000:3.0:1746126622.178409:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3295:x1830945721439744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.178483:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721439744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1553us total) trans 21474840431 rc 0/0 00000100:00100000:3.0:1746126622.178488:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13948 00000100:00100000:0.0:1746126622.178495:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3297:x1830945721439488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (1578us total) trans 21474840432 rc 0/0 00000100:00100000:3.0:1746126622.178496:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13949 00000100:00100000:3.0:1746126622.178500:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3295:x1830945721439104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.178501:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13947 00000100:00100000:0.0:1746126622.178511:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13950 00000100:00100000:0.0:1746126622.178515:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3295:x1830945721439616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126622.178563:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746126622.178565:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:3.0:1746126622.178567:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:3.0:1746126622.178568:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126621 -> 1746126621 00002000:00010000:3.0:1746126622.178570:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:3.0:1746126622.178590:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721439104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1611us total) trans 21474840433 rc 0/0 00000100:00100000:3.0:1746126622.178593:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13949 00000100:00100000:0.0:1746126622.178597:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3295:x1830945721439616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1595us total) trans 21474840434 rc 0/0 00000100:00100000:3.0:1746126622.178601:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13951 00000100:00100000:0.0:1746126622.178604:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13950 00000100:00100000:3.0:1746126622.178605:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3295:x1830945721439232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126622.178614:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13952 00000100:00100000:0.0:1746126622.178618:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3296:x1830945721438336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126622.178667:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126622.178669:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126622.178671:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126618 -> 1746126618 00002000:00010000:3.0:1746126622.178672:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126622.178673:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:0.0:1746126622.178684:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126622.178686:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.178688:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.178690:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.178691:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746126622.178692:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3295:x1830945721439232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1787us total) trans 21474840435 rc 0/0 00000100:00100000:3.0:1746126622.178696:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13951 00000100:00100000:3.0:1746126622.178706:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13953 00000100:00100000:3.0:1746126622.178710:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3296:x1830945721438848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.178729:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3296:x1830945721438336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1466us total) trans 17179873287 rc 0/0 00000100:00100000:0.0:1746126622.178734:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13952 00000100:00100000:0.0:1746126622.178745:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13954 00000100:00100000:0.0:1746126622.178750:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3296:x1830945721439360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126622.178776:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3296:x1830945721438848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1478us total) trans 17179873288 rc 0/0 00000100:00100000:3.0:1746126622.178780:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13953 00000100:00100000:3.0:1746126622.178789:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13955 00000100:00100000:3.0:1746126622.178793:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3296:x1830945721439872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126622.178821:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126622.178823:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.178848:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.178849:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.178851:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5693 00000100:00100000:0.0:1746126622.178872:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3296:x1830945721439360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (1557us total) trans 21474840436 rc 0/0 00000100:00100000:0.0:1746126622.178878:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13954 00000100:00100000:3.0:1746126622.178882:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3296:x1830945721439872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1549us total) trans 21474840437 rc 0/0 00000100:00100000:3.0:1746126622.178887:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13955 00000100:00100000:0.0:1746126622.178904:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126622.178923:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721438592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.178940:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126622.178965:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3297:x1830945721438464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1712us (2108us total) trans 17179873289 rc 0/0 00000100:00100000:3.0:1746126622.178972:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13944 00000100:00100000:3.0:1746126622.178980:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438080 00000100:00100000:3.0:1746126622.178983:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438080 00000100:00100000:3.0:1746126622.178994:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721438592 00000100:00100000:3.0:1746126622.178996:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721438592 00000100:00100000:0.0:1746126622.179004:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13956 00000100:00100000:0.0:1746126622.179010:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3294:x1830945721438080:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126622.179488:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56680/2, rc 0, transno 17179873287 00000100:00100000:2.0:1746126622.179497:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721438336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126622.179506:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f257800/2, rc 0, transno 17179873288 00000100:00100000:2.0:1746126622.179509:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721438848:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126622.179517:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab8380/2, rc 0, transno 21474840436 00000100:00100000:2.0:1746126622.179519:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721439360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126622.179525:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dabb480/2, rc 0, transno 21474840437 00000100:00100000:2.0:1746126622.179527:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721439872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126622.179567:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721440128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126622.179593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.179611:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440128 00000100:00100000:2.0:1746126622.179614:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440128 00000100:00100000:3.0:1746126622.181223:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13957 00000100:00100000:3.0:1746126622.181233:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3294:x1830945721438592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126622.181353:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746126622.181355:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126622.181357:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746126622.181358:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:3.0:1746126622.181360:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746126622.181393:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3294:x1830945721438592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (2452us total) trans 17179873290 rc 0/0 00000100:00100000:3.0:1746126622.181398:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13957 00000100:00100000:3.0:1746126622.181456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.181473:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.181642:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13958 00000100:00100000:2.0:1746126622.181649:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3294:x1830945721440128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126622.181706:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126622.181733:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3294:x1830945721440128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (2139us total) trans 17179873291 rc 0/0 00000100:00100000:2.0:1746126622.181739:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13958 00000004:00080000:1.0:1746126622.181743:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f56d80/2, rc 0, transno 17179873289 00000100:00100000:1.0:1746126622.181747:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721438464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126622.181748:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721440000 00000100:00100000:2.0:1746126622.181751:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721440000 00000004:00080000:1.0:1746126622.181755:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f256300/2, rc 0, transno 17179873286 00000100:00100000:1.0:1746126622.181757:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721438976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126622.181764:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13959 00000004:00080000:1.0:1746126622.181766:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab8e00/2, rc 0, transno 21474840432 00000100:00100000:2.0:1746126622.181768:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3297:x1830945721440000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.181769:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721439488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.181789:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721437952:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126622.181815:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75aa00/0xb50e8258676147c6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 12 pid: 20362 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746126622.181843:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 11 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.181862:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3297:x1830945721440000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (155us total) trans 21474840438 rc 0/0 00010000:00010000:1.0:1746126622.181862:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed30000, rc 0) 00000100:00100000:2.0:1746126622.181867:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13959 00000100:00100000:1.0:1746126622.181889:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31471:x1830945721626496:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 148751us (148821us total) trans 8589943214 rc 0/0 00000100:00100000:1.0:1746126622.181894:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9028 00000100:00100000:1.0:1746126622.181906:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721627904 00000100:00100000:1.0:1746126622.181908:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721627904 00000100:00100000:1.0:1746126622.181924:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9032 00000100:00100000:1.0:1746126622.181929:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+222:31469:x1830945721627904:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126622.181940:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.181950:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135527600/0xb50e825867614813 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e5fb expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746126622.181963:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a448e300/2, rc 0, transno 17179873291 00000100:00100000:2.0:1746126622.181967:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721440128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126622.181975:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f57b80/2, rc 0, transno 17179873290 00010000:00010000:1.0:1746126622.181976:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135527600/0xb50e825867614813 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5fb expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.181978:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721438592:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746126622.181986:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135527600/0xb50e825867614813 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5fb expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.181999:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126622.182001:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126622.182003:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527600, rc 0) 00000100:00100000:3.0:1746126622.182195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:0.0:1746126622.182273:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126622.182276:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.182278:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:0.0:1746126622.182280:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:0.0:1746126622.182281:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:0.0:1746126622.182304:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3294:x1830945721438080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3294us (3400us total) trans 17179873292 rc 0/0 00000100:00100000:0.0:1746126622.182309:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13956 00000100:00100000:3.0:1746126622.182343:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721627776 00000100:00100000:3.0:1746126622.182346:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721627776 00000100:00100000:3.0:1746126622.182363:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3832 00000100:00100000:3.0:1746126622.182368:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31466:x1830945721627776:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:3.0:1746126622.182418:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31466:x1830945721627776:12345-192.168.203.2@tcp:49:cat.0 Request processed in 49us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.182422:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3832 00000100:00100000:3.0:1746126622.182448:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628032 00000100:00100000:3.0:1746126622.182451:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628032 00000100:00100000:3.0:1746126622.182464:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9033 00000100:00100000:3.0:1746126622.182469:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31474:x1830945721628032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.182475:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.182482:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e82586761481a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e602 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.182502:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e82586761481a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e602 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.182510:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e82586761481a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e602 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.182520:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.182522:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126622.182524:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2f800, rc 0) 00000100:00100000:3.0:1746126622.182538:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31474:x1830945721628032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.182542:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9033 00000004:00080000:3.0:1746126622.182574:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dabbb80/2, rc 0, transno 21474840433 00000100:00100000:3.0:1746126622.182578:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439104:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126622.182587:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dabb100/2, rc 0, transno 21474840434 00000100:00100000:3.0:1746126622.182589:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126622.182596:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f57100/2, rc 0, transno 17179873284 00000100:00100000:3.0:1746126622.182599:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721438208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126622.182606:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f57800/2, rc 0, transno 17179873285 00000100:00100000:3.0:1746126622.182608:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721438720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126622.182615:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab9c00/2, rc 0, transno 21474840435 00000100:00100000:3.0:1746126622.182617:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126622.182623:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dabb800/2, rc 0, transno 21474840431 00000100:00100000:3.0:1746126622.182625:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721439744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126622.182733:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008daba680/2, rc 0, transno 21474840438 00000100:00100000:1.0:1746126622.182736:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721440000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126622.182914:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:31469:x1830945721627904:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 983us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.182919:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9032 00000004:00080000:2.0:1746126622.182981:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55880/2, rc 0, transno 17179873292 00000100:00100000:2.0:1746126622.182985:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721438080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126622.186487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.186724:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628160 00000100:00100000:3.0:1746126622.186730:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628160 00000100:00100000:3.0:1746126622.186932:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13960 00000100:00100000:3.0:1746126622.186940:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31471:x1830945721628160:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126622.186954:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.186968:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e609 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.186991:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126622.186997:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.186999:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.187002:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [4038656->4059135] (req 4038656->4059135) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.187036:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126622.187046:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 8 pid: 8438 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746126622.187057:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721440256:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.187123:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746126622.187221:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126622.189290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.189683:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628288 00000100:00100000:3.0:1746126622.189690:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628288 00000100:00100000:3.0:1746126622.189721:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 705 00000100:00100000:3.0:1746126622.189726:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:1966:x1830945721628288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.189735:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.189754:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135527600/0xb50e825867614813 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5fb expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.189765:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.189769:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.189796:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+222:1966:x1830945721628288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.189802:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 705 00000100:00100000:1.0:1746126622.190091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.192945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.194856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.194934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.194992:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628416 00000100:00100000:0.0:1746126622.194999:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628416 00000100:00100000:0.0:1746126622.195061:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628544 00000100:00100000:0.0:1746126622.195063:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628544 00000100:00080000:3.0:1746126622.195067:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126622.195075:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628672 00000100:00100000:0.0:1746126622.195077:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628672 00000100:00100000:0.0:1746126622.195090:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13961 00000100:00100000:0.0:1746126622.195096:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721628416:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.195110:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.195125:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e610 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.195144:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.195146:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.195153:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.195167:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.195176:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099212200, rc 0) 00000100:00100000:0.0:1746126622.195213:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721628416:12345-192.168.203.2@tcp:101:cat.0 Request processed in 117us (5121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.195218:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13961 00000100:00100000:0.0:1746126622.195231:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13962 00000100:00100000:0.0:1746126622.195235:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721628544:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.195242:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.195249:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e617 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.195262:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.195263:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.195267:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.195275:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.195281:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099213600, rc 0) 00000100:00100000:0.0:1746126622.195295:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721628544:12345-192.168.203.2@tcp:101:cat.0 Request processed in 59us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.195299:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13962 00000100:00100000:0.0:1746126622.195308:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13963 00000100:00100000:0.0:1746126622.195312:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721628672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.195316:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.195321:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e61e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.195330:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.195331:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.195334:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.195341:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.195351:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099212000, rc 0) 00000100:00100000:0.0:1746126622.195365:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721628672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 53us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.195369:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13963 00000100:00100000:1.0:1746126622.195786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.195799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.195864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.195898:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628800 00000100:00100000:1.0:1746126622.195902:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628800 00000100:00100000:1.0:1746126622.195918:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721628928 00000100:00100000:1.0:1746126622.195920:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721628928 00000100:00100000:1.0:1746126622.195928:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721629184 00000100:00100000:1.0:1746126622.195930:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721629184 00000100:00100000:1.0:1746126622.195936:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721629056 00000100:00100000:1.0:1746126622.195937:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721629056 00000100:00100000:1.0:1746126622.195945:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13964 00000100:00100000:1.0:1746126622.195949:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721628800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126622.195955:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.195964:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e625 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.195974:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.195976:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.195980:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.195989:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.195995:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c78000, rc 0) 00000100:00100000:1.0:1746126622.196015:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1965:x1830945721628800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 65us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.196020:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13964 00000100:00100000:1.0:1746126622.196039:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13965 00000100:00100000:1.0:1746126622.196044:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721628928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126622.196049:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.196055:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e62c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.196064:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.196065:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.196068:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.196076:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 32 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.196086:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c79c00, rc 0) 00000100:00100000:1.0:1746126622.196100:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1965:x1830945721628928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 56us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.196105:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13965 00000100:00100000:1.0:1746126622.196114:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13966 00000100:00100000:1.0:1746126622.196118:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:31469:x1830945721629184:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126622.196123:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.196128:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e63a expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.196140:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 7 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.196147:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 31 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.196152:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.196153:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.196156:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3645440->3674111] (req 3645440->3674111) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.196178:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 31 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.196186:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 31 pid: 4640 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746126622.196197:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721440384:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.196224:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721440256:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126622.196239:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [4038656->4059135] (req 4038656->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.196245:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 7 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126622.196249:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2f600, rc 0) 00010000:00010000:1.0:1746126622.196252:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 7 pid: 4641 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746126622.196258:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721440512:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.196264:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31471:x1830945721628160:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9326us (9783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.196269:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13960 00000100:00100000:1.0:1746126622.196274:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126622.196281:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13967 00000100:00100000:3.0:1746126622.196285:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721629056:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.196293:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.196298:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134c2e000/0xb50e825867614852 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e633 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.196307:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.196314:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134c2e000/0xb50e825867614852 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e633 expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126622.196320:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c2e000/0xb50e825867614852 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e633 expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126622.196328:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134c2e000, rc 0) 00000100:00100000:3.0:1746126622.196338:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721629056:12345-192.168.203.2@tcp:101:cat.0 Request processed in 53us (474us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126622.196342:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13967 00000100:00100000:0.0:1746126622.196563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.196611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.196763:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721629312 00000100:00100000:3.0:1746126622.196767:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721629312 00000100:00100000:3.0:1746126622.196786:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721629440 00000100:00100000:3.0:1746126622.196788:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721629440 00010000:00010000:3.0:1746126622.196795:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 9 pid: 8438 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746126622.196809:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7280 00000100:00100000:3.0:1746126622.196813:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721629440:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.196819:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.196855:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 9 pid: 8438 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.196868:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 9 pid: 8438 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.196879:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce14e00/0xb50e8258676147aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ca expref: 9 pid: 8438 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.196887:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.196889:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.196892:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.196898:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.196914:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126622.196922:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721440640:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126622.196949:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a82a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126622.196961:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 706 00000100:00100000:3.0:1746126622.196966:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721629312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.196973:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.196984:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2f800/0xb50e82586761481a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e602 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.196996:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.196999:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.197012:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721629312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 46us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.197017:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 706 00000100:00100000:2.0:1746126622.200097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.200271:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721629696 00000100:00100000:3.0:1746126622.200278:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721629696 00002000:00100000:3.0:1746126622.200311:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a448fb80 x1830945721629696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.200320:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448fb80 with x1830945721629696 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.200325:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448fb80 00000100:00100000:3.0:1746126622.200341:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7945 00000100:00100000:3.0:1746126622.200346:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721629696:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126622.202187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.202204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.202273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.202307:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721440384:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126622.202315:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721440512:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126622.202335:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3645440->3674111] (req 3645440->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 30 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.202347:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c79e00, rc 0) 00000100:00100000:1.0:1746126622.202379:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:31469:x1830945721629184:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6261us (6579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.202386:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13966 00000100:00100000:2.0:1746126622.202582:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721629952 00000100:00100000:2.0:1746126622.202587:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721629952 00002000:00100000:2.0:1746126622.202610:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (4038656->4042751) req@ffff88009b2fd880 x1830945721629952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.202617:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fd880 with x1830945721629952 ext(4038656->4042751) 00002000:00010000:2.0:1746126622.202622:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2fd880 00000100:00100000:2.0:1746126622.202634:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7946 00000100:00100000:2.0:1746126622.202639:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721629952:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126622.202746:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721629952:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 107us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126622.202751:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7946 00002000:00100000:2.0:1746126622.202756:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (4038656->4042751) req@ffff88009b2fd880 x1830945721629952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.202762:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fd880 with x1830945721629952 ext(4038656->4042751) 00002000:00010000:2.0:1746126622.202765:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2fd880 00000100:00100000:2.0:1746126622.202781:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721630080 00000100:00100000:2.0:1746126622.202783:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721630080 00010000:00010000:2.0:1746126622.202793:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 32 pid: 4640 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.202807:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721630208 00000100:00100000:2.0:1746126622.202808:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721630208 00010000:00010000:2.0:1746126622.202815:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 8 pid: 4641 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.202842:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7281 00000100:00100000:2.0:1746126622.202847:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1964:x1830945721630080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.202855:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.202867:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 32 pid: 4640 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.202880:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 32 pid: 4640 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.202897:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79c00/0xb50e825867614844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e62c expref: 32 pid: 4640 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.202905:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.202921:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1964:x1830945721630080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 74us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.202925:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7281 00000100:00100000:2.0:1746126622.202934:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7282 00000100:00100000:2.0:1746126622.202938:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721630208:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.202943:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.202949:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 8 pid: 4641 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.202956:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 8 pid: 4641 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.202966:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f75be00/0xb50e825867614795 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5c3 expref: 8 pid: 4641 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.202973:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.202975:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.202980:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.202986:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.203009:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.203018:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721440768:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.203064:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d0c8000 going to sleep for 11 seconds 00000001:00080000:2.0:1746126622.203319:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873274 is committed 00000001:00080000:2.0:1746126622.203338:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873262 is committed 00000001:00080000:2.0:1746126622.203356:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873238 is committed 00000001:00080000:2.0:1746126622.203370:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873264 is committed 00000001:00080000:2.0:1746126622.203387:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873265 is committed 00000100:00100000:0.0:1746126622.204259:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d919f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721440640:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126622.204272:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126622.204294:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721629440:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7478us (7681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.204300:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7280 00000100:00100000:2.0:1746126622.211298:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721440768:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.211315:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.211358:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721630208:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8417us (9083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.211366:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7282 00000100:00100000:0.0:1746126622.223204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.223226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.223252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.223276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.223524:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721630464 00000100:00100000:1.0:1746126622.223532:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721630464 00002000:00100000:1.0:1746126622.223565:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (4055040->4059135) req@ffff88008f255c00 x1830945721630464/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.223574:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f255c00 with x1830945721630464 ext(4055040->4059135) 00002000:00010000:1.0:1746126622.223579:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f255c00 00000100:00100000:1.0:1746126622.223593:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721630720 00000100:00100000:1.0:1746126622.223596:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721630720 00002000:00100000:1.0:1746126622.223606:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3645440->3649535) req@ffff88008f256a00 x1830945721630720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.223612:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256a00 with x1830945721630720 ext(3645440->3649535) 00002000:00010000:1.0:1746126622.223614:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256a00 00000100:00100000:1.0:1746126622.223622:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721630976 00000100:00100000:1.0:1746126622.223624:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721630976 00002000:00100000:1.0:1746126622.223634:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f254a80 x1830945721630976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.223640:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254a80 with x1830945721630976 ext(0->1048575) 00002000:00010000:1.0:1746126622.223642:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254a80 00000100:00100000:1.0:1746126622.223649:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721631232 00000100:00100000:1.0:1746126622.223650:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721631232 00002000:00100000:1.0:1746126622.223658:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008f255180 x1830945721631232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.223663:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f255180 with x1830945721631232 ext(1048576->2097151) 00002000:00010000:1.0:1746126622.223665:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f255180 00000100:00100000:1.0:1746126622.223675:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7947 00000100:00100000:1.0:1746126622.223680:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721630464:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126622.223814:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721630464:12345-192.168.203.2@tcp:3:cat.0 Request processed in 133us (616us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126622.223820:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7947 00002000:00100000:1.0:1746126622.223824:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (4055040->4059135) req@ffff88008f255c00 x1830945721630464/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.223848:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f255c00 with x1830945721630464 ext(4055040->4059135) 00002000:00010000:1.0:1746126622.223851:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f255c00 00000100:00100000:1.0:1746126622.223868:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7948 00000100:00100000:1.0:1746126622.223874:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721630720:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126622.223934:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721630720:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 59us (706us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126622.223938:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7948 00002000:00100000:1.0:1746126622.223942:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3645440->3649535) req@ffff88008f256a00 x1830945721630720/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.223947:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256a00 with x1830945721630720 ext(3645440->3649535) 00002000:00010000:1.0:1746126622.223949:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256a00 00000100:00100000:1.0:1746126622.223957:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7949 00000100:00100000:1.0:1746126622.223961:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721630976:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126622.226155:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7950 00000100:00100000:1.0:1746126622.226163:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721631232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.227704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.227754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.229318:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721631488 00000100:00100000:0.0:1746126622.229326:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721631488 00002000:00100000:0.0:1746126622.229355:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008f257100 x1830945721631488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.229363:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f257100 with x1830945721631488 ext(1048576->2097151) 00002000:00010000:0.0:1746126622.229368:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f257100 00000100:00100000:0.0:1746126622.229382:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721631744 00000100:00100000:0.0:1746126622.229384:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721631744 00002000:00100000:0.0:1746126622.229395:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008f256680 x1830945721631744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.229401:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256680 with x1830945721631744 ext(1048576->2097151) 00002000:00010000:0.0:1746126622.229403:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256680 00000100:00100000:0.0:1746126622.229412:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7951 00000100:00100000:0.0:1746126622.229417:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721631488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.230590:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7952 00000100:00100000:0.0:1746126622.230597:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1965:x1830945721631744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.236635:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721629696:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 36282us (36537us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126622.236645:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7945 00002000:00100000:0.0:1746126622.236653:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a448fb80 x1830945721629696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.236660:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448fb80 with x1830945721629696 ext(1048576->2097151) 00002000:00010000:0.0:1746126622.236666:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448fb80 00000100:00100000:0.0:1746126622.240775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.246786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.246811:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721632256 00000100:00100000:0.0:1746126622.246818:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721632256 00002000:00100000:0.0:1746126622.246862:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3670016->3674111) req@ffff88008f254000 x1830945721632256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.246870:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254000 with x1830945721632256 ext(3670016->3674111) 00002000:00010000:0.0:1746126622.246875:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254000 00000100:00100000:0.0:1746126622.246890:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7953 00000100:00100000:0.0:1746126622.246896:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721632256:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126622.247017:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721632256:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 121us (238us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126622.247023:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7953 00002000:00100000:0.0:1746126622.247038:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3670016->3674111) req@ffff88008f254000 x1830945721632256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.247043:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254000 with x1830945721632256 ext(3670016->3674111) 00002000:00010000:0.0:1746126622.247046:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254000 00000100:00100000:1.0:1746126622.248136:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1965:x1830945721630976:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24172us (24880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126622.248143:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7949 00002000:00100000:1.0:1746126622.248147:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f254a80 x1830945721630976/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.248154:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254a80 with x1830945721630976 ext(0->1048575) 00002000:00010000:1.0:1746126622.248158:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254a80 00000100:00100000:3.0:1746126622.248552:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721632000 00000100:00100000:3.0:1746126622.248557:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721632000 00000100:00100000:3.0:1746126622.248581:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3833 00000100:00100000:3.0:1746126622.248586:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31471:x1830945721632000:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126622.248722:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31471:x1830945721632000:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 135us (7953us total) trans 8589943217 rc 0/0 00000100:00100000:3.0:1746126622.248728:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3833 00000100:00100000:1.0:1746126622.260129:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721631232:12345-192.168.203.2@tcp:3:cat.0 Request processed in 33959us (36844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126622.260139:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7950 00002000:00100000:1.0:1746126622.260150:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008f255180 x1830945721631232/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.260159:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f255180 with x1830945721631232 ext(1048576->2097151) 00002000:00010000:1.0:1746126622.260164:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f255180 00000100:00100000:0.0:1746126622.260947:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721631488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31527us (33269us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126622.260954:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7951 00002000:00100000:0.0:1746126622.260960:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88008f257100 x1830945721631488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.260966:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f257100 with x1830945721631488 ext(1048576->2097151) 00002000:00010000:0.0:1746126622.260969:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f257100 00000100:00100000:0.0:1746126622.270136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.270208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.270229:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721632512 00000100:00100000:0.0:1746126622.270236:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721632512 00002000:00100000:0.0:1746126622.270265:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dad1f80 x1830945721632512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.270274:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1f80 with x1830945721632512 ext(2097152->3145727) 00002000:00010000:0.0:1746126622.270278:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dad1f80 00000100:00100000:0.0:1746126622.270292:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7954 00000100:00100000:0.0:1746126622.270298:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721632512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.271195:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1965:x1830945721631744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40597us (43439us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126622.271201:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7952 00002000:00100000:0.0:1746126622.271207:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88008f256680 x1830945721631744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.271213:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f256680 with x1830945721631744 ext(1048576->2097151) 00002000:00010000:0.0:1746126622.271217:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f256680 00000100:00100000:3.0:1746126622.277211:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721632768 00000100:00100000:3.0:1746126622.277221:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721632768 00000100:00100000:3.0:1746126622.277261:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3834 00000100:00100000:3.0:1746126622.277268:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31469:x1830945721632768:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126622.277420:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31469:x1830945721632768:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 153us (7212us total) trans 8589943218 rc 0/0 00000100:00100000:3.0:1746126622.277426:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3834 00000100:00100000:0.0:1746126622.280421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.282570:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721632896 00000100:00100000:1.0:1746126622.282578:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721632896 00000100:00100000:1.0:1746126622.282623:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13968 00000100:00100000:1.0:1746126622.282630:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:31474:x1830945721632896:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126622.282642:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.282656:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e641 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.282679:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 30 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.282686:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126622.282687:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126622.282690:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.282718:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 30 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.282729:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 30 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746126622.282740:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721440896:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126622.282811:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126622.291136:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721440896:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126622.291158:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 32 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.291172:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b22c200, rc 0) 00000100:00100000:1.0:1746126622.291216:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:31474:x1830945721632896:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8585us (10798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.291223:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13968 00000100:00100000:0.0:1746126622.292894:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721632512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22593us (22764us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126622.292903:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7954 00002000:00100000:0.0:1746126622.292911:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008dad1f80 x1830945721632512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.292918:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dad1f80 with x1830945721632512 ext(2097152->3145727) 00010000:00010000:0.0:1746126622.292925:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.292936:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746126622.292943:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dad1f80 00000100:00100000:0.0:1746126622.314353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.317689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.317721:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721633024 00000100:00100000:0.0:1746126622.317729:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721633024 00002000:00100000:0.0:1746126622.317763:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3645440->3674111) req@ffff88009e3f7480 x1830945721633024/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.317772:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7480 with x1830945721633024 ext(3645440->3674111) 00010000:00010000:0.0:1746126622.317781:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.317793:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 29 pid: 4640 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746126622.317800:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f7480 00000100:00100000:0.0:1746126622.317815:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1817 00000100:00100000:0.0:1746126622.317821:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721633024:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126622.318294:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721633152 00000100:00100000:1.0:1746126622.318298:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721633152 00000100:00100000:1.0:1746126622.319742:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13969 00000100:00100000:1.0:1746126622.319749:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:31466:x1830945721633152:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126622.319759:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.320749:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e648 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.320778:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 7 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.320785:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126622.320786:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126622.320789:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.320812:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 7 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.320822:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 7 pid: 17475 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.321507:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721633024:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3684us (7158us total) trans 21474840439 rc 0/0 00000100:00100000:0.0:1746126622.321516:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1817 00002000:00100000:0.0:1746126622.321523:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3645440->3674111) req@ffff88009e3f7480 x1830945721633024/t21474840439(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/448 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.321531:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7480 with x1830945721633024 ext(3645440->3674111) 00010000:00010000:0.0:1746126622.321537:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 31 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.321546:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 31 pid: 4640 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746126622.321552:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e3f7480 00000100:00100000:1.0:1746126622.324497:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721441024:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126622.324575:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.331226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.331284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.331306:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721633408 00000100:00100000:0.0:1746126622.331313:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721633408 00002000:00100000:0.0:1746126622.331352:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (4038656->4059135) req@ffff880092b14a80 x1830945721633408/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.331361:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14a80 with x1830945721633408 ext(4038656->4059135) 00010000:00010000:0.0:1746126622.331370:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 8 pid: 17475 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.331380:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 8 pid: 17475 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746126622.331391:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b14a80 00000100:00100000:0.0:1746126622.331408:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1818 00000100:00100000:0.0:1746126622.331415:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721633408:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126622.331636:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721441024:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126622.331654:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.331666:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b22d600, rc 0) 00000100:00100000:0.0:1746126622.331689:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:31466:x1830945721633152:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11940us (14006us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.331694:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13969 00000100:00100000:2.0:1746126622.332720:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721633280 00000100:00100000:2.0:1746126622.332725:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721633280 00010000:00010000:2.0:1746126622.332743:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 31 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.332764:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7283 00000100:00100000:2.0:1746126622.332768:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721633280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.332777:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.332790:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 31 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.332799:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 31 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.332813:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79e00/0xb50e82586761484b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->3674111) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e63a expref: 31 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.332821:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.332823:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.332839:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.332846:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.332866:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.332875:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721441152:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.332921:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d0c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.333666:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721633408:12345-192.168.203.2@tcp:4:cat.0 Request processed in 2250us (2380us total) trans 17179873293 rc 0/0 00000100:00100000:0.0:1746126622.333677:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1818 00002000:00100000:0.0:1746126622.333684:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (4038656->4059135) req@ffff880092b14a80 x1830945721633408/t17179873293(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/448 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.333691:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14a80 with x1830945721633408 ext(4038656->4059135) 00010000:00010000:0.0:1746126622.333697:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 10 pid: 17475 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.333707:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 10 pid: 17475 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746126622.333712:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b14a80 00000100:00100000:2.0:1746126622.336921:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721441152:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.336937:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.336971:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721633280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4200us (5749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.336979:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7283 00000100:00100000:0.0:1746126622.341540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.342266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.342286:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721633792 00000100:00100000:0.0:1746126622.342293:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721633792 00002000:00100000:0.0:1746126622.342325:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880092b16680 x1830945721633792/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.342334:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b16680 with x1830945721633792 ext(2097152->3145727) 00002000:00010000:0.0:1746126622.342339:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b16680 00000100:00100000:0.0:1746126622.342353:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7955 00000100:00100000:0.0:1746126622.342359:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1964:x1830945721633792:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126622.342985:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721633664 00000100:00100000:3.0:1746126622.342988:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721633664 00010000:00010000:3.0:1746126622.343005:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 10 pid: 17475 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746126622.343037:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7284 00000100:00100000:3.0:1746126622.343042:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721633664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.343049:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.343062:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 10 pid: 17475 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.343072:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 10 pid: 17475 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.343088:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c2f600/0xb50e825867614821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4038656->4059135) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e609 expref: 10 pid: 17475 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.343097:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.343098:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.343103:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.343110:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.343133:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126622.343142:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d918700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721441280:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126622.343203:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126622.346414:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d918700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721441280:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126622.346429:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.346471:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721633664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3427us (4934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.346479:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7284 00000100:00100000:1.0:1746126622.350004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.352479:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721634048 00000100:00100000:0.0:1746126622.352488:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721634048 00002000:00100000:0.0:1746126622.352522:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009b2ff100 x1830945721634048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.352538:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff100 with x1830945721634048 ext(2097152->3145727) 00002000:00010000:0.0:1746126622.352543:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2ff100 00000100:00100000:0.0:1746126622.352572:0:21462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7956 00000100:00100000:0.0:1746126622.352579:0:21462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721634048:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.367614:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1964:x1830945721633792:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25245us (25338us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126622.367625:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7955 00002000:00100000:0.0:1746126622.367635:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880092b16680 x1830945721633792/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.367644:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b16680 with x1830945721633792 ext(2097152->3145727) 00002000:00010000:0.0:1746126622.367650:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b16680 00000100:00100000:1.0:1746126622.367727:0:21462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721634048:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15147us (17726us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126622.367734:0:21462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7956 00002000:00100000:1.0:1746126622.367740:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009b2ff100 x1830945721634048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.367746:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2ff100 with x1830945721634048 ext(2097152->3145727) 00002000:00010000:1.0:1746126622.367749:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2ff100 00000100:00100000:1.0:1746126622.382363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.382442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.382578:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721634176 00000100:00100000:0.0:1746126622.382585:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721634176 00000100:00100000:0.0:1746126622.382612:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721634304 00000100:00100000:0.0:1746126622.382615:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721634304 00000100:00100000:0.0:1746126622.382628:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13970 00000100:00100000:0.0:1746126622.382634:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31474:x1830945721634176:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.382648:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.382662:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e64f expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.382682:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.382684:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.382690:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.382706:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.382716:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fde00, rc 0) 00000100:00100000:0.0:1746126622.382784:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31474:x1830945721634176:12345-192.168.203.2@tcp:101:cat.0 Request processed in 150us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.382790:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13970 00000100:00100000:0.0:1746126622.382805:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13971 00000100:00100000:0.0:1746126622.382809:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:31466:x1830945721634304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.382815:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.382823:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e656 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.382850:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.382851:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.382855:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.382863:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 31 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.382870:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921fc800, rc 0) 00000100:00100000:0.0:1746126622.382887:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:31466:x1830945721634304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 77us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.382892:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13971 00000100:00100000:3.0:1746126622.394711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.394963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.394975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.395245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.395361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.395397:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721634688 00000100:00100000:1.0:1746126622.395405:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721634688 00002000:00100000:1.0:1746126622.395438:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d918700 x1830945721634688/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.395447:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918700 with x1830945721634688 ext(3145728->4194303) 00002000:00010000:1.0:1746126622.395452:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d918700 00000100:00100000:1.0:1746126622.395465:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721634816 00000100:00100000:1.0:1746126622.395467:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721634816 00002000:00100000:1.0:1746126622.395477:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d91ad80 x1830945721634816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.395482:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91ad80 with x1830945721634816 ext(3145728->4194303) 00002000:00010000:1.0:1746126622.395484:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91ad80 00000100:00100000:1.0:1746126622.395490:0:21462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721635072 00000100:00100000:1.0:1746126622.395492:0:21462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721635072 00002000:00100000:1.0:1746126622.395500:0:21462:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012d91a680 x1830945721635072/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.395505:0:21462:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a680 with x1830945721635072 ext(2097152->3145727) 00002000:00010000:1.0:1746126622.395507:0:21462:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91a680 00000100:00100000:0.0:1746126622.395644:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721635328 00000100:00100000:0.0:1746126622.395648:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721635328 00002000:00100000:0.0:1746126622.395662:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d919f80 x1830945721635328/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.395668:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919f80 with x1830945721635328 ext(3145728->4194303) 00002000:00010000:0.0:1746126622.395671:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d919f80 00000100:00100000:0.0:1746126622.395680:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721635584 00000100:00100000:0.0:1746126622.395682:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721635584 00002000:00100000:0.0:1746126622.395691:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012ddac000 x1830945721635584/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126622.395696:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac000 with x1830945721635584 ext(3145728->4194303) 00002000:00010000:0.0:1746126622.395698:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac000 00000100:00100000:0.0:1746126622.395708:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7957 00000100:00100000:0.0:1746126622.395714:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721634688:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126622.399238:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7958 00000100:00100000:2.0:1746126622.399253:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7959 00000100:00100000:2.0:1746126622.399261:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721635072:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126622.399860:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7960 00000100:00100000:2.0:1746126622.399867:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721635328:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126622.401274:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7961 00000100:00100000:3.0:1746126622.401283:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1966:x1830945721635584:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126622.402596:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721634816:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126622.412976:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721634688:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17254us (18262us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126622.412985:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7957 00002000:00100000:1.0:1746126622.412995:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d918700 x1830945721634688/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.413003:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918700 with x1830945721634688 ext(3145728->4194303) 00002000:00010000:1.0:1746126622.413007:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d918700 00000001:00080000:3.0:1746126622.420335:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840436 is committed 00000001:00080000:3.0:1746126622.420663:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840411 is committed 00000001:00080000:3.0:1746126622.420670:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840410 is committed 00000001:00080000:3.0:1746126622.420699:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840438 is committed 00000001:00080000:3.0:1746126622.420752:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840414 is committed 00000001:00080000:3.0:1746126622.420760:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840413 is committed 00000100:00100000:3.0:1746126622.424708:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721635328:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24829us (29451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.424719:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7960 00002000:00100000:3.0:1746126622.424729:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88012d919f80 x1830945721635328/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.424737:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919f80 with x1830945721635328 ext(3145728->4194303) 00002000:00010000:3.0:1746126622.424743:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d919f80 00000100:00100000:0.0:1746126622.432884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.433442:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721635072:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34181us (38462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126622.433450:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7959 00002000:00100000:2.0:1746126622.433458:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88012d91a680 x1830945721635072/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.433466:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a680 with x1830945721635072 ext(2097152->3145727) 00002000:00010000:2.0:1746126622.433471:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91a680 00000100:00100000:3.0:1746126622.433524:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721635840 00000100:00100000:3.0:1746126622.433530:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721635840 00000100:00100000:3.0:1746126622.433555:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9034 00000100:00100000:3.0:1746126622.433561:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b19050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+223:31479:x1830945721635840:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126622.433574:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.433588:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e65d expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.433659:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433668:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433675:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433684:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433689:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433693:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433890:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433897:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433902:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126622.433909:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126622.433965:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433971:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433975:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433980:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.433983:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433988:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.433996:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.433998:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126622.434001:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434005:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649a00/0xb50e82586761488a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434038:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434042:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434046:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434050:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135648600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.434053:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434057:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434063:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126622.434065:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.434066:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434070:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648600/0xb50e82586761487c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434076:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434079:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434084:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434087:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135648400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.434089:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434093:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434097:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1400) 00010000:00010000:3.0:1746126622.434099:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.434101:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434104:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648400/0xb50e825867614883 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.434131:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614875 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e65d expref: 225 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.434138:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e65d expref: 225 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.434149:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135648800, rc 0) 00000100:00100000:3.0:1746126622.435304:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b19050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+224:31479:x1830945721635840:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 611us (1296us total) trans 8589943219 rc 301/301 00000100:00100000:3.0:1746126622.435314:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9034 00000100:00100000:3.0:1746126622.440118:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721635584:12345-192.168.203.2@tcp:3:cat.0 Request processed in 38828us (44747us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.440129:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7961 00002000:00100000:3.0:1746126622.440139:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012ddac000 x1830945721635584/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.440153:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddac000 with x1830945721635584 ext(3145728->4194303) 00002000:00010000:3.0:1746126622.440158:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ddac000 00000100:00100000:3.0:1746126622.442277:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721634816:12345-192.168.203.2@tcp:3:cat.0 Request processed in 43025us (47308us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.442286:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7958 00002000:00100000:3.0:1746126622.442294:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d91ad80 x1830945721634816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.442302:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91ad80 with x1830945721634816 ext(3145728->4194303) 00002000:00010000:3.0:1746126622.442306:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91ad80 00000100:00100000:0.0:1746126622.457496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.457563:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721635968 00000100:00100000:1.0:1746126622.457571:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721635968 00000100:00100000:1.0:1746126622.458466:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13972 00000100:00100000:1.0:1746126622.458475:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721635968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126622.458489:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.458502:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e664 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.458521:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.458529:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.458536:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.458550:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.458558:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b22dc00, rc 0) 00000100:00100000:1.0:1746126622.458613:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721635968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 139us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.458619:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13972 00000100:00100000:0.0:1746126622.459393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.459460:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721636224 00000100:00100000:3.0:1746126622.459465:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721636224 00002000:00100000:3.0:1746126622.459492:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092b16a00 x1830945721636224/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.459499:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b16a00 with x1830945721636224 ext(4194304->4976639) 00002000:00010000:3.0:1746126622.459503:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b16a00 00000100:00100000:3.0:1746126622.459516:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7962 00000100:00100000:3.0:1746126622.459521:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721636224:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.473373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.473434:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721636480 00000100:00100000:2.0:1746126622.473442:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721636480 00002000:00100000:2.0:1746126622.473475:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092b14000 x1830945721636480/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.473484:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14000 with x1830945721636480 ext(4194304->4976639) 00002000:00010000:2.0:1746126622.473488:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b14000 00000100:00100000:2.0:1746126622.474239:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7963 00000100:00100000:2.0:1746126622.474250:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721636480:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126622.476168:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721636224:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16639us (16769us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126622.476177:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7962 00002000:00100000:3.0:1746126622.476184:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092b16a00 x1830945721636224/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.476192:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b16a00 with x1830945721636224 ext(4194304->4976639) 00002000:00010000:3.0:1746126622.476199:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b16a00 00000100:00100000:0.0:1746126622.485554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.485692:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721636608 00000100:00100000:2.0:1746126622.485701:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721636608 00000100:00100000:2.0:1746126622.485735:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 230 00000100:00100000:2.0:1746126622.485741:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1965:x1830945721636608:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1746126622.485802:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1965:x1830945721636608:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.485808:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 230 00000100:00100000:3.0:1746126622.486154:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721636480:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11905us (12787us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126622.486162:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7963 00002000:00100000:3.0:1746126622.486170:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880092b14000 x1830945721636480/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.486179:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b14000 with x1830945721636480 ext(4194304->4976639) 00002000:00010000:3.0:1746126622.486184:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b14000 00000100:00100000:0.0:1746126622.499817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.500058:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721636864 00000100:00100000:3.0:1746126622.500066:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721636864 00000100:00100000:3.0:1746126622.500812:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9035 00000100:00100000:3.0:1746126622.500820:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31481:x1830945721636864:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126622.500864:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.500880:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e82586761489f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e66b expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.501030:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501041:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501050:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501061:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501065:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501070:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501148:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501155:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501160:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126622.501167:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126622.501225:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501231:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501235:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501240:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135648c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.501242:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501247:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501255:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.501258:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126622.501261:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501268:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148b4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501285:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501289:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501292:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501296:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.501298:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501301:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501306:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126622.501308:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.501310:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501314:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501320:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501324:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501327:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501331:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.501332:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501335:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501339:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1d00) 00010000:00010000:3.0:1746126622.501341:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.501342:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.501345:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.504139:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e82586761489f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e66b expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.504150:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e82586761489f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e66b expref: 14 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.504158:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135649800, rc 0) 00000100:00100000:3.0:1746126622.504221:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31481:x1830945721636864:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 3401us (4410us total) trans 8589943220 rc 301/301 00000100:00100000:3.0:1746126622.504228:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9035 00000100:00100000:0.0:1746126622.525548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.525617:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721636992 00000100:00100000:2.0:1746126622.525625:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721636992 00000100:00100000:2.0:1746126622.525673:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13973 00000100:00100000:2.0:1746126622.525680:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31481:x1830945721636992:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126622.525695:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.525709:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e672 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.525737:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.525744:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.525751:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.525757:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.525758:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.525762:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.525786:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.525796:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 9 pid: 8436 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.525806:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721441408:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.525934:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.525942:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 15 pid: 8436 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.525949:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721441536:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.525972:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 6 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.525979:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 6 pid: 10890 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.525985:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721441664:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.526000:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126622.538434:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721441408:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126622.540748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.541129:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721637120 00000100:00100000:3.0:1746126622.541136:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721637120 00010000:00010000:3.0:1746126622.541163:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 10 pid: 8436 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.541422:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721441536:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.541434:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721441664:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.541460:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 10 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.541472:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ead0a00, rc 0) 00000100:00100000:2.0:1746126622.541508:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31481:x1830945721636992:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15828us (15966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.541514:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13973 00000100:00100000:0.0:1746126622.541636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.541807:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721637376 00000100:00100000:3.0:1746126622.541811:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721637376 00010000:00010000:3.0:1746126622.541823:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 7 pid: 10890 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746126622.541859:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7285 00000100:00100000:3.0:1746126622.541865:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721637120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.541874:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.541891:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 9 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.541900:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 9 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.541917:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614828 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e610 expref: 9 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.541931:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.541949:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721637120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.541954:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7285 00000100:00100000:3.0:1746126622.541966:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7286 00000100:00100000:3.0:1746126622.541970:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721637376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.541976:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.541983:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 7 pid: 10890 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.541991:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 7 pid: 10890 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.542001:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a03a00/0xb50e825867614787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5a7 expref: 7 pid: 10890 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.542008:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.542021:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721637376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 50us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.542037:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7286 00000100:00100000:0.0:1746126622.542202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.542457:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721637248 00000100:00100000:2.0:1746126622.542461:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721637248 00010000:00010000:2.0:1746126622.542474:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 16 pid: 8436 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.542489:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7287 00000100:00100000:2.0:1746126622.542493:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721637248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.542499:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.542507:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 16 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.542515:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 16 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.542526:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b22dc00/0xb50e825867614898 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e664 expref: 16 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.542540:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.542542:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.542547:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.542554:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.542581:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.542592:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721441792:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.542637:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126622.552662:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721441792:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.552679:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.552730:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+15:1966:x1830945721637248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10234us (10526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.552738:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7287 00000100:00100000:1.0:1746126622.552900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.553889:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721637632 00000100:00100000:2.0:1746126622.553896:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721637632 00002000:00100000:2.0:1746126622.553928:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (729088->733183) req@ffff88009b2fc380 x1830945721637632/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.553935:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fc380 with x1830945721637632 ext(729088->733183) 00002000:00010000:2.0:1746126622.553939:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fc380 00000100:00100000:2.0:1746126622.553954:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7964 00000100:00100000:2.0:1746126622.553960:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721637632:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126622.554124:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721637632:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 163us (1224us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126622.554129:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7964 00002000:00100000:2.0:1746126622.554133:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (729088->733183) req@ffff88009b2fc380 x1830945721637632/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.554140:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2fc380 with x1830945721637632 ext(729088->733183) 00002000:00010000:2.0:1746126622.554142:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2fc380 00000100:00100000:0.0:1746126622.559862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.563075:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721637888 00000100:00100000:3.0:1746126622.563085:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721637888 00000100:00100000:3.0:1746126622.563137:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3835 00000100:00100000:3.0:1746126622.563143:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31481:x1830945721637888:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126622.563400:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31481:x1830945721637888:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 256us (3579us total) trans 8589943221 rc 0/0 00000100:00100000:3.0:1746126622.563407:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3835 00000100:00100000:0.0:1746126622.606667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.607513:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721638016 00000100:00100000:2.0:1746126622.607521:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721638016 00000100:00100000:2.0:1746126622.607565:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13974 00000100:00100000:2.0:1746126622.607571:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:31479:x1830945721638016:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126622.607584:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.607598:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e679 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.607623:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.607631:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.607637:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.607642:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.607644:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.607646:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1359872->2068479] (req 1359872->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.607668:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.607676:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 7 pid: 8438 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.607687:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721441920:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.607780:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.607787:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 9 pid: 8436 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.607794:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721442048:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.607817:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.607824:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.607844:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721442176:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.607868:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126622.610222:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721441920:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.610232:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721442048:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.610239:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721442176:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.610260:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [1359872->2068479] (req 1359872->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.610273:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9ec00, rc 0) 00000100:00100000:2.0:1746126622.610305:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:31479:x1830945721638016:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2733us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.610313:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13974 00000100:00100000:0.0:1746126622.613803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.614690:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721638144 00000100:00100000:2.0:1746126622.614698:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721638144 00010000:00010000:2.0:1746126622.614726:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 8 pid: 8438 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746126622.614763:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7288 00000100:00100000:2.0:1746126622.614770:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721638144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.614783:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.614801:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 8 pid: 8438 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.614811:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 8 pid: 8438 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746126622.614843:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce15c00/0xb50e82586761479c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5ae expref: 8 pid: 8438 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746126622.615103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.615152:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721638272 00000100:00100000:3.0:1746126622.615156:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721638272 00010000:00010000:3.0:1746126622.615168:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 10 pid: 8436 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746126622.615189:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7289 00000100:00100000:3.0:1746126622.615193:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721638272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.615198:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.615206:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 10 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.615212:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 10 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.615221:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099213600/0xb50e82586761482f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e617 expref: 10 pid: 8436 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746126622.615232:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.615262:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721638272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.615266:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7289 00010000:00010000:2.0:1746126622.615402:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.615431:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721638144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 662us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.615437:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7288 00000100:00100000:0.0:1746126622.617641:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.617692:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721638400 00000100:00100000:2.0:1746126622.617698:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721638400 00010000:00010000:2.0:1746126622.617720:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.617753:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7290 00000100:00100000:2.0:1746126622.617759:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721638400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.617768:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.617782:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.617790:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.617804:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b390e00/0xb50e825867614710 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e56f expref: 21 pid: 8436 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.617814:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.617816:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.617820:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.617982:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.618009:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.618019:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721442304:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.619217:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.622514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.622741:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721442304:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.622756:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.622796:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721638400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5036us (5158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.622804:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7290 00000100:00100000:3.0:1746126622.623144:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721638656 00000100:00100000:3.0:1746126622.623151:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721638656 00002000:00100000:3.0:1746126622.623184:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1359872->1363967) req@ffff880091da3100 x1830945721638656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.623192:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3100 with x1830945721638656 ext(1359872->1363967) 00002000:00010000:3.0:1746126622.623196:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da3100 00000100:00100000:3.0:1746126622.623220:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7965 00000100:00100000:3.0:1746126622.623226:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721638656:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126622.623383:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721638656:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 156us (875us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126622.623388:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7965 00002000:00100000:3.0:1746126622.623392:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x322:0x0] (1359872->1363967) req@ffff880091da3100 x1830945721638656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.623404:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3100 with x1830945721638656 ext(1359872->1363967) 00002000:00010000:3.0:1746126622.623407:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da3100 00000100:00100000:0.0:1746126622.640470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.640621:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721638912 00000100:00100000:2.0:1746126622.640629:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721638912 00002000:00100000:2.0:1746126622.640663:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (2064384->2068479) req@ffff880091da2d80 x1830945721638912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.640672:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da2d80 with x1830945721638912 ext(2064384->2068479) 00002000:00010000:2.0:1746126622.640676:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da2d80 00000100:00100000:2.0:1746126622.640709:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7966 00000100:00100000:2.0:1746126622.640716:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721638912:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126622.640919:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721638912:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 203us (455us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126622.640929:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7966 00002000:00100000:2.0:1746126622.640934:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (2064384->2068479) req@ffff880091da2d80 x1830945721638912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.640942:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da2d80 with x1830945721638912 ext(2064384->2068479) 00002000:00010000:2.0:1746126622.640944:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da2d80 00000100:00100000:0.0:1746126622.643621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.643697:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721639168 00000100:00100000:2.0:1746126622.643703:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721639168 00000100:00100000:2.0:1746126622.643798:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3836 00000100:00100000:2.0:1746126622.643805:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31479:x1830945721639168:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126622.644546:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+225:31479:x1830945721639168:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 739us (929us total) trans 8589943222 rc 0/0 00000100:00100000:2.0:1746126622.644552:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3836 00000100:00100000:0.0:1746126622.726588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.726683:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721639424 00000100:00100000:3.0:1746126622.726692:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721639424 00000100:00100000:3.0:1746126622.726739:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9036 00000100:00100000:3.0:1746126622.726745:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+225:31489:x1830945721639424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.726764:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.726780:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649400/0xb50e8258676148d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e680 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.726884:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.726894:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.726902:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.726911:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.726915:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.726919:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727003:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727013:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727018:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126622.727314:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126622.727380:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727386:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727395:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727399:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.727402:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727410:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727419:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.727421:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126622.727424:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727429:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649c00/0xb50e8258676148e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727457:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727465:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727469:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727473:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.727478:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727483:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727488:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126622.727492:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.727494:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727498:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649800/0xb50e8258676148d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727504:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727510:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727514:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727518:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.727520:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727527:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727532:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1f00) 00010000:00010000:3.0:1746126622.727534:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.727535:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727539:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649600/0xb50e8258676148de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.727568:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649400/0xb50e8258676148d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e680 expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.727574:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649400/0xb50e8258676148d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e680 expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.727581:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135649400, rc 0) 00000100:00100000:3.0:1746126622.727618:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+226:31489:x1830945721639424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 873us (1038us total) trans 8589943223 rc 301/301 00000100:00100000:3.0:1746126622.727623:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9036 00000100:00100000:0.0:1746126622.731074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.731234:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721639680 00000100:00100000:2.0:1746126622.731241:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721639680 00000100:00100000:2.0:1746126622.731273:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3837 00000100:00100000:2.0:1746126622.731279:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31489:x1830945721639680:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126622.732123:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+227:31489:x1830945721639680:12345-192.168.203.2@tcp:35:cat.0 Request processed in 842us (1054us total) trans 8589943224 rc 0/0 00000100:00100000:2.0:1746126622.732130:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3837 00000100:00100000:0.0:1746126622.733528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.733734:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721639808 00000100:00100000:3.0:1746126622.733740:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721639808 00000100:00100000:3.0:1746126622.733784:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9037 00000100:00100000:3.0:1746126622.733790:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+227:31489:x1830945721639808:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.733807:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.733822:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e687 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.733925:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.733937:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.733944:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126622.733966:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126622.733969:0:15560:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126622.733980:0:15560:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.734000:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648c00/0xb50e8258676148f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 229 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.734036:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 228 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.734042:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.734045:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126622.734048:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135648a00, rc 0) 00000100:00100000:3.0:1746126622.734083:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+228:31489:x1830945721639808:12345-192.168.203.2@tcp:101:cat.0 Request processed in 294us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.734089:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9037 00000100:00100000:0.0:1746126622.736753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.736975:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721639936 00000100:00100000:2.0:1746126622.736982:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721639936 00000100:00100000:2.0:1746126622.737034:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13975 00000100:00100000:2.0:1746126622.737040:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721639936:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126622.737055:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.737067:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a9fe00/0xb50e825867614901 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e68e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.737105:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721442432:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126622.737184:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edb40 going to sleep for 11 seconds 00002000:00010000:2.0:1746126622.743752:0:10890:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126621 -> 1746126622 00002000:00010000:2.0:1746126622.743758:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126621 -> 1746126622 00002000:00010000:2.0:1746126622.743760:0:10890:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126621 -> 1746126622 00000100:00100000:2.0:1746126622.743781:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721442432:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126622.743806:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a9fe00/0xb50e825867614901 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e68e expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.743817:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a9fe00/0xb50e825867614901 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e68e expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126622.743864:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9fe00, rc 0) 00000100:00100000:2.0:1746126622.743915:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721639936:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6874us (7168us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126622.743923:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13975 00000100:00100000:0.0:1746126622.746892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.746983:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721640064 00000100:00100000:2.0:1746126622.746990:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721640064 00000100:00100000:2.0:1746126622.747129:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13976 00000100:00100000:2.0:1746126622.747136:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:31489:x1830945721640064:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126622.747149:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.747162:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e695 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.747188:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.747194:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126622.747196:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126622.747199:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 16 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.747226:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.747236:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 7 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.747246:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721442560:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126622.747326:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.748660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.748743:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721640320 00000100:00100000:2.0:1746126622.748748:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721640320 00000100:00100000:2.0:1746126622.748787:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9038 00000100:00100000:2.0:1746126622.748793:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31491:x1830945721640320:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126622.748808:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.748821:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e200/0xb50e82586761490f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e69c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.748930:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.748942:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.748950:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.748961:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.748966:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.748971:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749067:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749075:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749081:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126622.749094:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126622.749154:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749160:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749164:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749172:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ead1600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.749175:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749181:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749194:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.749197:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126622.749199:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749204:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614924 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749216:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749221:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749225:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749229:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a9e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.749231:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749234:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749239:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126622.749241:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126622.749244:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749247:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e000/0xb50e825867614916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749253:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749257:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749261:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749264:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ead0800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.749266:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749270:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749275:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe900) 00010000:00010000:2.0:1746126622.749277:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126622.749278:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749283:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761491d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.749309:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e200/0xb50e82586761490f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e69c expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.749315:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a9e200/0xb50e82586761490f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e69c expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.749327:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9e200, rc 0) 00000100:00100000:2.0:1746126622.749378:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31491:x1830945721640320:12345-192.168.203.2@tcp:101:cat.0 Request processed in 584us (718us total) trans 8589943225 rc 301/301 00000100:00100000:2.0:1746126622.749384:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9038 00000100:00100000:2.0:1746126622.750246:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721442560:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.750265:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 16 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.750276:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a9fc00, rc 0) 00000100:00100000:2.0:1746126622.750309:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:31489:x1830945721640064:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3173us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.750315:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13976 00000100:00100000:0.0:1746126622.750558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.751536:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721640448 00000100:00100000:3.0:1746126622.751542:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721640448 00002000:00100000:3.0:1746126622.751572:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (729088->733183) req@ffff880091da0700 x1830945721640448/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 4584/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.751584:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da0700 with x1830945721640448 ext(729088->733183) 00010000:00010000:3.0:1746126622.751590:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 8 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.751600:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 8 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.751606:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da0700 00000100:00100000:3.0:1746126622.751631:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1819 00000100:00100000:3.0:1746126622.751638:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721640448:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126622.752033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.752087:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721640704 00000100:00100000:2.0:1746126622.752090:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721640704 00000100:00100000:2.0:1746126622.752113:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3838 00000100:00100000:2.0:1746126622.752117:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31491:x1830945721640704:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126622.752231:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31491:x1830945721640704:12345-192.168.203.2@tcp:35:cat.0 Request processed in 113us (208us total) trans 8589943226 rc 0/0 00000100:00100000:2.0:1746126622.752236:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3838 00000100:00100000:3.0:1746126622.755354:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721640448:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 3709us (4790us total) trans 21474840440 rc 0/0 00000100:00100000:3.0:1746126622.755363:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1819 00002000:00100000:3.0:1746126622.755370:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x31d:0x0] (729088->733183) req@ffff880091da0700 x1830945721640448/t21474840440(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 4584/448 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.755378:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da0700 with x1830945721640448 ext(729088->733183) 00010000:00010000:3.0:1746126622.755386:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 10 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.755398:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 10 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.755404:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091da0700 00000100:00100000:0.0:1746126622.760545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.761218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.761788:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721640832 00000100:00100000:2.0:1746126622.761795:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721640832 00000100:00100000:2.0:1746126622.761926:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13977 00000100:00100000:2.0:1746126622.761932:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721640832:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126622.761947:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.761960:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ead0600/0xb50e825867614932 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6a3 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.762002:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721442688:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126622.762072:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126622.763437:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721640960 00000100:00100000:3.0:1746126622.763444:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721640960 00010000:00010000:3.0:1746126622.763464:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 12 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746126622.763481:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7291 00000100:00100000:3.0:1746126622.763486:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721640960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.763494:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126622.763509:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 12 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.763518:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 12 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.763533:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.763534:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.763539:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 15 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.763545:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 15 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.763564:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 15 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126622.763571:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721442816:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126622.763839:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126622.763977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.764340:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721641088 00000100:00100000:0.0:1746126622.764345:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721641088 00000100:00100000:0.0:1746126622.764364:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13978 00000100:00100000:0.0:1746126622.764368:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721641088:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.764378:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.764388:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbcba00/0xb50e825867614939 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6aa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126622.764416:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721442944:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126622.764443:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaeb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746126622.766215:0:10890:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff8800a448ca80 x1830945721442688) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 12 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.766246:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ead0a00/0xb50e8258676148c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 729088->733183) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e672 expref: 12 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.766261:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721442688:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126622.766324:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721442816:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126622.766335:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126622.766359:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1963:x1830945721640960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2872us (5140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.766367:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7291 00010000:00010000:0.0:1746126622.766520:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ead0600/0xb50e825867614932 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6a3 expref: 11 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.766532:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ead0600/0xb50e825867614932 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6a3 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126622.766539:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ead0600, rc 0) 00000100:00100000:0.0:1746126622.766556:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721640832:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4625us (6020us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126622.766561:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13977 00002000:00010000:1.0:1746126622.766813:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126621 -> 1746126622 00002000:00010000:1.0:1746126622.766816:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126621 -> 1746126622 00002000:00010000:1.0:1746126622.766818:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126620 -> 1746126622 00000100:00100000:1.0:1746126622.766844:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721442944:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126622.766858:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbcba00/0xb50e825867614939 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6aa expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.766866:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbcba00/0xb50e825867614939 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6aa expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126622.766884:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbcba00, rc 0) 00000100:00100000:1.0:1746126622.766902:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721641088:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2534us (2925us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126622.766907:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13978 00000100:00100000:0.0:1746126622.776635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.776719:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721641216 00000100:00100000:1.0:1746126622.776725:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721641216 00000100:00100000:1.0:1746126622.776760:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13979 00000100:00100000:1.0:1746126622.776765:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31491:x1830945721641216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126622.776780:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126622.776793:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6b1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.776813:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.776815:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.776820:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.776851:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.776859:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cc2800, rc 0) 00000100:00100000:1.0:1746126622.776905:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31491:x1830945721641216:12345-192.168.203.2@tcp:101:cat.0 Request processed in 140us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.776913:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13979 00000100:00100000:0.0:1746126622.780386:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.780424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.781359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.781394:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721641472 00000100:00100000:2.0:1746126622.781402:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721641472 00002000:00100000:2.0:1746126622.781439:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880091da1f80 x1830945721641472/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.781448:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1f80 with x1830945721641472 ext(0->1048575) 00002000:00010000:2.0:1746126622.781453:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091da1f80 00000100:00100000:2.0:1746126622.781476:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721641728 00000100:00100000:2.0:1746126622.781478:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721641728 00002000:00100000:2.0:1746126622.781490:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880091da0e00 x1830945721641728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 504/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.781496:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da0e00 with x1830945721641728 ext(1048576->2097151) 00002000:00010000:2.0:1746126622.781499:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da0e00 00000100:00100000:2.0:1746126622.781516:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7967 00000100:00100000:2.0:1746126622.781521:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721641472:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126622.783365:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7968 00000100:00100000:1.0:1746126622.783376:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721641728:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.786453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.786535:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721641984 00000100:00100000:3.0:1746126622.786543:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721641984 00002000:00100000:3.0:1746126622.786571:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009bb2ea00 x1830945721641984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.786579:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ea00 with x1830945721641984 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.786583:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ea00 00000100:00100000:3.0:1746126622.786597:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721642240 00000100:00100000:3.0:1746126622.786599:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721642240 00002000:00100000:3.0:1746126622.786608:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009bb2f100 x1830945721642240/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.786613:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830945721642240 ext(0->1048575) 00002000:00010000:3.0:1746126622.786615:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f100 00000100:00100000:3.0:1746126622.786624:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7969 00000100:00100000:3.0:1746126622.786628:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721641984:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126622.788743:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7970 00000100:00100000:3.0:1746126622.788752:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721642240:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126622.809075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.810187:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721641728:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26811us (29760us total) trans 0 rc 339968/339968 00000100:00100000:2.0:1746126622.810196:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7968 00002000:00100000:2.0:1746126622.810206:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880091da0e00 x1830945721641728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 504/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 339968/339968 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.810213:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da0e00 with x1830945721641728 ext(1048576->2097151) 00002000:00010000:2.0:1746126622.810219:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da0e00 00000100:00100000:3.0:1746126622.816341:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721642496 00000100:00100000:3.0:1746126622.816351:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721642496 00000100:00100000:3.0:1746126622.816398:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9039 00000100:00100000:3.0:1746126622.816405:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+228:31493:x1830945721642496:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126622.816419:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.816434:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649400/0xb50e825867614947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6b8 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.816510:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816520:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816529:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816538:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816543:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816548:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816618:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816624:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816629:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126622.816635:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126622.816687:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816692:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816698:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816703:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921fc000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.816705:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816710:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816718:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126622.816720:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126622.816723:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816727:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921fc000/0xb50e82586761495c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816741:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816745:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816749:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816752:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.816754:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816758:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816766:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126622.816768:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.816770:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816774:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649000/0xb50e82586761494e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816778:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816782:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816786:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816789:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135648800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126622.816791:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816795:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816800:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1600) 00010000:00010000:3.0:1746126622.816801:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126622.816803:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816806:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648800/0xb50e825867614955 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126622.816855:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135649400/0xb50e825867614947 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b8 expref: 230 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.816861:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135649400/0xb50e825867614947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b8 expref: 230 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.816867:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135649400, rc 0) 00000100:00100000:3.0:1746126622.816909:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:31493:x1830945721642496:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 505us (7841us total) trans 8589943227 rc 301/301 00000100:00100000:3.0:1746126622.816915:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9039 00000100:00100000:1.0:1746126622.840403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.840475:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721642752 00000100:00100000:2.0:1746126622.840483:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721642752 00000100:00100000:2.0:1746126622.841777:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9040 00000100:00100000:2.0:1746126622.841786:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31495:x1830945721642752:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126622.841805:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126622.841819:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009397b400/0xb50e82586761496a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6bf expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.841913:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.841924:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.841933:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.841943:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.841948:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.841953:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842044:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842052:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842062:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126622.842068:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126622.842130:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842136:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842141:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842145:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ead0800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.842148:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842153:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842162:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126622.842164:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126622.842167:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.842171:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0800/0xb50e82586761497f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845097:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845110:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845120:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845125:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ead0e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.845128:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845134:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845146:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126622.845148:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126622.845151:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845156:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead0e00/0xb50e825867614971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845167:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845171:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845176:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845180:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ead1600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126622.845182:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845187:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845196:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fed00) 00010000:00010000:2.0:1746126622.845198:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126622.845200:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845205:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ead1600/0xb50e825867614978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126622.845243:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009397b400/0xb50e82586761496a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6bf expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.845251:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009397b400/0xb50e82586761496a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6bf expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.845259:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009397b400, rc 0) 00000100:00100000:2.0:1746126622.846988:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31495:x1830945721642752:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5199us (6587us total) trans 8589943228 rc 301/301 00000100:00100000:2.0:1746126622.846996:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9040 00000100:00100000:1.0:1746126622.848930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.849178:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721642240:12345-192.168.203.2@tcp:3:cat.0 Request processed in 60427us (62731us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126622.849187:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7970 00002000:00100000:1.0:1746126622.849195:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009bb2f100 x1830945721642240/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.849203:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830945721642240 ext(0->1048575) 00002000:00010000:1.0:1746126622.849208:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f100 00000100:00100000:0.0:1746126622.849421:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721642880 00000100:00100000:0.0:1746126622.849427:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721642880 00000100:00100000:0.0:1746126622.849467:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13980 00000100:00100000:0.0:1746126622.849472:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:31493:x1830945721642880:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126622.849484:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.849497:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6c6 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.849520:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.849528:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.849533:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.849534:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.849537:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2723840->2764799] (req 2723840->2764799) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.849560:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.849570:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 19 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.849581:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721443072:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126622.849638:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.849646:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 9 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.849652:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721443200:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126622.849670:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaea80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126622.849984:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721641984:12345-192.168.203.2@tcp:3:cat.0 Request processed in 63352us (68623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.849991:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7969 00002000:00100000:3.0:1746126622.849996:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009bb2ea00 x1830945721641984/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.850003:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ea00 with x1830945721641984 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.850006:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ea00 00000100:00100000:2.0:1746126622.852959:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721641472:12345-192.168.203.2@tcp:3:cat.0 Request processed in 71429us (72571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126622.852968:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7967 00002000:00100000:2.0:1746126622.852977:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880091da1f80 x1830945721641472/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.852984:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1f80 with x1830945721641472 ext(0->1048575) 00002000:00010000:2.0:1746126622.852988:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091da1f80 00010000:00010000:3.0:1746126622.853479:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126622.863203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.863238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.863256:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.863277:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643008 00000100:00100000:0.0:1746126622.863283:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643008 00010000:00010000:0.0:1746126622.863309:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 18 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.863328:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643264 00000100:00100000:0.0:1746126622.863330:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643264 00010000:00010000:0.0:1746126622.863337:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 10 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.863348:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7292 00000100:00100000:0.0:1746126622.863353:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721643008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126622.863363:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126622.863377:0:7074:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5693 -> 5695 00010000:00010000:0.0:1746126622.863381:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 18 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.863391:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 18 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.863408:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126622.863438:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721643008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.863446:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7292 00000100:00100000:0.0:1746126622.863456:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7293 00000100:00100000:0.0:1746126622.863460:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721643264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126622.863464:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126622.863469:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 10 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.863476:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 10 pid: 4640 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746126622.863484:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.863485:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126622.863491:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863497:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863520:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126622.863530:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721443328:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126622.863572:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.863607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.863621:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643136 00000100:00100000:0.0:1746126622.863623:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643136 00000100:00100000:0.0:1746126622.863635:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643392 00000100:00100000:0.0:1746126622.863636:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643392 00000100:00100000:0.0:1746126622.863645:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13981 00000100:00100000:0.0:1746126622.863649:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31495:x1830945721643136:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126622.863657:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.863665:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6cd expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863678:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863682:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126622.863684:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126622.863686:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2859008->3043327] (req 2859008->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863698:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863706:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 17 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.863713:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721443456:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126622.863727:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.863737:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13982 00000100:00100000:0.0:1746126622.863741:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31491:x1830945721643392:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126622.863746:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126622.863753:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6d4 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863766:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863771:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126622.863772:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126622.863775:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863789:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.863796:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 19 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746126622.863803:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721443584:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126622.863819:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaef00 going to sleep for 11 seconds 00010000:00010000:2.0:1746126622.864053:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921fc800/0xb50e82586761486e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e656 expref: 17 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.864082:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721443072:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.864091:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b22c200/0xb50e825867614859 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e641 expref: 12 pid: 4640 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.864098:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721443200:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.864115:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.864121:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.864127:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cc3600, rc 0) 00000100:00100000:2.0:1746126622.864152:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:31493:x1830945721642880:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 14680us (15225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.864157:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13980 00000100:00100000:2.0:1746126622.867005:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721443456:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126622.867009:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721443584:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126622.867035:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2859008->3043327] (req 2859008->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126622.867035:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 10 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.867047:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cc3200, rc 0) 00010000:00010000:0.0:1746126622.867047:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cc2a00, rc 0) 00000100:00100000:1.0:1746126622.867102:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721443328:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126622.867112:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126622.870258:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31491:x1830945721643392:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6507us (6640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.870266:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13982 00000100:00100000:1.0:1746126622.870336:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721643264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6873us (7077us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.870344:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7293 00000100:00100000:2.0:1746126622.870405:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31495:x1830945721643136:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6754us (7165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.870411:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13981 00000100:00100000:0.0:1746126622.871684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.871951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.872032:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643520 00000100:00100000:3.0:1746126622.872040:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643520 00000100:00100000:2.0:1746126622.872047:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643776 00000100:00100000:2.0:1746126622.872050:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643776 00002000:00100000:3.0:1746126622.872070:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1359872->2068479) req@ffff88009f11ca80 x1830945721643520/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.872070:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2723840->2727935) req@ffff88009f11c700 x1830945721643776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.872079:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11ca80 with x1830945721643520 ext(1359872->2068479) 00002000:00100000:2.0:1746126622.872079:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c700 with x1830945721643776 ext(2723840->2727935) 00010000:00010000:3.0:1746126622.872087:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 20 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.872087:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.872096:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 20 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.872096:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.872102:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f11ca80 00002000:00010000:2.0:1746126622.872102:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f11c700 00000100:00100000:3.0:1746126622.872121:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1820 00000100:00100000:3.0:1746126622.872126:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721643520:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126622.872176:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1821 00000100:00100000:2.0:1746126622.872182:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721643776:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126622.872332:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721643776:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 149us (380us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126622.872338:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1821 00002000:00100000:2.0:1746126622.872342:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2723840->2727935) req@ffff88009f11c700 x1830945721643776/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.872349:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c700 with x1830945721643776 ext(2723840->2727935) 00010000:00010000:2.0:1746126622.872353:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.872360:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746126622.872370:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f11c700 00000100:00100000:2.0:1746126622.874732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.874979:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721644160 00000100:00100000:1.0:1746126622.874986:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721644160 00002000:00100000:1.0:1746126622.875014:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2760704->2764799) req@ffff8800a448c000 x1830945721644160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.875031:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448c000 with x1830945721644160 ext(2760704->2764799) 00010000:00010000:1.0:1746126622.875038:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746126622.875048:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746126622.875054:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448c000 00000100:00100000:1.0:1746126622.875082:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1822 00000100:00100000:1.0:1746126622.875088:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721644160:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126622.875252:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721644160:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 163us (523us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126622.875258:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1822 00002000:00100000:1.0:1746126622.875262:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2760704->2764799) req@ffff8800a448c000 x1830945721644160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.875269:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448c000 with x1830945721644160 ext(2760704->2764799) 00010000:00010000:1.0:1746126622.875274:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746126622.875281:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746126622.875286:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448c000 00000100:00100000:0.0:1746126622.876032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.876467:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721643904 00000100:00100000:3.0:1746126622.876472:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721643904 00000100:00100000:3.0:1746126622.876550:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13983 00000100:00100000:3.0:1746126622.876557:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:31489:x1830945721643904:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.876566:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.876578:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6db expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.876596:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126622.876601:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.876609:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.876617:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135648800, rc 0) 00000100:00100000:3.0:1746126622.876801:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:31489:x1830945721643904:12345-192.168.203.2@tcp:101:cat.0 Request processed in 243us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.876806:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13983 00000100:00100000:0.0:1746126622.879748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.879788:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.879800:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721644416 00000100:00100000:2.0:1746126622.879806:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721644416 00002000:00100000:2.0:1746126622.879851:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2723840->2764799) req@ffff88009f11e300 x1830945721644416/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.879865:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11e300 with x1830945721644416 ext(2723840->2764799) 00010000:00010000:2.0:1746126622.879872:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.879880:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 16 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746126622.879886:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f11e300 00000100:00100000:2.0:1746126622.879909:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1823 00000100:00100000:2.0:1746126622.879914:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721644416:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126622.879969:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721644672 00000100:00100000:3.0:1746126622.879973:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721644672 00000100:00100000:3.0:1746126622.879993:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3839 00000100:00100000:3.0:1746126622.879998:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+229:31493:x1830945721644672:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126622.880133:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:31493:x1830945721644672:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 132us (343us total) trans 8589943229 rc 0/0 00000100:00100000:3.0:1746126622.880138:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3839 00000100:00100000:3.0:1746126622.880424:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721643520:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 8296us (8741us total) trans 17179873294 rc 0/0 00000100:00100000:3.0:1746126622.880430:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1820 00002000:00100000:3.0:1746126622.880435:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1359872->2068479) req@ffff88009f11ca80 x1830945721643520/t17179873294(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/448 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.880442:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11ca80 with x1830945721643520 ext(1359872->2068479) 00010000:00010000:3.0:1746126622.880447:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 23 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.880455:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 23 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.880460:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f11ca80 00000100:00100000:2.0:1746126622.883503:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721644416:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 3582us (3754us total) trans 21474840441 rc 0/0 00000100:00100000:2.0:1746126622.883513:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1823 00002000:00100000:2.0:1746126622.883520:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2723840->2764799) req@ffff88009f11e300 x1830945721644416/t21474840441(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/448 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.883529:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11e300 with x1830945721644416 ext(2723840->2764799) 00010000:00010000:2.0:1746126622.883537:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 18 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.883548:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 18 pid: 10890 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746126622.883554:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f11e300 00000100:00100000:0.0:1746126622.888587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.889605:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721644800 00000100:00100000:1.0:1746126622.889612:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721644800 00010000:00010000:1.0:1746126622.889640:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 23 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746126622.889727:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7294 00000100:00100000:1.0:1746126622.889734:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721644800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126622.889745:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126622.889760:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 23 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746126622.889769:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 23 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746126622.889785:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a9ec00/0xb50e8258676148c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1359872->2068479) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e679 expref: 23 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746126622.890098:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.890101:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.890107:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.890404:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.890413:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.890414:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126622.890417:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.890422:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.890449:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126622.890460:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721443712:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126622.891423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.891593:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721644928 00000100:00100000:3.0:1746126622.891599:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721644928 00010000:00010000:3.0:1746126622.891622:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 18 pid: 10890 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746126622.891643:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7295 00000100:00100000:3.0:1746126622.891648:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721644928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126622.891656:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746126622.891669:0:7073:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126621 -> 1746126622 00002000:00010000:3.0:1746126622.891671:0:7073:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126621 -> 1746126622 00010000:00010000:3.0:1746126622.891675:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 18 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.891683:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 18 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.891697:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3600/0xb50e82586761498d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->2764799) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6c6 expref: 18 pid: 10890 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.891720:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.891721:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126622.891725:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.891732:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126622.892002:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126622.892011:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721443840:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126622.892303:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746126622.892538:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126622.892546:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721443968:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126622.892577:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177600 going to sleep for 11 seconds 00000100:00100000:2.0:1746126622.899648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126622.899699:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721443712:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126622.899877:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721645184 00000100:00100000:3.0:1746126622.899883:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721645184 00000100:00100000:1.0:1746126622.899931:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721443840:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126622.899946:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746126622.899964:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a448d180 x1830945721645184/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746126622.900027:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721443968:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126622.900047:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126622.900115:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721644800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10381us (11536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126622.900123:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7294 00002000:00100000:3.0:1746126622.900243:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448d180 with x1830945721645184 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.900249:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448d180 00000100:00100000:3.0:1746126622.900265:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7971 00000100:00100000:3.0:1746126622.900271:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721645184:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126622.900629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.900693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.900707:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721645440 00000100:00100000:2.0:1746126622.900710:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721645440 00002000:00100000:2.0:1746126622.900728:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2859008->2863103) req@ffff8800a448ca80 x1830945721645440/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.900735:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ca80 with x1830945721645440 ext(2859008->2863103) 00002000:00010000:2.0:1746126622.900738:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ca80 00000100:00100000:2.0:1746126622.900747:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721645696 00000100:00100000:2.0:1746126622.900748:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721645696 00002000:00100000:2.0:1746126622.900756:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a448df80 x1830945721645696/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.900761:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448df80 with x1830945721645696 ext(1048576->2097151) 00002000:00010000:2.0:1746126622.900763:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448df80 00000100:00100000:2.0:1746126622.900773:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7972 00000100:00100000:2.0:1746126622.900777:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721645440:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126622.900932:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721645440:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 153us (303us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126622.900938:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7972 00002000:00100000:2.0:1746126622.900943:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2859008->2863103) req@ffff8800a448ca80 x1830945721645440/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.900950:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ca80 with x1830945721645440 ext(2859008->2863103) 00002000:00010000:2.0:1746126622.900952:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ca80 00000100:00100000:1.0:1746126622.900960:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7973 00000100:00100000:1.0:1746126622.900970:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721645696:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126622.901086:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721644928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8981us (9208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126622.901094:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7295 00000100:00100000:1.0:1746126622.917070:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721645696:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16095us (16368us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126622.917087:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7973 00002000:00100000:1.0:1746126622.917097:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a448df80 x1830945721645696/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126622.917111:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448df80 with x1830945721645696 ext(1048576->2097151) 00002000:00010000:1.0:1746126622.917116:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448df80 00000100:00100000:0.0:1746126622.923662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.923799:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721645184:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23526us (24157us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.923809:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7971 00002000:00100000:3.0:1746126622.923817:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a448d180 x1830945721645184/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.923843:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448d180 with x1830945721645184 ext(1048576->2097151) 00002000:00010000:3.0:1746126622.923848:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a448d180 00000100:00100000:3.0:1746126622.923866:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721645952 00000100:00100000:3.0:1746126622.923871:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721645952 00002000:00100000:3.0:1746126622.923894:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3039232->3043327) req@ffff88009f11f100 x1830945721645952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.923900:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11f100 with x1830945721645952 ext(3039232->3043327) 00002000:00010000:3.0:1746126622.923903:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11f100 00000100:00100000:3.0:1746126622.923925:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7974 00000100:00100000:3.0:1746126622.923931:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721645952:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126622.924075:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721645952:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 143us (419us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126622.924080:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7974 00002000:00100000:3.0:1746126622.924085:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3039232->3043327) req@ffff88009f11f100 x1830945721645952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/4536 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.924091:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11f100 with x1830945721645952 ext(3039232->3043327) 00002000:00010000:3.0:1746126622.924094:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11f100 00000100:00100000:0.0:1746126622.928449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.928520:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721646208 00000100:00100000:3.0:1746126622.928529:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721646208 00000100:00100000:3.0:1746126622.928571:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3840 00000100:00100000:3.0:1746126622.928578:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31495:x1830945721646208:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126622.928758:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31495:x1830945721646208:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 179us (315us total) trans 8589943230 rc 0/0 00000100:00100000:3.0:1746126622.928765:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3840 00000100:00100000:0.0:1746126622.942657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.942774:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721646336 00000100:00100000:3.0:1746126622.942785:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721646336 00000100:00100000:3.0:1746126622.942861:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13984 00000100:00100000:3.0:1746126622.942867:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+17:31489:x1830945721646336:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.942881:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.942895:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6e2 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.942917:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.942924:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126622.942925:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126622.942928:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.942956:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.942965:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 9 pid: 23766 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746126622.942975:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721444096:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126622.944259:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126622.947004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.947061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126622.947331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.947422:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721444096:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126622.947446:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.947460:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eae8000, rc 0) 00000100:00100000:3.0:1746126622.947505:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+18:31489:x1830945721646336:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4638us (4858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.947513:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13984 00000100:00100000:3.0:1746126622.947539:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721646720 00000100:00100000:3.0:1746126622.947543:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721646720 00002000:00100000:3.0:1746126622.947568:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3330048->4194303) req@ffff88009e9d6300 x1830945721646720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.947576:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6300 with x1830945721646720 ext(3330048->4194303) 00010000:00010000:3.0:1746126622.947582:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 10 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.947597:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 10 pid: 23766 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.947603:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9d6300 00000100:00100000:3.0:1746126622.947617:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721646592 00000100:00100000:3.0:1746126622.947619:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721646592 00002000:00100000:3.0:1746126622.947627:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3330047) req@ffff88009e9d5500 x1830945721646592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 504/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.947633:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5500 with x1830945721646592 ext(2097152->3330047) 00010000:00010000:3.0:1746126622.947636:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 11 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.947643:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 11 pid: 23766 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.947648:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9d5500 00000100:00100000:3.0:1746126622.947653:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721646976 00000100:00100000:3.0:1746126622.947655:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721646976 00002000:00100000:3.0:1746126622.947661:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2859008->3043327) req@ffff88009e9d4a80 x1830945721646976/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.947667:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4a80 with x1830945721646976 ext(2859008->3043327) 00010000:00010000:3.0:1746126622.947670:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 12 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.947677:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 12 pid: 23766 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.947682:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9d4a80 00000100:00100000:3.0:1746126622.947689:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1824 00000100:00100000:3.0:1746126622.947694:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721646720:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126622.948631:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1825 00000100:00100000:3.0:1746126622.948637:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721646592:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126622.949800:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1826 00000100:00100000:2.0:1746126622.949809:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721646976:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126622.964799:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721646720:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17097us (17793us total) trans 0 rc 864256/864256 00000100:00100000:3.0:1746126622.964809:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1824 00002000:00100000:3.0:1746126622.964818:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3330048->4194303) req@ffff88009e9d6300 x1830945721646720/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.964845:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d6300 with x1830945721646720 ext(3330048->4194303) 00010000:00010000:3.0:1746126622.964854:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 14 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.964866:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 14 pid: 23766 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.964872:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9d6300 00000100:00100000:2.0:1746126622.965514:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721646976:12345-192.168.203.2@tcp:4:cat.0 Request processed in 15705us (18181us total) trans 21474840442 rc 0/0 00000100:00100000:2.0:1746126622.965521:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1826 00002000:00100000:2.0:1746126622.965526:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2859008->3043327) req@ffff88009e9d4a80 x1830945721646976/t21474840442(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/448 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.965534:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4a80 with x1830945721646976 ext(2859008->3043327) 00010000:00010000:2.0:1746126622.965538:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 14 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.965548:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 14 pid: 23766 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746126622.965553:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9d4a80 00000100:00100000:3.0:1746126622.971356:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721646592:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22709us (24283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126622.971367:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1825 00002000:00100000:3.0:1746126622.971378:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3330047) req@ffff88009e9d5500 x1830945721646592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 504/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.971392:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5500 with x1830945721646592 ext(2097152->3330047) 00010000:00010000:3.0:1746126622.971401:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 12 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746126622.971416:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 12 pid: 23766 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746126622.971421:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e9d5500 00000100:00100000:0.0:1746126622.978685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.978783:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721647104 00000100:00100000:3.0:1746126622.978795:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721647104 00000100:00100000:3.0:1746126622.978856:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13985 00000100:00100000:3.0:1746126622.978863:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31491:x1830945721647104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126622.978877:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126622.978891:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6e9 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.978913:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126622.978915:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126622.978918:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.978928:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126622.978937:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eae8c00, rc 0) 00000100:00100000:3.0:1746126622.978993:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31491:x1830945721647104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126622.978999:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13985 00000100:00100000:0.0:1746126622.980349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.980424:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721647232 00000100:00100000:2.0:1746126622.980429:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721647232 00010000:00010000:2.0:1746126622.980451:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 13 pid: 23766 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746126622.980480:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7296 00000100:00100000:2.0:1746126622.980486:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721647232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126622.980495:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126622.980510:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 13 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.980519:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 13 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.980535:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cc3200/0xb50e825867614994 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2859008->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6cd expref: 13 pid: 23766 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746126622.980730:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.980732:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.980738:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.980744:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.980751:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.980752:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126622.980755:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.980760:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126622.980782:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.980793:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721444224:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.981234:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126622.981243:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721444352:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.981263:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126622.984735:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721444224:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126622.984745:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721444352:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126622.984760:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126622.984801:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721647232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4314us (4453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126622.984810:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7296 00000100:00100000:0.0:1746126622.986961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.987432:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721647488 00000100:00100000:3.0:1746126622.987439:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721647488 00002000:00100000:3.0:1746126622.987474:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e9d7100 x1830945721647488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.987483:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7100 with x1830945721647488 ext(3145728->4194303) 00002000:00010000:3.0:1746126622.987487:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d7100 00000100:00100000:3.0:1746126622.987575:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7975 00000100:00100000:3.0:1746126622.987582:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721647488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.988381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126622.989212:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721647744 00000100:00100000:2.0:1746126622.989218:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721647744 00002000:00100000:2.0:1746126622.989241:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e9d5180 x1830945721647744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126622.989249:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5180 with x1830945721647744 ext(2097152->3145727) 00002000:00010000:2.0:1746126622.989253:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d5180 00000100:00100000:2.0:1746126622.989273:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7976 00000100:00100000:2.0:1746126622.989278:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721647744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126622.989412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126622.990147:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721647872 00000100:00100000:3.0:1746126622.990150:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721647872 00002000:00100000:3.0:1746126622.990167:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e9d4700 x1830945721647872/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/0 e 0 to 0 dl 1746126633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126622.990173:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4700 with x1830945721647872 ext(3145728->4194303) 00002000:00010000:3.0:1746126622.990176:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d4700 00000100:00100000:3.0:1746126622.990186:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7977 00000100:00100000:3.0:1746126622.990191:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721647872:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.009306:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721647488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21717us (22342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.009315:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7975 00002000:00100000:3.0:1746126623.009324:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e9d7100 x1830945721647488/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.009332:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d7100 with x1830945721647488 ext(3145728->4194303) 00002000:00010000:3.0:1746126623.009337:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d7100 00000100:00100000:2.0:1746126623.018115:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721647744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28828us (29727us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.018128:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7976 00002000:00100000:2.0:1746126623.018139:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009e9d5180 x1830945721647744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.018147:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d5180 with x1830945721647744 ext(2097152->3145727) 00002000:00010000:2.0:1746126623.018152:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d5180 00000100:00100000:3.0:1746126623.018481:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721647872:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28287us (29070us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.018489:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7977 00002000:00100000:3.0:1746126623.018494:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e9d4700 x1830945721647872/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:383/0 lens 488/440 e 0 to 0 dl 1746126633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.018501:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4700 with x1830945721647872 ext(3145728->4194303) 00002000:00010000:3.0:1746126623.018504:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d4700 00000100:00100000:0.0:1746126623.026679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.026801:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721648256 00000100:00100000:3.0:1746126623.026809:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721648256 00002000:00100000:3.0:1746126623.026961:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e9d4000 x1830945721648256/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.026971:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4000 with x1830945721648256 ext(4194304->4976639) 00002000:00010000:3.0:1746126623.026975:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d4000 00000100:00100000:3.0:1746126623.027041:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7978 00000100:00100000:3.0:1746126623.027047:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721648256:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126623.030606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.032743:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721648512 00000100:00100000:2.0:1746126623.032753:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721648512 00000100:00100000:2.0:1746126623.032804:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3841 00000100:00100000:2.0:1746126623.032811:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31463:x1830945721648512:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:2.0:1746126623.033010:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31463:x1830945721648512:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 198us (2410us total) trans 8589943231 rc 0/0 00000100:00100000:2.0:1746126623.033016:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3841 00000100:00100000:0.0:1746126623.034182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.034323:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721648768 00000100:00100000:2.0:1746126623.034327:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721648768 00002000:00100000:2.0:1746126623.034352:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009f135f80 x1830945721648768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.034361:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135f80 with x1830945721648768 ext(4194304->4976639) 00002000:00010000:2.0:1746126623.034366:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f135f80 00000100:00100000:2.0:1746126623.034392:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7979 00000100:00100000:2.0:1746126623.034398:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721648768:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126623.042320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.042379:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721649024 00000100:00100000:2.0:1746126623.042386:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721649024 00000100:00100000:2.0:1746126623.042437:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9041 00000100:00100000:2.0:1746126623.042444:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+230:31499:x1830945721649024:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.042464:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.042479:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889e00/0xb50e8258676149b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6f0 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.042566:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042576:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042586:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042596:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042602:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042607:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042690:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e8258676149cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042698:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e8258676149cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.042704:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e8258676149cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126623.042712:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126623.043582:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043593:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043598:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043602:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c889c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.043605:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043611:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043621:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126623.043623:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.043627:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043631:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889c00/0xb50e8258676149be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043658:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043663:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043667:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043670:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c889a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.043673:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043680:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043685:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe900) 00010000:00010000:2.0:1746126623.043687:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.043689:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043693:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889a00/0xb50e8258676149c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.043728:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c889e00/0xb50e8258676149b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f0 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.043739:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e8258676149cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f0 expref: 232 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.043744:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.043746:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126623.043748:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e08c00, rc 0) 00000100:00100000:2.0:1746126623.043805:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+232:31499:x1830945721649024:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1361us (1491us total) trans 8589943232 rc 0/0 00000100:00100000:2.0:1746126623.043813:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9041 00000100:00100000:3.0:1746126623.048151:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721648256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21096us (21470us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126623.048162:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7978 00002000:00100000:3.0:1746126623.048172:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e9d4000 x1830945721648256/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.048181:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9d4000 with x1830945721648256 ext(4194304->4976639) 00002000:00010000:3.0:1746126623.048186:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e9d4000 00000100:00100000:0.0:1746126623.053173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.053727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.054238:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721648768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19835us (20054us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126623.054249:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7979 00002000:00100000:3.0:1746126623.054261:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009f135f80 x1830945721648768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.054270:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135f80 with x1830945721648768 ext(4194304->4976639) 00002000:00010000:3.0:1746126623.054275:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f135f80 00000100:00100000:2.0:1746126623.055536:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721649280 00000100:00100000:2.0:1746126623.055543:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721649280 00000100:00100000:2.0:1746126623.055576:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3842 00000100:00100000:2.0:1746126623.055581:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31463:x1830945721649280:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:2.0:1746126623.055728:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31463:x1830945721649280:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 146us (2562us total) trans 8589943233 rc 0/0 00000100:00100000:2.0:1746126623.055734:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3842 00000100:00100000:2.0:1746126623.056206:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721649408 00000100:00100000:2.0:1746126623.056210:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721649408 00000100:00100000:2.0:1746126623.056236:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 707 00000100:00100000:2.0:1746126623.056241:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+232:1963:x1830945721649408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.056250:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.056269:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e08c00/0xb50e8258676149cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f0 expref: 232 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.056280:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.056283:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.056302:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:1963:x1830945721649408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 61us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.056307:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 707 00000100:00100000:0.0:1746126623.130632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.132009:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721649536 00000100:00100000:2.0:1746126623.132017:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721649536 00000100:00100000:2.0:1746126623.132075:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13986 00000100:00100000:2.0:1746126623.132082:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:31499:x1830945721649536:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.132096:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.132110:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6f7 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.132137:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.132144:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.132150:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.132152:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.132154:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2486272->3133439] (req 2486272->3133439) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.132177:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.132185:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 11 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.132194:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721444480:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.132258:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.132264:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.132270:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721444608:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.132281:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.138681:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721444480:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.138692:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721444608:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.138715:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2486272->3133439] (req 2486272->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.138735:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c889a00, rc 0) 00000100:00100000:2.0:1746126623.138785:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:31499:x1830945721649536:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6702us (8158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.138792:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13986 00000100:00100000:0.0:1746126623.141890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.141989:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721649664 00000100:00100000:2.0:1746126623.141996:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721649664 00010000:00010000:2.0:1746126623.142030:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.142059:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7297 00000100:00100000:2.0:1746126623.142065:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721649664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.142075:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.142090:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.142100:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.142118:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8000/0xb50e8258676149a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e2 expref: 19 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.142132:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.142160:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721649664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.142165:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7297 00000100:00100000:0.0:1746126623.146712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.149200:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721649792 00000100:00100000:2.0:1746126623.149209:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721649792 00010000:00010000:3.0:1746126623.149277:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.149306:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7298 00000100:00100000:3.0:1746126623.149312:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721649792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126623.149322:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126623.149338:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.149349:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.149366:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eae8c00/0xb50e8258676149b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6e9 expref: 12 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.149455:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.149457:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.149462:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.149473:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.149498:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.149507:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721444736:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126623.150968:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.156790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.156889:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721444736:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126623.156905:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126623.156954:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721649792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7640us (10247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.156963:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7298 00000100:00100000:0.0:1746126623.157338:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721650048 00000100:00100000:0.0:1746126623.157344:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721650048 00002000:00100000:0.0:1746126623.157375:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2486272->2490367) req@ffff8800a448ce00 x1830945721650048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.157384:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ce00 with x1830945721650048 ext(2486272->2490367) 00002000:00010000:0.0:1746126623.157388:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ce00 00000100:00100000:0.0:1746126623.157401:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7980 00000100:00100000:0.0:1746126623.157407:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721650048:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126623.157527:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721650048:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 120us (744us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126623.157532:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7980 00002000:00100000:0.0:1746126623.157537:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2486272->2490367) req@ffff8800a448ce00 x1830945721650048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.157543:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448ce00 with x1830945721650048 ext(2486272->2490367) 00002000:00010000:0.0:1746126623.157545:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448ce00 00000100:00100000:0.0:1746126623.161951:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.162074:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721650304 00000100:00100000:2.0:1746126623.162081:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721650304 00000100:00100000:2.0:1746126623.162115:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9042 00000100:00100000:2.0:1746126623.162121:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31504:x1830945721650304:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.162140:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.162155:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2800/0xb50e8258676149e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e6fe expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.162234:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162244:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162254:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162265:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162269:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162274:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162352:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162359:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162365:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126623.162372:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126623.162432:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162438:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162443:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162448:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356c2e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.162451:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162456:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162464:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126623.162466:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.162469:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162473:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2e00/0xb50e8258676149e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162501:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162507:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162515:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162518:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356c2200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.162520:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162524:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162529:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe800) 00010000:00010000:2.0:1746126623.162531:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.162533:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162537:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2200/0xb50e8258676149ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.162565:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c2800/0xb50e8258676149e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.162575:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.162581:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.162582:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126623.162584:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c3400, rc 0) 00000100:00100000:2.0:1746126623.163839:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31504:x1830945721650304:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1716us (1892us total) trans 8589943234 rc 0/0 00000100:00100000:2.0:1746126623.163847:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9042 00000100:00100000:0.0:1746126623.167791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.167859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.167925:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721650560 00000100:00100000:3.0:1746126623.167931:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721650560 00002000:00100000:3.0:1746126623.167964:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3129344->3133439) req@ffff880099251880 x1830945721650560/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.167972:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251880 with x1830945721650560 ext(3129344->3133439) 00002000:00010000:3.0:1746126623.167977:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251880 00000100:00100000:3.0:1746126623.167990:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7981 00000100:00100000:3.0:1746126623.167996:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721650560:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126623.168149:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721650560:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 152us (363us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126623.168159:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7981 00002000:00100000:3.0:1746126623.168164:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3129344->3133439) req@ffff880099251880 x1830945721650560/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.168171:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251880 with x1830945721650560 ext(3129344->3133439) 00002000:00010000:3.0:1746126623.168174:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251880 00000100:00100000:2.0:1746126623.168408:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721650688 00000100:00100000:2.0:1746126623.168412:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721650688 00000100:00100000:2.0:1746126623.168431:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13987 00000100:00100000:2.0:1746126623.168435:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31504:x1830945721650688:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.168444:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.168456:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e705 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.168477:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.168484:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.168490:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.168491:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.168494:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->3309567] (req 3268608->3309567) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.168516:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.168526:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.168536:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721444864:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.168584:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 21 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.168593:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 21 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.168600:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721444992:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.168622:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.170821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.171301:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721650944 00000100:00100000:3.0:1746126623.171307:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721650944 00000100:00100000:3.0:1746126623.171373:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3843 00000100:00100000:3.0:1746126623.171379:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:31499:x1830945721650944:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126623.171594:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+232:31499:x1830945721650944:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 210us (772us total) trans 8589943235 rc 0/0 00000100:00100000:3.0:1746126623.171600:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3843 00000100:00100000:2.0:1746126623.173420:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721444864:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.173434:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721444992:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.173455:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3268608->3309567] (req 3268608->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.173470:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c2200, rc 0) 00000100:00100000:2.0:1746126623.173511:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31504:x1830945721650688:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5074us (5650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.173518:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13987 00000100:00100000:0.0:1746126623.178906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.178974:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721651200 00000100:00100000:3.0:1746126623.178981:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721651200 00000100:00100000:0.0:1746126623.178981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126623.179011:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.179049:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721651072 00000100:00100000:3.0:1746126623.179051:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721651072 00010000:00010000:3.0:1746126623.179061:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 22 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.179089:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7299 00000100:00100000:3.0:1746126623.179095:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721651200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126623.179106:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126623.179122:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.179133:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.179151:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921fde00/0xb50e825867614867 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e64f expref: 11 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.179161:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7300 00010000:00010000:3.0:1746126623.179166:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.179168:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721651072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.179174:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.179181:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 22 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.179188:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 22 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.179199:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721651200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 104us (300us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126623.179203:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b22d600/0xb50e825867614860 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e648 expref: 22 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.179204:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7299 00010000:00010000:2.0:1746126623.179213:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.179214:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.179219:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.179226:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.179251:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.179261:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721445120:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126623.179318:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.181445:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721445120:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126623.181459:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.181539:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721651072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2370us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.181548:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7300 00000100:00100000:0.0:1746126623.183318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.183572:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721651456 00000100:00100000:2.0:1746126623.183579:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721651456 00002000:00100000:2.0:1746126623.183609:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3268608->3272703) req@ffff880099250e00 x1830945721651456/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.183621:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250e00 with x1830945721651456 ext(3268608->3272703) 00002000:00010000:2.0:1746126623.183625:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099250e00 00000100:00100000:2.0:1746126623.183651:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7982 00000100:00100000:2.0:1746126623.183658:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721651456:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126623.183819:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721651456:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 161us (504us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126623.183825:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7982 00002000:00100000:2.0:1746126623.183849:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3268608->3272703) req@ffff880099250e00 x1830945721651456/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.183855:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250e00 with x1830945721651456 ext(3268608->3272703) 00002000:00010000:2.0:1746126623.183858:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099250e00 00000100:00100000:0.0:1746126623.185774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.185900:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721651712 00000100:00100000:3.0:1746126623.185905:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721651712 00002000:00100000:3.0:1746126623.185929:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3305472->3309567) req@ffff880099250700 x1830945721651712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.185937:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250700 with x1830945721651712 ext(3305472->3309567) 00002000:00010000:3.0:1746126623.185941:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099250700 00000100:00100000:3.0:1746126623.186118:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7983 00000100:00100000:3.0:1746126623.186125:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721651712:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126623.186254:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721651712:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 130us (484us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126623.186259:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7983 00002000:00100000:3.0:1746126623.186263:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3305472->3309567) req@ffff880099250700 x1830945721651712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.186274:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250700 with x1830945721651712 ext(3305472->3309567) 00002000:00010000:3.0:1746126623.186277:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099250700 00000100:00100000:0.0:1746126623.190250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.190364:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721651968 00000100:00100000:3.0:1746126623.190372:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721651968 00000100:00100000:3.0:1746126623.190418:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3844 00000100:00100000:3.0:1746126623.190425:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31504:x1830945721651968:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126623.190611:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31504:x1830945721651968:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 187us (369us total) trans 8589943236 rc 0/0 00000100:00100000:3.0:1746126623.190616:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3844 00000100:00100000:1.0:1746126623.211242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.211405:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721652096 00000100:00100000:2.0:1746126623.211413:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721652096 00000100:00100000:2.0:1746126623.211593:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13988 00000100:00100000:2.0:1746126623.211601:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721652096:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.211615:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.211629:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c3000/0xb50e825867614a0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e70c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.211673:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721445248:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126623.212108:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746126623.216384:0:4640:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126621 -> 1746126622 00000100:00100000:2.0:1746126623.216410:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721445248:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126623.216438:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c3000/0xb50e825867614a0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e70c expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.216449:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356c3000/0xb50e825867614a0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e70c expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.216478:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c3000, rc 0) 00000100:00100000:2.0:1746126623.216531:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721652096:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4929us (5294us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126623.216539:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13988 00000100:00100000:0.0:1746126623.232988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.234211:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721652224 00000100:00100000:2.0:1746126623.234220:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721652224 00000100:00100000:2.0:1746126623.234260:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13989 00000100:00100000:2.0:1746126623.234267:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31509:x1830945721652224:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.234281:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.234295:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e713 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.234319:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.234325:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126623.234326:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126623.234329:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.234354:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 17 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.234365:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 17 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.234377:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721445376:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.234446:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.236981:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721445376:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.237003:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.237016:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c2e00, rc 0) 00000100:00100000:2.0:1746126623.237069:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31509:x1830945721652224:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2801us (4088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.237076:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13989 00000100:00100000:0.0:1746126623.240622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.241285:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721652352 00000100:00100000:2.0:1746126623.241293:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721652352 00002000:00100000:2.0:1746126623.241330:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2486272->3133439) req@ffff880099250380 x1830945721652352/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.241340:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250380 with x1830945721652352 ext(2486272->3133439) 00010000:00010000:2.0:1746126623.241348:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 18 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.241359:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 18 pid: 4640 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746126623.241369:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099250380 00000100:00100000:2.0:1746126623.241423:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1827 00000100:00100000:2.0:1746126623.241430:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721652352:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126623.252614:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721652352:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 11177us (11991us total) trans 21474840443 rc 0/0 00000100:00100000:2.0:1746126623.252624:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1827 00002000:00100000:2.0:1746126623.252633:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2486272->3133439) req@ffff880099250380 x1830945721652352/t21474840443(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/448 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.252641:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250380 with x1830945721652352 ext(2486272->3133439) 00010000:00010000:2.0:1746126623.252649:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 20 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.252661:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 20 pid: 4640 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746126623.252667:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099250380 00000100:00100000:0.0:1746126623.257717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.257777:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721652480 00000100:00100000:2.0:1746126623.257784:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721652480 00010000:00010000:2.0:1746126623.258363:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 20 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.258390:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7301 00000100:00100000:2.0:1746126623.258396:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721652480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.258410:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.258427:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 20 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.258435:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 20 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.258451:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c889a00/0xb50e8258676149da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->3133439) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6f7 expref: 20 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.258476:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.258478:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.258483:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.258489:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.258513:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.258523:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721445504:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126623.258595:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.262155:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721445504:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126623.262171:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.262217:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721652480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3819us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.262227:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7301 00000100:00100000:0.0:1746126623.272660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.272700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.272899:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721652736 00000100:00100000:3.0:1746126623.272907:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721652736 00002000:00100000:3.0:1746126623.272940:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880099250000 x1830945721652736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.272949:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250000 with x1830945721652736 ext(2097152->3145727) 00002000:00010000:3.0:1746126623.272954:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099250000 00000100:00100000:3.0:1746126623.272965:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721652992 00000100:00100000:3.0:1746126623.272966:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721652992 00002000:00100000:3.0:1746126623.272974:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880099251c00 x1830945721652992/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.272980:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251c00 with x1830945721652992 ext(3145728->4194303) 00002000:00010000:3.0:1746126623.272982:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251c00 00000100:00100000:3.0:1746126623.272990:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7984 00000100:00100000:3.0:1746126623.272995:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721652736:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126623.273054:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7985 00000100:00100000:2.0:1746126623.273061:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721652992:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126623.274098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.274120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.274138:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721653376 00000100:00100000:1.0:1746126623.274142:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721653376 00002000:00100000:1.0:1746126623.274159:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008dab9880 x1830945721653376/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 504/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.274165:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9880 with x1830945721653376 ext(3145728->4194303) 00002000:00010000:1.0:1746126623.274169:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab9880 00000100:00100000:1.0:1746126623.274177:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721653248 00000100:00100000:1.0:1746126623.274178:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721653248 00002000:00100000:1.0:1746126623.274186:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dab9500 x1830945721653248/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.274191:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9500 with x1830945721653248 ext(2097152->3145727) 00002000:00010000:1.0:1746126623.274193:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab9500 00000100:00100000:1.0:1746126623.274205:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7986 00000100:00100000:1.0:1746126623.274209:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721653376:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.274713:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7987 00000100:00100000:3.0:1746126623.274721:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721653248:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.297635:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721652736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24630us (24973us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.297645:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7984 00002000:00100000:3.0:1746126623.297654:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880099250000 x1830945721652736/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.297663:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099250000 with x1830945721652736 ext(2097152->3145727) 00002000:00010000:3.0:1746126623.297668:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099250000 00000100:00100000:2.0:1746126623.298610:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721652992:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25547us (25907us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.298617:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7985 00002000:00100000:2.0:1746126623.298623:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880099251c00 x1830945721652992/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.298629:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251c00 with x1830945721652992 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.298632:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251c00 00000100:00100000:3.0:1746126623.304135:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721653248:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29406us (30004us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.304146:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7987 00002000:00100000:3.0:1746126623.304156:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dab9500 x1830945721653248/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.304165:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9500 with x1830945721653248 ext(2097152->3145727) 00002000:00010000:3.0:1746126623.304170:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab9500 00000100:00100000:1.0:1746126623.308303:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721653376:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34084us (34197us total) trans 0 rc 1007616/1007616 00000100:00100000:1.0:1746126623.308314:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7986 00002000:00100000:1.0:1746126623.308323:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008dab9880 x1830945721653376/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 504/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.308336:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9880 with x1830945721653376 ext(3145728->4194303) 00002000:00010000:1.0:1746126623.308342:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab9880 00000100:00100000:0.0:1746126623.313994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.314032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.314073:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.314154:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721653888 00000100:00100000:3.0:1746126623.314161:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721653888 00000100:00100000:3.0:1746126623.314201:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721654016 00000100:00100000:3.0:1746126623.314204:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721654016 00000100:00100000:3.0:1746126623.314219:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13990 00000100:00100000:3.0:1746126623.314225:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721653888:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.314238:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.314252:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e71a expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.314274:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.314276:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.314283:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 20 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.314295:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 20 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.314303:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099078800, rc 0) 00000100:00100000:3.0:1746126623.314338:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721653888:12345-192.168.203.2@tcp:101:cat.0 Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.314344:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13990 00000100:00100000:3.0:1746126623.314356:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13991 00000100:00100000:3.0:1746126623.314366:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721654016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.314372:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126623.314417:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721653760 00000100:00100000:1.0:1746126623.314421:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721653760 00002000:00100000:1.0:1746126623.314442:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099253100 x1830945721653760/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.314450:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253100 with x1830945721653760 ext(4194304->4976639) 00002000:00010000:1.0:1746126623.314453:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253100 00000100:00100000:1.0:1746126623.314466:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7988 00000100:00100000:1.0:1746126623.314470:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721653760:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:3.0:1746126623.315080:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867614a20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e721 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.315116:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721445632:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126623.315171:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.324108:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721653760:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9629us (10113us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126623.324119:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7988 00002000:00100000:1.0:1746126623.324129:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880099253100 x1830945721653760/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.324138:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253100 with x1830945721653760 ext(4194304->4976639) 00002000:00010000:1.0:1746126623.324143:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099253100 00002000:00010000:3.0:1746126623.324212:0:23766:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126621 -> 1746126622 00002000:00010000:3.0:1746126623.324215:0:23766:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126621 -> 1746126623 00002000:00010000:3.0:1746126623.324217:0:23766:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126621 -> 1746126622 00000100:00100000:3.0:1746126623.324231:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721445632:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126623.324256:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867614a20 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e721 expref: 22 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.324269:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867614a20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e721 expref: 22 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.324285:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099078600, rc 0) 00000100:00100000:3.0:1746126623.324304:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721654016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9943us (10230us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126623.324309:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13991 00000100:00100000:0.0:1746126623.329364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.329436:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721654272 00000100:00100000:2.0:1746126623.329443:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721654272 00000100:00100000:2.0:1746126623.329487:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9043 00000100:00100000:2.0:1746126623.329493:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31514:x1830945721654272:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.329512:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.329527:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ca00/0xb50e825867614a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e728 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329596:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.329607:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 22 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329614:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 231 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329620:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329625:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.329649:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329658:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 22 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.329669:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721445760:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.329757:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 231 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329764:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 231 pid: 15560 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.329771:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721445888:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.329794:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 22 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.329800:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 22 pid: 14547 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.329807:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721446016:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.329821:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.332910:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721445760:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.332920:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721445888:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.332927:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721446016:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.332946:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126623.335723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.336103:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721654656 00000100:00100000:2.0:1746126623.336110:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721654656 00010000:00010000:2.0:1746126623.336139:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 23 pid: 14547 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.336505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.337260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.337823:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721654400 00000100:00100000:2.0:1746126623.337841:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721654400 00010000:00010000:2.0:1746126623.337859:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 24 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.337882:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7302 00000100:00100000:2.0:1746126623.337888:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721654656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.337899:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.337904:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 24 pid: 14547 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.337913:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 24 pid: 14547 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.337930:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134c2e200/0xb50e82586761480c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5f4 expref: 24 pid: 14547 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.337949:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.337953:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.337959:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.337963:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.338000:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721654656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 112us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.338006:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7302 00000100:00100000:2.0:1746126623.338054:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7303 00000100:00100000:2.0:1746126623.338059:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721654400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.338065:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.338069:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 22 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.338076:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 22 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.338085:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c3400/0xb50e8258676149f6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6fe expref: 22 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.338092:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.338095:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.338100:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.338104:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.338119:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721654400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 60us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.338124:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7303 00000100:00100000:1.0:1746126623.338872:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721654528 00000100:00100000:1.0:1746126623.338876:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721654528 00010000:00010000:1.0:1746126623.339084:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 232 pid: 15560 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.339110:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7304 00000100:00100000:1.0:1746126623.339115:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+232:1965:x1830945721654528:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.339122:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.339125:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 232 pid: 15560 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.339137:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 232 pid: 15560 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.339148:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135648a00/0xb50e8258676148fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e687 expref: 232 pid: 15560 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.339161:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.339165:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.339171:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.339177:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.339254:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.339262:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746126623.339277:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126623.339379:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7ca00/0xb50e825867614a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.339394:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.339399:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126623.339401:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126623.339403:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce7cc00, rc 0) 00000100:00100000:3.0:1746126623.339432:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31514:x1830945721654272:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9939us (10075us total) trans 8589943237 rc 0/0 00000100:00100000:3.0:1746126623.339438:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9043 00010000:00010000:1.0:1746126623.339509:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.339543:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+231:1965:x1830945721654528:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 427us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.339549:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7304 00000100:00100000:0.0:1746126623.346036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.346096:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721654912 00000100:00100000:1.0:1746126623.346104:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721654912 00002000:00100000:1.0:1746126623.346141:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a4c8e300 x1830945721654912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.346149:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8e300 with x1830945721654912 ext(2097152->3145727) 00002000:00010000:1.0:1746126623.346155:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8e300 00000100:00100000:1.0:1746126623.346182:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7989 00000100:00100000:1.0:1746126623.346188:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721654912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126623.362577:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721654912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16380us (16540us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126623.362588:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7989 00002000:00100000:1.0:1746126623.362598:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a4c8e300 x1830945721654912/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.362607:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8e300 with x1830945721654912 ext(2097152->3145727) 00002000:00010000:1.0:1746126623.362612:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8e300 00000100:00100000:0.0:1746126623.369701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.369769:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721655040 00000100:00100000:3.0:1746126623.369776:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721655040 00000100:00100000:3.0:1746126623.369822:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13992 00000100:00100000:3.0:1746126623.369848:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:31512:x1830945721655040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.369864:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.369878:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e72f expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.369900:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.369906:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126623.369908:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126623.369911:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.369934:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 9 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.369944:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 9 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.369954:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446144:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.371943:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.374881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.375032:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721655168 00000100:00100000:1.0:1746126623.375039:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721655168 00002000:00100000:1.0:1746126623.375074:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3268608->3309567) req@ffff8800a4c8c700 x1830945721655168/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.375082:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8c700 with x1830945721655168 ext(3268608->3309567) 00010000:00010000:1.0:1746126623.375091:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 10 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.375102:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 10 pid: 4640 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746126623.375108:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4c8c700 00000100:00100000:3.0:1746126623.375244:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446144:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.375264:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.375280:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae43200, rc 0) 00000100:00100000:3.0:1746126623.375329:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:31512:x1830945721655040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5500us (5634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.375335:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13992 00000100:00100000:1.0:1746126623.375633:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1828 00000100:00100000:1.0:1746126623.375640:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721655168:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126623.378327:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721655168:12345-192.168.203.2@tcp:4:cat.0 Request processed in 2682us (3446us total) trans 17179873295 rc 0/0 00000100:00100000:1.0:1746126623.378336:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1828 00002000:00100000:1.0:1746126623.378343:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3268608->3309567) req@ffff8800a4c8c700 x1830945721655168/t17179873295(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/448 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.378351:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8c700 with x1830945721655168 ext(3268608->3309567) 00010000:00010000:1.0:1746126623.378360:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.378370:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746126623.378376:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4c8c700 00000100:00100000:0.0:1746126623.385603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.386858:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721655296 00000100:00100000:2.0:1746126623.386867:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721655296 00010000:00010000:2.0:1746126623.386982:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.387030:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7305 00000100:00100000:2.0:1746126623.387037:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721655296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.387049:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.387066:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.387077:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.387095:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356c2200/0xb50e825867614a04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e705 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.387124:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.387125:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.387131:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.387138:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.387164:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.387186:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721446272:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126623.387809:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.390537:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721446272:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126623.390556:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126623.390601:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721655296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3563us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126623.390609:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7305 00000100:00100000:0.0:1746126623.395117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.395376:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721655552 00000100:00100000:1.0:1746126623.395384:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721655552 00002000:00100000:1.0:1746126623.395419:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a4c8ce00 x1830945721655552/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.395429:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8ce00 with x1830945721655552 ext(2097152->3145727) 00002000:00010000:1.0:1746126623.395434:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c8ce00 00000100:00100000:1.0:1746126623.395466:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7990 00000100:00100000:1.0:1746126623.395472:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721655552:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126623.397188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.397237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.397316:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721655936 00000100:00100000:2.0:1746126623.397322:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721655936 00002000:00100000:2.0:1746126623.397349:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880135ed2a00 x1830945721655936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.397356:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed2a00 with x1830945721655936 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.397360:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ed2a00 00000100:00100000:2.0:1746126623.397372:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721656064 00000100:00100000:2.0:1746126623.397375:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721656064 00002000:00100000:2.0:1746126623.397385:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135ed0000 x1830945721656064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.397390:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed0000 with x1830945721656064 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.397393:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ed0000 00000100:00100000:2.0:1746126623.397403:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7991 00000100:00100000:2.0:1746126623.397408:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721655936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126623.397584:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7992 00000100:00100000:0.0:1746126623.397591:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721656064:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126623.410890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.410984:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721656320 00000100:00100000:3.0:1746126623.410992:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721656320 00000100:00100000:3.0:1746126623.411034:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9044 00000100:00100000:3.0:1746126623.411040:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+231:31517:x1830945721656320:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126623.411059:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.411073:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28600/0xb50e825867614a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e736 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.411155:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411165:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411173:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411182:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411186:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411191:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411263:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411269:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411274:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746126623.411280:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126623.411335:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411340:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411345:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411349:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c28000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126623.411351:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411356:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411363:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126623.411365:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126623.411368:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411371:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411387:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411391:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411394:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411398:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c28c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126623.411399:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411403:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411407:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1d00) 00010000:00010000:3.0:1746126623.411408:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126623.411410:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411413:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28c00/0xb50e825867614a51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.411436:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28600/0xb50e825867614a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 234 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.411445:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 233 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.411449:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126623.411451:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126623.411453:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29800, rc 0) 00000100:00100000:3.0:1746126623.411500:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+233:31517:x1830945721656320:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 460us (616us total) trans 8589943238 rc 0/0 00000100:00100000:3.0:1746126623.411506:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9044 00000100:00100000:2.0:1746126623.418784:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721655552:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23303us (23666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.418795:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7990 00002000:00100000:2.0:1746126623.418806:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a4c8ce00 x1830945721655552/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.418815:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8ce00 with x1830945721655552 ext(2097152->3145727) 00002000:00010000:2.0:1746126623.418820:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c8ce00 00000100:00100000:2.0:1746126623.428776:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721655936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31359us (31583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.428786:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7991 00002000:00100000:2.0:1746126623.428796:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880135ed2a00 x1830945721655936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.428804:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed2a00 with x1830945721655936 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.428808:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ed2a00 00000100:00100000:1.0:1746126623.429489:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721656064:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31896us (32249us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126623.429496:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7992 00002000:00100000:1.0:1746126623.429501:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880135ed0000 x1830945721656064/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.429514:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed0000 with x1830945721656064 ext(3145728->4194303) 00002000:00010000:1.0:1746126623.429517:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ed0000 00000100:00100000:0.0:1746126623.437054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.437689:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721656576 00000100:00100000:1.0:1746126623.437697:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721656576 00002000:00100000:1.0:1746126623.437730:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880135ed1c00 x1830945721656576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.437738:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed1c00 with x1830945721656576 ext(4194304->4976639) 00002000:00010000:1.0:1746126623.437743:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ed1c00 00000100:00100000:1.0:1746126623.437772:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7993 00000100:00100000:1.0:1746126623.437778:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721656576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126623.456640:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721656576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18853us (19583us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126623.456652:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7993 00002000:00100000:1.0:1746126623.456662:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880135ed1c00 x1830945721656576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.456671:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ed1c00 with x1830945721656576 ext(4194304->4976639) 00002000:00010000:1.0:1746126623.456677:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ed1c00 00000100:00100000:0.0:1746126623.472608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.474606:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721656704 00000100:00100000:3.0:1746126623.474616:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721656704 00000100:00100000:3.0:1746126623.474669:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13993 00000100:00100000:3.0:1746126623.474676:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:31517:x1830945721656704:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126623.474691:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.474706:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e73d expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.474729:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.474735:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.474736:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.474739:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3530752->3891199] (req 3530752->3891199) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.474763:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.474772:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.474782:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446400:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.474900:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.476577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.476652:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721656960 00000100:00100000:3.0:1746126623.476657:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721656960 00000100:00100000:3.0:1746126623.476697:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9045 00000100:00100000:3.0:1746126623.476704:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31520:x1830945721656960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.476719:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.476733:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e744 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.476812:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476821:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476850:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476860:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476866:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476871:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476949:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476957:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.476966:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746126623.476973:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126623.477045:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477050:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477055:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477059:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c28a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126623.477062:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477067:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477076:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126623.477079:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126623.477082:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477086:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28a00/0xb50e825867614a74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477099:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477103:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477111:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477115:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c29a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126623.477117:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477121:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477127:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1000) 00010000:00010000:3.0:1746126623.477128:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126623.477130:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477134:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29a00/0xb50e825867614a7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746126623.477164:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28000/0xb50e825867614a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.477173:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.477178:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126623.477179:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126623.477181:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28800, rc 0) 00000100:00100000:3.0:1746126623.477216:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31520:x1830945721656960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 513us (643us total) trans 8589943239 rc 0/0 00000100:00100000:3.0:1746126623.477223:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9045 00000100:00100000:0.0:1746126623.479568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.479600:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446400:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.479622:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3530752->3891199] (req 3530752->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.479633:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29200, rc 0) 00000100:00100000:0.0:1746126623.479644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.479666:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:31517:x1830945721656704:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4990us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.479673:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13993 00000100:00100000:2.0:1746126623.479748:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721657344 00000100:00100000:2.0:1746126623.479753:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721657344 00000100:00100000:2.0:1746126623.479791:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3845 00000100:00100000:2.0:1746126623.479796:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31520:x1830945721657344:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126623.479966:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31520:x1830945721657344:12345-192.168.203.2@tcp:35:cat.0 Request processed in 169us (322us total) trans 8589943240 rc 0/0 00000100:00100000:2.0:1746126623.479971:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3845 00000100:00100000:1.0:1746126623.480071:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721657088 00000100:00100000:1.0:1746126623.480075:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721657088 00010000:00010000:1.0:1746126623.480091:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.480108:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7306 00000100:00100000:1.0:1746126623.480114:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721657088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.480121:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.480135:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.480145:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.480162:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae43200/0xb50e825867614a3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e72f expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.480175:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.480176:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.480182:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.480188:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.480209:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.480219:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721446528:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126623.480265:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.485384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.486258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.486589:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721657728 00000100:00100000:3.0:1746126623.486597:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721657728 00000100:00100000:3.0:1746126623.486640:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13994 00000100:00100000:3.0:1746126623.486646:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721657728:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.486661:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.486676:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e825867614a90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e74b expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.486718:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446656:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126623.486785:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19000 going to sleep for 11 seconds 00002000:00010000:3.0:1746126623.490254:0:23766:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126622 -> 1746126623 00002000:00010000:3.0:1746126623.490261:0:23766:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126622 -> 1746126623 00000100:00100000:3.0:1746126623.490279:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446656:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126623.490304:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e825867614a90 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e74b expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.490316:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29600/0xb50e825867614a90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e74b expref: 12 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.490346:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29600, rc 0) 00000100:00100000:3.0:1746126623.490386:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1966:x1830945721657728:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3739us (4129us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126623.490393:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13994 00000100:00100000:2.0:1746126623.503160:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721657600 00000100:00100000:2.0:1746126623.503171:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721657600 00002000:00100000:2.0:1746126623.503217:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3530752->3534847) req@ffff88009ed48700 x1830945721657600/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.503226:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed48700 with x1830945721657600 ext(3530752->3534847) 00002000:00010000:2.0:1746126623.503231:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed48700 00000100:00100000:2.0:1746126623.503252:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7994 00000100:00100000:2.0:1746126623.503258:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721657600:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126623.503414:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721657600:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 155us (18035us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126623.503419:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7994 00002000:00100000:2.0:1746126623.503424:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3530752->3534847) req@ffff88009ed48700 x1830945721657600/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.503431:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed48700 with x1830945721657600 ext(3530752->3534847) 00002000:00010000:2.0:1746126623.503434:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed48700 00000100:00100000:1.0:1746126623.503601:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721446528:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126623.503615:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.503647:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721657088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 23533us (24085us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.503654:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7306 00000100:00100000:0.0:1746126623.511947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.516664:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721657856 00000100:00100000:3.0:1746126623.516674:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721657856 00000100:00100000:3.0:1746126623.517312:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13995 00000100:00100000:3.0:1746126623.517320:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31520:x1830945721657856:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.517334:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.517349:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e752 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.517372:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.517379:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126623.517380:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126623.517382:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.517406:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.517415:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 21 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.517432:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446784:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.519011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.519082:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721658112 00000100:00100000:0.0:1746126623.519087:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721658112 00002000:00100000:0.0:1746126623.519116:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3887104->3891199) req@ffff880091da1c00 x1830945721658112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.519124:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1c00 with x1830945721658112 ext(3887104->3891199) 00010000:00010000:0.0:1746126623.519130:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.519140:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746126623.519145:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091da1c00 00000100:00100000:0.0:1746126623.519158:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1829 00000100:00100000:0.0:1746126623.519163:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721658112:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126623.519294:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721658112:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 129us (286us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126623.519300:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1829 00002000:00100000:0.0:1746126623.519304:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3887104->3891199) req@ffff880091da1c00 x1830945721658112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.519311:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da1c00 with x1830945721658112 ext(3887104->3891199) 00010000:00010000:0.0:1746126623.519315:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.519324:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746126623.519329:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091da1c00 00000100:00100000:3.0:1746126623.522078:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126623.522109:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721446784:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.522130:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.522144:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28600, rc 0) 00000100:00100000:3.0:1746126623.522176:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31520:x1830945721657856:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4857us (10235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.522183:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13995 00000100:00100000:0.0:1746126623.526169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.526219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.526233:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721658368 00000100:00100000:2.0:1746126623.526241:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721658368 00002000:00100000:2.0:1746126623.526282:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3530752->3891199) req@ffff88009ed4a680 x1830945721658368/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.526290:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4a680 with x1830945721658368 ext(3530752->3891199) 00010000:00010000:2.0:1746126623.526297:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.526310:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 22 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746126623.526315:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed4a680 00000100:00100000:2.0:1746126623.526344:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1830 00000100:00100000:2.0:1746126623.526350:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721658368:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126623.526865:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721658624 00000100:00100000:3.0:1746126623.526869:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721658624 00000100:00100000:3.0:1746126623.526891:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3846 00000100:00100000:3.0:1746126623.526896:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+233:31517:x1830945721658624:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126623.527287:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+234:31517:x1830945721658624:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 389us (1067us total) trans 8589943241 rc 0/0 00000100:00100000:3.0:1746126623.527297:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3846 00000100:00100000:2.0:1746126623.535674:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721658368:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 9316us (9503us total) trans 17179873296 rc 0/0 00000100:00100000:2.0:1746126623.535688:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1830 00002000:00100000:2.0:1746126623.535697:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3530752->3891199) req@ffff88009ed4a680 x1830945721658368/t17179873296(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/448 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.535706:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed4a680 with x1830945721658368 ext(3530752->3891199) 00010000:00010000:2.0:1746126623.535715:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.535727:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746126623.535733:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed4a680 00000100:00100000:0.0:1746126623.538716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.538772:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721658752 00000100:00100000:1.0:1746126623.538779:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721658752 00010000:00010000:1.0:1746126623.538804:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.538861:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7307 00000100:00100000:1.0:1746126623.538867:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721658752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.538882:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.538903:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.538913:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.538931:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29200/0xb50e825867614a66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e73d expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.538950:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.538952:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.538957:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.538964:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.538999:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.539009:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721446912:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126623.539087:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.544000:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721446912:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126623.544028:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.544075:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721658752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5206us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.544084:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7307 00000100:00100000:0.0:1746126623.556351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.556402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.556477:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721659008 00000100:00100000:1.0:1746126623.556484:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721659008 00002000:00100000:1.0:1746126623.556520:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880093232d80 x1830945721659008/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.556529:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232d80 with x1830945721659008 ext(2097152->3145727) 00002000:00010000:1.0:1746126623.556533:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093232d80 00000100:00100000:1.0:1746126623.556560:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721659264 00000100:00100000:1.0:1746126623.556563:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721659264 00002000:00100000:1.0:1746126623.556574:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093233b80 x1830945721659264/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.556580:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233b80 with x1830945721659264 ext(3145728->4194303) 00002000:00010000:1.0:1746126623.556582:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093233b80 00000100:00100000:3.0:1746126623.556589:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7995 00000100:00100000:1.0:1746126623.556594:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7996 00000100:00100000:3.0:1746126623.556597:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721659008:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126623.556599:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721659264:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.573080:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721659008:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16475us (16726us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.573090:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7995 00002000:00100000:3.0:1746126623.573101:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880093232d80 x1830945721659008/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.573108:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093232d80 with x1830945721659008 ext(2097152->3145727) 00002000:00010000:3.0:1746126623.573114:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093232d80 00000100:00100000:2.0:1746126623.582180:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721659264:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25572us (25769us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.582189:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7996 00002000:00100000:2.0:1746126623.582199:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880093233b80 x1830945721659264/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.582208:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093233b80 with x1830945721659264 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.582213:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093233b80 00000100:00100000:0.0:1746126623.590222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.590325:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721659392 00000100:00100000:3.0:1746126623.590332:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721659392 00000100:00100000:3.0:1746126623.590769:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13996 00000100:00100000:3.0:1746126623.590778:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31514:x1830945721659392:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126623.590793:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.590806:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e759 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.590937:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.590944:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 19 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.590950:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.590951:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.590955:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2473984->3145727] (req 2473984->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.590979:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 19 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.590988:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 19 pid: 23766 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746126623.591000:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721447040:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.593136:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.593148:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.593158:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721447168:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.594321:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126623.599641:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721447040:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.601162:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721447168:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.601187:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2473984->3145727] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.601202:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28400, rc 0) 00000100:00100000:3.0:1746126623.601240:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31514:x1830945721659392:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10463us (11024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.601247:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13996 00000100:00100000:0.0:1746126623.603921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.604000:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721659520 00000100:00100000:1.0:1746126623.604011:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721659520 00010000:00010000:1.0:1746126623.604053:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 20 pid: 23766 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746126623.604094:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7308 00000100:00100000:1.0:1746126623.604101:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721659520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.604112:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.604129:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 20 pid: 23766 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.604140:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 20 pid: 23766 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.604158:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099078800/0xb50e825867614a19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e71a expref: 20 pid: 23766 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.604189:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.604224:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721659520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.604230:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7308 00000100:00100000:0.0:1746126623.608792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.609654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.609702:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721659776 00000100:00100000:3.0:1746126623.609705:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721659904 00000100:00100000:3.0:1746126623.609710:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721659904 00000100:00100000:2.0:1746126623.609710:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721659776 00010000:00010000:3.0:1746126623.609738:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.609757:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9046 00000100:00100000:2.0:1746126623.609765:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+234:31527:x1830945721659776:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126623.609767:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7309 00000100:00100000:3.0:1746126623.609777:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721659904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.609782:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.609788:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.609797:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64200/0xb50e825867614aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e760 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.609804:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.609814:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.609844:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356c2e00/0xb50e825867614a12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e713 expref: 13 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.609860:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.609861:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.609866:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.609873:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.609896:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126623.609900:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 12 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.609906:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126623.609910:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721447296:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126623.609914:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.609924:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.609930:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.609935:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:3.0:1746126623.609977:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19000 going to sleep for 11 seconds 00010000:00010000:2.0:1746126623.610026:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614aba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610034:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614aba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610040:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614aba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126623.610047:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126623.610125:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610135:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610143:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610147:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef65800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.610150:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610155:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610162:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126623.610164:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.610167:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610171:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65800/0xb50e825867614aac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610183:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610187:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610191:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610195:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef65a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.610197:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610201:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610209:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fed00) 00010000:00010000:2.0:1746126623.610211:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.610213:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610216:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614ab3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.610244:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64200/0xb50e825867614aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e760 expref: 237 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.610253:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614aba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e760 expref: 236 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.610258:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.610260:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746126623.610261:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65000, rc 0) 00000100:00100000:2.0:1746126623.610285:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+236:31527:x1830945721659776:12345-192.168.203.2@tcp:101:cat.0 Request processed in 521us (1500us total) trans 8589943242 rc 0/0 00000100:00100000:2.0:1746126623.610290:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9046 00000100:00100000:2.0:1746126623.615110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.615167:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721447296:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126623.615182:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126623.615222:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721659904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5448us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.615231:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7309 00000100:00100000:2.0:1746126623.615558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.615583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.615598:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721660544 00000100:00100000:2.0:1746126623.615602:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721660544 00002000:00100000:2.0:1746126623.615629:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2473984->2478079) req@ffff880099251f80 x1830945721660544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.615638:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251f80 with x1830945721660544 ext(2473984->2478079) 00002000:00010000:2.0:1746126623.615642:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251f80 00000100:00100000:2.0:1746126623.615653:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7997 00000100:00100000:2.0:1746126623.615657:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721660544:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.615780:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721660160 00000100:00100000:3.0:1746126623.615783:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721660160 00000100:00100000:3.0:1746126623.615807:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3847 00000100:00100000:3.0:1746126623.615811:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+236:31527:x1830945721660160:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1746126623.616032:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721660288 00000100:00100000:0.0:1746126623.616036:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721660288 00000100:00100000:0.0:1746126623.616532:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 708 00000100:00100000:0.0:1746126623.616538:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+237:1964:x1830945721660288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126623.616546:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126623.616564:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614aba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e760 expref: 237 pid: 15560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.616706:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+237:31527:x1830945721660160:12345-192.168.203.2@tcp:35:cat.0 Request processed in 894us (1608us total) trans 8589943243 rc 0/0 00000100:00100000:3.0:1746126623.616712:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3847 00000100:00100000:2.0:1746126623.616924:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721660544:12345-192.168.203.2@tcp:3:cat.0 Request processed in 1265us (1338us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126623.616931:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7997 00002000:00100000:2.0:1746126623.616936:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2473984->2478079) req@ffff880099251f80 x1830945721660544/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.616942:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251f80 with x1830945721660544 ext(2473984->2478079) 00002000:00010000:2.0:1746126623.616945:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099251f80 00010000:00010000:0.0:1746126623.617003:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126623.617007:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126623.617037:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:1964:x1830945721660288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 499us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126623.617042:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 708 00000100:00100000:0.0:1746126623.620758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.620796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.621325:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721660672 00000100:00100000:3.0:1746126623.621332:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721660672 00000100:00100000:3.0:1746126623.621371:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721660800 00000100:00100000:3.0:1746126623.621373:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721660800 00000100:00100000:3.0:1746126623.621389:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13997 00000100:00100000:3.0:1746126623.621395:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721660672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.621409:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.621423:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867614ac8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e767 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.621465:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721447424:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126623.621537:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.621954:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13998 00000100:00100000:1.0:1746126623.621962:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721660800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.621970:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.621979:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e76e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.621996:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.621998:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.622004:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.622029:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.622038:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e85600, rc 0) 00000100:00100000:1.0:1746126623.622065:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721660800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 105us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.622070:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13998 00000100:00100000:0.0:1746126623.632239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.633049:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721660928 00000100:00100000:2.0:1746126623.633056:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721660928 00000100:00100000:2.0:1746126623.633097:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13999 00000100:00100000:2.0:1746126623.633104:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31514:x1830945721660928:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.633118:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.633131:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e775 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.633154:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.633162:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.633168:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.633170:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.633173:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2387967] (req 2097152->2387967) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.633196:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.633206:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 23 pid: 8436 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126623.633216:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099253b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721447552:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.633295:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.633303:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.633310:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721447680:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.633329:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746126623.633466:0:23766:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime: 1746126622 -> 1746126623 00002000:00010000:3.0:1746126623.633469:0:23766:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126622 -> 1746126623 00002000:00010000:3.0:1746126623.633471:0:23766:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime: 1746126622 -> 1746126623 00000100:00100000:3.0:1746126623.633485:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721447424:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126623.633504:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867614ac8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e767 expref: 20 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.633512:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c29000/0xb50e825867614ac8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e767 expref: 20 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.633523:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29000, rc 0) 00000100:00100000:3.0:1746126623.633544:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721660672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 12149us (12792us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126623.633549:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13997 00000100:00100000:2.0:1746126623.637817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.637940:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661056 00000100:00100000:1.0:1746126623.637946:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661056 00010000:00010000:1.0:1746126623.637973:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 24 pid: 8436 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746126623.637995:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7310 00000100:00100000:1.0:1746126623.638001:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721661056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.638012:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.638041:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 24 pid: 8436 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.638051:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 24 pid: 8436 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.638074:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.638118:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721661056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 117us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.638124:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7310 00010000:00010000:0.0:1746126623.638316:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e85600/0xb50e825867614acf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e76e expref: 23 pid: 8436 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746126623.638339:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099253b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721447552:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126623.638348:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721447680:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126623.638368:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->2387967] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.638377:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65200, rc 0) 00000100:00100000:0.0:1746126623.638404:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31514:x1830945721660928:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5301us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126623.638410:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13999 00000100:00100000:2.0:1746126623.647082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.647138:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661184 00000100:00100000:0.0:1746126623.647147:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661184 00010000:00010000:0.0:1746126623.647176:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.647218:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7311 00000100:00100000:0.0:1746126623.647225:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721661184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126623.647236:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126623.647254:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.647264:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.647282:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c28600/0xb50e825867614a97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e752 expref: 13 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.647305:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.647307:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.647312:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.647318:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.647344:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 12 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126623.647356:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721447808:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126623.647428:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.653717:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721447808:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126623.653736:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.653793:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721661184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6567us (6715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.653802:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7311 00000100:00100000:0.0:1746126623.656581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.656634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.656645:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661312 00000100:00100000:2.0:1746126623.656652:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661312 00000100:00100000:2.0:1746126623.656699:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14000 00000100:00100000:2.0:1746126623.656706:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721661312:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.656719:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.656733:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64a00/0xb50e825867614add lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e77c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.656775:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721447936:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126623.657944:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126623.659413:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661568 00000100:00100000:3.0:1746126623.659420:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661568 00002000:00100000:3.0:1746126623.659458:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2383872->2387967) req@ffff880099253b80 x1830945721661568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.659467:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253b80 with x1830945721661568 ext(2383872->2387967) 00002000:00010000:3.0:1746126623.659472:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099253b80 00000100:00100000:3.0:1746126623.659492:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7998 00000100:00100000:3.0:1746126623.659498:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721661568:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.659633:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721661568:12345-192.168.203.2@tcp:3:cat.0 Request processed in 134us (2998us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126623.659639:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7998 00002000:00100000:3.0:1746126623.659644:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2383872->2387967) req@ffff880099253b80 x1830945721661568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.659650:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099253b80 with x1830945721661568 ext(2383872->2387967) 00002000:00010000:3.0:1746126623.659653:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099253b80 00000100:00100000:2.0:1746126623.661698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.661747:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661696 00000100:00100000:1.0:1746126623.661752:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661696 00000100:00100000:1.0:1746126623.661796:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14001 00000100:00100000:1.0:1746126623.661802:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721661696:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.661813:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.661842:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e84400/0xb50e825867614ae4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e783 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.661881:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721448064:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126623.661949:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.664258:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721447936:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126623.664283:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64a00/0xb50e825867614add lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e77c expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.664294:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64a00/0xb50e825867614add lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e77c expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.664320:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64a00, rc 0) 00000100:00100000:2.0:1746126623.664364:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721661312:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7658us (7789us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126623.664375:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14000 00000100:00100000:1.0:1746126623.670493:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721448064:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126623.670524:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e84400/0xb50e825867614ae4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e783 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.670536:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e84400/0xb50e825867614ae4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e783 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.670550:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e84400, rc 0) 00000100:00100000:1.0:1746126623.670605:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721661696:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8802us (8909us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126623.670616:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14001 00000100:00100000:0.0:1746126623.678702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.678824:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661824 00000100:00100000:1.0:1746126623.678854:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661824 00000100:00100000:1.0:1746126623.678898:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14002 00000100:00100000:1.0:1746126623.678905:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:31527:x1830945721661824:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.678919:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.678933:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e78a expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.678957:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.678964:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126623.678966:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126623.678969:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.678993:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 11 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.679003:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 11 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.679025:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721448192:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.679100:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.683256:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721448192:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126623.683284:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 20 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.683300:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e85200, rc 0) 00000100:00100000:1.0:1746126623.683350:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+20:31527:x1830945721661824:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4444us (4654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.683357:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14002 00000100:00100000:0.0:1746126623.684650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.685468:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721661952 00000100:00100000:2.0:1746126623.685475:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721661952 00002000:00100000:2.0:1746126623.685513:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2473984->3145727) req@ffff88008f15ca80 x1830945721661952/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.685522:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15ca80 with x1830945721661952 ext(2473984->3145727) 00010000:00010000:2.0:1746126623.685531:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 12 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.685543:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 12 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746126623.685549:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f15ca80 00000100:00100000:2.0:1746126623.685583:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1831 00000100:00100000:2.0:1746126623.685589:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721661952:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126623.693378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.693738:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721662080 00000100:00100000:1.0:1746126623.693746:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721662080 00000100:00100000:1.0:1746126623.693782:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9047 00000100:00100000:1.0:1746126623.693788:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31529:x1830945721662080:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126623.693813:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.693846:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85800/0xb50e825867614af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e791 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.693894:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.693909:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.693918:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.693929:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.693937:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.693942:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.694033:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.694041:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.694047:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.694070:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.694078:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 23 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.694087:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721448320:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.694165:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126623.695583:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721661952:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9991us (10932us total) trans 21474840444 rc 0/0 00000100:00100000:3.0:1746126623.695593:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1831 00002000:00100000:3.0:1746126623.695600:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2473984->3145727) req@ffff88008f15ca80 x1830945721661952/t21474840444(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/448 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.695608:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15ca80 with x1830945721661952 ext(2473984->3145727) 00010000:00010000:3.0:1746126623.695615:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 14 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.695624:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 14 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.695630:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f15ca80 00000100:00100000:0.0:1746126623.698393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.698638:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721662336 00000100:00100000:3.0:1746126623.698645:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721662336 00000100:00100000:1.0:1746126623.698853:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721448320:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126623.698873:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746126623.698928:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3848 00000100:00100000:3.0:1746126623.698935:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:15413:x1830945721662336:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126623.699223:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.699450:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:15413:x1830945721662336:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 514us (1060us total) trans 8589943244 rc 0/0 00000100:00100000:3.0:1746126623.699457:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3848 00000100:00100000:2.0:1746126623.700263:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721662464 00000100:00100000:2.0:1746126623.700268:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721662464 00010000:00010000:2.0:1746126623.700287:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 14 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.700306:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7312 00000100:00100000:2.0:1746126623.700311:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721662464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.700319:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.700335:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 14 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.700344:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 14 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.700466:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28400/0xb50e825867614a9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e759 expref: 14 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.700491:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.700493:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.700499:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.700507:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.700532:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.700542:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721448448:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126623.700711:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.702565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.702657:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721448448:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126623.702670:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.702695:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721662464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2383us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.702702:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7312 00000100:00100000:2.0:1746126623.702719:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721662592 00000100:00100000:2.0:1746126623.702722:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721662592 00010000:00010000:2.0:1746126623.702736:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 25 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.703185:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7313 00000100:00100000:2.0:1746126623.703192:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721662592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.703205:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.703210:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 25 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.703219:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 25 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.703235:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce7cc00/0xb50e825867614a2e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e728 expref: 25 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.703246:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.703250:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.703257:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.703262:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.703276:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.703294:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721662592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.703298:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7313 00010000:00010000:1.0:1746126623.703518:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703525:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126623.703556:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126623.703560:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126623.703571:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703579:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703587:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703592:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703597:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703602:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e85600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126623.703604:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703610:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703617:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126623.703620:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126623.703622:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703625:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85600/0xb50e825867614af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703647:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703652:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703656:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703659:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e85400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126623.703662:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703665:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703671:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093949600) 00010000:00010000:1.0:1746126623.703672:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126623.703674:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703678:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85400/0xb50e825867614b00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.703708:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e85800/0xb50e825867614af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.703717:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.703722:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.703724:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126623.703725:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e84400, rc 0) 00000100:00100000:1.0:1746126623.703759:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31529:x1830945721662080:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 9971us (10387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.703764:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9047 00000100:00100000:0.0:1746126623.704562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.704718:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721662848 00000100:00100000:3.0:1746126623.704722:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721662848 00002000:00100000:3.0:1746126623.704748:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880093df7800 x1830945721662848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.704755:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df7800 with x1830945721662848 ext(2097152->3145727) 00002000:00010000:3.0:1746126623.704759:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df7800 00000100:00100000:3.0:1746126623.704783:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7999 00000100:00100000:3.0:1746126623.704788:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721662848:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126623.709142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.709177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.709234:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721662976 00000100:00100000:2.0:1746126623.709240:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721662976 00000100:00100000:2.0:1746126623.709273:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721663104 00000100:00100000:2.0:1746126623.709274:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721663104 00000100:00100000:2.0:1746126623.709296:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14003 00000100:00100000:2.0:1746126623.709302:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721662976:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126623.709316:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.709329:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e798 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.709346:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.709348:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.709356:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.709367:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 7 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.709375:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64200, rc 0) 00000100:00100000:2.0:1746126623.709410:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721662976:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.709415:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14003 00000100:00100000:2.0:1746126623.709429:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14004 00000100:00100000:2.0:1746126623.709433:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721663104:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126623.709440:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.709447:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e79f expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.709457:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.709458:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.709461:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.709468:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.709474:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64000, rc 0) 00000100:00100000:2.0:1746126623.709488:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721663104:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 55us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.709492:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14004 00000100:00080000:2.0:1746126623.709544:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746126623.709547:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126623.712528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.712572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.712955:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721663232 00000100:00100000:3.0:1746126623.712962:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721663232 00000100:00100000:1.0:1746126623.713071:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721663360 00000100:00100000:1.0:1746126623.713074:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721663360 00000100:00100000:1.0:1746126623.713104:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14005 00000100:00100000:1.0:1746126623.713110:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721663360:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126623.713123:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.713136:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009394f800/0xb50e825867614b1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7ad expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.713174:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721448576:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126623.713231:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126623.713269:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14006 00000100:00100000:3.0:1746126623.713274:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721663232:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126623.713280:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.713287:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7a6 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.713298:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.713300:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.713306:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.713316:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 8 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.713323:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c28a00, rc 0) 00000100:00100000:3.0:1746126623.713340:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721663232:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 67us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.713345:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14006 00000100:00100000:3.0:1746126623.716465:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721662848:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11669us (11896us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.716475:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7999 00002000:00100000:3.0:1746126623.716485:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff880093df7800 x1830945721662848/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.716499:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df7800 with x1830945721662848 ext(2097152->3145727) 00002000:00010000:3.0:1746126623.716504:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093df7800 00000100:00100000:1.0:1746126623.717925:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721448576:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126623.717951:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009394f800/0xb50e825867614b1c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7ad expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.717962:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009394f800/0xb50e825867614b1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7ad expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.717978:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009394f800, rc 0) 00000100:00100000:1.0:1746126623.718966:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721663360:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 5851us (6389us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126623.718974:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14005 00000100:00100000:0.0:1746126623.722293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.722439:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721663488 00000100:00100000:1.0:1746126623.722446:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721663488 00000100:00100000:1.0:1746126623.722490:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14007 00000100:00100000:1.0:1746126623.722496:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:31527:x1830945721663488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.722514:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.722529:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7b4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.722552:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.722558:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126623.722560:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126623.722562:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.722585:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 11 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.722594:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 11 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.722605:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721448704:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.722675:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.724636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.724703:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721663744 00000100:00100000:1.0:1746126623.724708:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721663744 00000100:00100000:1.0:1746126623.724747:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9048 00000100:00100000:1.0:1746126623.724753:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31529:x1830945721663744:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126623.724767:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.724781:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009394e600/0xb50e825867614b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7bb expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.724881:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.724894:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.724901:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.724921:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.724929:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 10 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.724937:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721448832:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.724994:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.729002:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830945721448704:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126623.729037:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.729051:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009394e200, rc 0) 00000100:00100000:1.0:1746126623.729095:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:31527:x1830945721663488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6598us (6808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.729101:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14007 00000100:00100000:1.0:1746126623.731498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.731585:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721663872 00000100:00100000:3.0:1746126623.731591:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721663872 00002000:00100000:3.0:1746126623.731626:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2387967) req@ffff88008dab8000 x1830945721663872/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.731634:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8000 with x1830945721663872 ext(2097152->2387967) 00010000:00010000:3.0:1746126623.731642:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.731653:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.731658:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dab8000 00000100:00100000:3.0:1746126623.731684:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1832 00000100:00100000:3.0:1746126623.731690:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1963:x1830945721663872:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126623.735945:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830945721448832:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126623.735966:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746126623.738340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.739043:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664000 00000100:00100000:1.0:1746126623.739051:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664000 00010000:00010000:1.0:1746126623.739080:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 11 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.739102:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7314 00000100:00100000:1.0:1746126623.739109:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721664000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.739119:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.739124:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 11 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.739134:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 11 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.739151:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e84400/0xb50e825867614b07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e791 expref: 11 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.739172:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.739176:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.739183:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.739189:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.739205:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.739239:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721664000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 131us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.739245:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7314 00010000:00010000:1.0:1746126623.739265:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.739270:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126623.739284:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126623.739386:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009394e600/0xb50e825867614b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7bb expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.739398:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7bb expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.739403:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.739405:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126623.739407:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c9a00, rc 0) 00000100:00100000:1.0:1746126623.739434:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31529:x1830945721663744:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 14681us (14802us total) trans 8589943245 rc 0/0 00000100:00100000:1.0:1746126623.739439:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9048 00000100:00100000:0.0:1746126623.742627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.742859:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664256 00000100:00100000:1.0:1746126623.742866:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664256 00000100:00100000:1.0:1746126623.742899:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9049 00000100:00100000:1.0:1746126623.742905:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31529:x1830945721664256:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126623.742922:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.742925:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746126623.742946:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9a00/0xb50e825867614b38 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7bb expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.742963:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.742966:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126623.742976:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c8800/0xb50e825867614b46 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7c2 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.743054:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.743064:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126623.743072:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126623.743080:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126623.743162:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c8800/0xb50e825867614b46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.743173:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.743179:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.743181:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126623.743183:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c9400, rc 0) 00000100:00100000:1.0:1746126623.743230:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31529:x1830945721664256:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 323us (606us total) trans 8589943246 rc 0/0 00000100:00100000:1.0:1746126623.743236:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9049 00000100:00100000:3.0:1746126623.745057:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721663872:12345-192.168.203.2@tcp:4:cat.0 Request processed in 13361us (13559us total) trans 17179873297 rc 0/0 00000100:00100000:3.0:1746126623.745067:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1832 00002000:00100000:3.0:1746126623.745075:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2387967) req@ffff88008dab8000 x1830945721663872/t17179873297(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/448 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.745083:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8000 with x1830945721663872 ext(2097152->2387967) 00010000:00010000:3.0:1746126623.745091:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 14 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.745106:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 14 pid: 4640 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.745112:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dab8000 00000100:00100000:2.0:1746126623.746055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.746128:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664384 00000100:00100000:3.0:1746126623.746134:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664384 00000100:00100000:3.0:1746126623.746473:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9050 00000100:00100000:3.0:1746126623.746480:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31529:x1830945721664384:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126623.746496:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.746510:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e73a00/0xb50e825867614b5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7c9 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.746550:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e73a00/0xb50e825867614b5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.746561:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e73a00/0xb50e825867614b5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c9 expref: 12 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.746574:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126623.746577:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126623.746579:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e73a00, rc 0) 00000100:00100000:3.0:1746126623.746606:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31529:x1830945721664384:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 127us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.746611:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9050 00000100:00100000:0.0:1746126623.749792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.749813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.749859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.749889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.749901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.749919:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664512 00000100:00100000:0.0:1746126623.749926:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664512 00000100:00100000:0.0:1746126623.749952:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664768 00000100:00100000:0.0:1746126623.749954:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664768 00000100:00100000:0.0:1746126623.749963:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664896 00000100:00100000:0.0:1746126623.749965:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664896 00000100:00100000:0.0:1746126623.749972:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665024 00000100:00100000:0.0:1746126623.749974:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665024 00000100:00100000:0.0:1746126623.749982:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665152 00000100:00100000:0.0:1746126623.749983:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665152 00000100:00100000:0.0:1746126623.749995:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14008 00000100:00100000:0.0:1746126623.750001:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721664512:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126623.750046:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750062:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750069:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750076:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750081:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.750083:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.750086:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750110:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750120:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 12 pid: 8436 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.750131:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721448960:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126623.750192:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 10 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750198:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 10 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746126623.750210:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721449088:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126623.750227:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750233:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 19 pid: 10890 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.750238:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721449216:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.750249:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14009 00000100:00100000:0.0:1746126623.750249:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126623.750256:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721664768:12345-192.168.203.2@tcp:1:mirror_io.0 00000100:00100000:0.0:1746126623.750264:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14010 00000100:00100000:0.0:1746126623.750268:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721664896:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:3.0:1746126623.750275:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750281:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.750286:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750289:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.750293:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750296:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.750300:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750301:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750305:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.750306:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.750307:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.750307:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.750309:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750309:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750320:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.750325:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750326:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 9 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.750333:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.750333:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721449344:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.750341:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721449472:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126623.750350:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750356:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746126623.750362:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721449600:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.750369:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 9 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750377:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.750381:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 9 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746126623.750383:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.750388:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721449728:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126623.750389:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721449856:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126623.750399:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaea80 going to sleep for 11 seconds 00010000:00010000:3.0:1746126623.750409:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 13 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.750416:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 13 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.750417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.750423:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721449984:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126623.750429:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665280 00000100:00100000:0.0:1746126623.750431:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665280 00000100:00100000:3.0:1746126623.750433:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.750441:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14011 00000100:00100000:0.0:1746126623.750445:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721665024:12345-192.168.203.2@tcp:1:mirror_io.0 00000100:00100000:3.0:1746126623.750448:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14012 00000100:00100000:3.0:1746126623.750454:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721665152:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126623.750457:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750465:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.750470:0:17475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750471:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750476:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.750478:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750481:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.750483:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.750485:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750485:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.750490:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.750491:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.750493:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750495:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750500:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.750506:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 10 pid: 4640 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126623.750511:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721450112:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.750514:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 10 pid: 4640 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746126623.750522:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721450240:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126623.750526:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750532:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746126623.750538:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099370000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721450368:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.750541:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 19 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.750550:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.750556:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746126623.750562:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099372680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721450624:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126623.750568:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.750618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.750633:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721664640 00000100:00100000:0.0:1746126623.750636:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721664640 00010000:00010000:0.0:1746126623.750651:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 14 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.750667:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7315 00000100:00100000:0.0:1746126623.750671:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721664640:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126623.750679:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126623.750694:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 14 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.750703:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 14 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.751027:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14013 00000100:00100000:1.0:1746126623.751034:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721665280:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126623.751049:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.751807:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 19 pid: 10890 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.751820:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721450496:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.751868:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746126623.752126:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.752131:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.752136:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126623.752138:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.752159:0:9686:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.752167:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.752230:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65200/0xb50e825867614ad6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e775 expref: 14 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126623.752252:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.752253:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126623.752258:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.752264:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.752281:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126623.752289:0:7892:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 23 pid: 8436 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.752296:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099373100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721450880:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126623.752452:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.763845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.763866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.763891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.764143:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721449088:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.764154:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721449216:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.764161:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721448960:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.764180:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.764310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.764412:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721449344:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126623.764420:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721449600:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.764493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.764555:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665536 00000100:00100000:3.0:1746126623.764561:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665536 00010000:00010000:3.0:1746126623.764587:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 20 pid: 10890 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.764606:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665408 00000100:00100000:3.0:1746126623.764607:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665408 00010000:00010000:3.0:1746126623.764614:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 11 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746126623.764625:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665664 00000100:00100000:3.0:1746126623.764627:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665664 00010000:00010000:3.0:1746126623.764634:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 11 pid: 4641 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746126623.764641:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665792 00000100:00100000:3.0:1746126623.764643:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665792 00010000:00010000:3.0:1746126623.764650:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 13 pid: 8436 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126623.764660:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7316 00000100:00100000:3.0:1746126623.764666:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721665536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126623.764677:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126623.764693:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 20 pid: 10890 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.764701:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 20 pid: 10890 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.764719:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a9fc00/0xb50e825867614908 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e695 expref: 20 pid: 10890 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.764735:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126623.764766:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721665536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 101us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.764772:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7316 00000100:00100000:3.0:1746126623.764785:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7317 00000100:00100000:3.0:1746126623.764789:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721665408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126623.764795:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126623.764801:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 11 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.764808:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 11 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.764818:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614b0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e798 expref: 11 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.764843:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126623.764859:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721665408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.764864:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7317 00000100:00100000:3.0:1746126623.764873:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7318 00000100:00100000:3.0:1746126623.764877:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721665664:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126623.764883:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126623.764894:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 11 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.764901:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 11 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.764911:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f75bc00/0xb50e82586761478e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5b5 expref: 11 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126623.764922:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126623.764934:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721665664:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 57us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.764938:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7318 00000100:00100000:3.0:1746126623.764946:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7319 00000100:00100000:3.0:1746126623.764950:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1966:x1830945721665792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126623.764955:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126623.764962:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 13 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.764968:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 13 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.764977:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cc2800/0xb50e825867614940 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6b1 expref: 13 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.764984:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.764986:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.764989:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.764996:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.765011:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126623.765034:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1966:x1830945721665792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 84us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.765039:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7319 00000100:00100000:3.0:1746126623.765059:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721449472:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.765212:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721449856:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126623.765228:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.765248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.765286:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721450112:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.765322:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099372680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721450624:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126623.765353:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099373100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721450880:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126623.765361:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.765378:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1964:x1830945721664640:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 14707us (14760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.765385:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7315 00000100:00100000:1.0:1746126623.765421:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721665920 00000100:00100000:1.0:1746126623.765424:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721665920 00010000:00010000:1.0:1746126623.765436:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746126623.765444:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666048 00000100:00100000:1.0:1746126623.765445:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666048 00010000:00010000:1.0:1746126623.765453:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.765460:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7320 00000100:00100000:1.0:1746126623.765464:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721665920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.765470:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.765477:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765484:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765498:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099212000/0xb50e825867614836 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e61e expref: 13 pid: 8436 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765508:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.765520:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721665920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 56us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.765524:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7320 00000100:00100000:1.0:1746126623.765534:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7321 00000100:00100000:1.0:1746126623.765538:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721666048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.765543:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.765550:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.765557:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.765568:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135648800/0xb50e8258676149a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6db expref: 24 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.765574:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.765585:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721666048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.765590:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7321 00000100:00100000:1.0:1746126623.765630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.765641:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666432 00000100:00100000:1.0:1746126623.765643:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666432 00010000:00010000:1.0:1746126623.765652:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746126623.765662:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7322 00000100:00100000:1.0:1746126623.765666:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721666432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.765672:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126623.765678:0:7892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2077 -> 2079 00010000:00010000:1.0:1746126623.765682:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765689:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765698:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f75ba00/0xb50e8258676147a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5bc expref: 10 pid: 4641 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765706:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.765719:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721666432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 52us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.765723:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7322 00000100:00100000:1.0:1746126623.765765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.765775:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666304 00000100:00100000:1.0:1746126623.765777:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666304 00010000:00010000:1.0:1746126623.765786:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 9 pid: 4640 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746126623.765796:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7323 00000100:00100000:1.0:1746126623.765800:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721666304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.765804:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.765812:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 9 pid: 4640 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765819:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 9 pid: 4640 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746126623.765846:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.765860:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1966:x1830945721666304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 60us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.765865:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7323 00000100:00100000:1.0:1746126623.765895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.765904:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666560 00000100:00100000:1.0:1746126623.765906:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666560 00010000:00010000:1.0:1746126623.765915:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.765925:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7324 00000100:00100000:1.0:1746126623.765929:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721666560:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.765934:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.765941:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.765948:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.765961:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a03800/0xb50e8258676147d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5df expref: 19 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.765969:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.765982:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1966:x1830945721666560:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 52us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.765986:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7324 00000100:00100000:1.0:1746126623.766042:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099370000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721450368:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126623.766055:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.766101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.766113:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666944 00000100:00100000:1.0:1746126623.766116:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666944 00010000:00010000:1.0:1746126623.766126:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 18 pid: 10890 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.766136:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7325 00000100:00100000:1.0:1746126623.766140:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721666944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.766145:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.766151:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 18 pid: 10890 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.766158:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 18 pid: 10890 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.766172:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.766173:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.766176:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.766182:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.766192:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.766205:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721666944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.766210:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7325 00010000:00010000:2.0:1746126623.766608:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766615:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766630:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766636:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766646:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766651:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec80e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126623.766654:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766660:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766668:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766673:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec80e00/0xb50e825867614b62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.766715:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721664512:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 16714us (16929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.766721:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14008 00010000:00010000:2.0:1746126623.766795:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c28a00/0xb50e825867614b23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7a6 expref: 7 pid: 4640 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126623.766802:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721450240:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.766809:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e85200/0xb50e825867614aeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e78a expref: 17 pid: 10890 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.766819:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721450496:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.766853:0:17475:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766860:0:17475:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766864:0:17475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766876:0:17475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766881:0:17475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766887:0:17475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766891:0:17475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b42bd600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126623.766894:0:17475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766899:0:17475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766912:0:17475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.766917:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b42bd600/0xb50e825867614b7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.766953:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721665152:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 16499us (17050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.766958:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14012 00000100:00100000:3.0:1746126623.767264:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721449728:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126623.767272:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721449984:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126623.767288:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126623.769466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.769498:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.769521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.769536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.769559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.769621:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666688 00000100:00100000:2.0:1746126623.769627:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666688 00010000:00010000:2.0:1746126623.769652:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.769670:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721667072 00000100:00100000:2.0:1746126623.769672:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721667072 00010000:00010000:2.0:1746126623.769680:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.769701:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666176 00000100:00100000:2.0:1746126623.769703:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666176 00010000:00010000:2.0:1746126623.769711:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 10 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126623.769717:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721666816 00000100:00100000:2.0:1746126623.769719:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721666816 00010000:00010000:2.0:1746126623.769727:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126623.769736:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7326 00000100:00100000:2.0:1746126623.769741:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721666688:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.769751:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.769765:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.769774:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.769797:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a0400/0xb50e825867614733 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e57d expref: 23 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.769808:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.769810:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.769813:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.769820:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.769856:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.769886:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721666688:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 144us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.769892:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7326 00000100:00100000:2.0:1746126623.769904:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7327 00000100:00100000:2.0:1746126623.769908:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721667072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.769914:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.769923:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.769930:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.769940:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cc2a00/0xb50e82586761499b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e6d4 expref: 12 pid: 4640 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.769947:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.769960:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721667072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.769964:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7327 00000100:00100000:2.0:1746126623.769971:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7328 00000100:00100000:2.0:1746126623.769975:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721666176:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.769980:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.769985:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 10 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126623.769991:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 10 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126623.769999:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef64000/0xb50e825867614b15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e79f expref: 10 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126623.770008:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.770010:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.770012:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.770029:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.770040:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.770051:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721666176:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 75us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.770055:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7328 00000100:00100000:2.0:1746126623.770063:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7329 00000100:00100000:2.0:1746126623.770067:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721666816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.770072:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.770082:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126623.770088:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126623.770099:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78000/0xb50e82586761483d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e625 expref: 12 pid: 4640 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126623.770106:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.770107:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.770109:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.770114:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.770124:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.770136:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721666816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.770140:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7329 00010000:00010000:3.0:1746126623.770316:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770323:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770339:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770345:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770350:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770356:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c28e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126623.770359:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770369:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770378:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.770383:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c28e00/0xb50e825867614b69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.770423:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721664768:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 20168us (20608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.770429:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14009 00000100:00100000:3.0:1746126623.770448:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721667328 00000100:00100000:3.0:1746126623.770451:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721667328 00002000:00100000:3.0:1746126623.770471:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099372300 x1830945721667328/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.770479:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099372300 with x1830945721667328 ext(2097152->3145727) 00010000:00010000:3.0:1746126623.770484:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.770493:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.770499:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099372300 00000100:00100000:3.0:1746126623.770511:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1833 00000100:00100000:3.0:1746126623.770515:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721667328:12345-192.168.203.2@tcp:3:cat.0 00010000:00010000:1.0:1746126623.772406:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772416:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772438:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772443:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772449:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772459:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f131400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126623.772461:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772466:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772478:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772483:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f131400/0xb50e825867614b77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.772546:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1966:x1830945721665024:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 22097us (22653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.772553:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14011 00010000:00010000:1.0:1746126623.772573:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772580:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772592:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772598:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772603:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772607:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ec80a00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126623.772609:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772614:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772622:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.772627:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec80a00/0xb50e825867614b70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.772654:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721664896:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 22385us (22795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.772659:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14010 00000100:00100000:3.0:1746126623.783687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.783735:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721667584 00000100:00100000:2.0:1746126623.783742:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721667584 00000100:00100000:2.0:1746126623.783773:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9051 00000100:00100000:2.0:1746126623.783779:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+236:31531:x1830945721667584:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.783796:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.783810:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65600/0xb50e825867614b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7d0 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.783919:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.783929:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.783937:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.783946:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.783953:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.783958:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.784043:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.784053:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.784058:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.784082:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.784090:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 11 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.784100:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721451008:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.786612:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a48333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.790200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.790305:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721451008:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.790324:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:1.0:1746126623.790500:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721667712 00000100:00100000:1.0:1746126623.790506:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721667712 00010000:00010000:1.0:1746126623.790530:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 12 pid: 14549 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.790550:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7330 00000100:00100000:1.0:1746126623.790556:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:1966:x1830945721667712:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.790569:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.790573:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 12 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.790581:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 12 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.790598:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800937c9400/0xb50e825867614b4d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c2 expref: 12 pid: 14549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.790609:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126623.790613:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126623.790620:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126623.790625:0:7072:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:1.0:1746126623.790639:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.790672:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721667712:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.790678:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7330 00000100:00100000:3.0:1746126623.791085:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721667328:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20568us (21524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126623.791091:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1833 00002000:00100000:3.0:1746126623.791097:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099372300 x1830945721667328/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.791104:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099372300 with x1830945721667328 ext(2097152->3145727) 00010000:00010000:3.0:1746126623.791110:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.791120:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.791125:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099372300 00010000:00010000:2.0:1746126623.791330:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791339:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126623.791351:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126623.791431:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791437:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791442:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791446:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef65200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.791449:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791454:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791463:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.791465:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126623.791468:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791472:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65200/0xb50e825867614ba1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791490:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791495:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791502:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791505:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef64600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.791507:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791511:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791517:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126623.791519:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.791522:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791526:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64600/0xb50e825867614b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791533:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791537:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791541:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791544:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef65000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.791546:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791550:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791558:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fed00) 00010000:00010000:2.0:1746126623.791559:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.791561:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791565:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65000/0xb50e825867614b9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.791599:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65600/0xb50e825867614b8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d0 expref: 238 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.791605:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65600/0xb50e825867614b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d0 expref: 238 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.791611:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65600, rc 0) 00000100:00100000:2.0:1746126623.791632:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+237:31531:x1830945721667584:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7853us (7952us total) trans 8589943247 rc 301/301 00000100:00100000:2.0:1746126623.791638:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9051 00000100:00100000:2.0:1746126623.805183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.807192:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721667840 00000100:00100000:1.0:1746126623.807201:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721667840 00000100:00100000:1.0:1746126623.807242:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14014 00000100:00100000:1.0:1746126623.807248:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:31527:x1830945721667840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.807262:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.807278:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7d7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126623.807298:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c71f, atime: 0x6813c71e, ctime: 0x6813c71f, blocks: 0x163f 00010000:00010000:1.0:1746126623.807313:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.807315:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.807321:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.807331:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.807338:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c9400, rc 0) 00000100:00100000:1.0:1746126623.807379:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+18:31527:x1830945721667840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 131us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.807384:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14014 00000100:00100000:0.0:1746126623.808208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.808271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.808329:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721667968 00000100:00100000:1.0:1746126623.808333:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721667968 00010000:00010000:1.0:1746126623.808352:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126623.808368:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7331 00000100:00100000:1.0:1746126623.808373:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721667968:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126623.808381:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126623.808395:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.808407:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.808422:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009394e200/0xb50e825867614b2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7b4 expref: 22 pid: 8436 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746126623.808436:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.808437:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.808440:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808447:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808464:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126623.808485:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721667968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 112us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.808490:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7331 00010000:00010000:1.0:1746126623.808506:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808513:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808528:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808538:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808545:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808550:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800937c8800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126623.808553:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808559:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808569:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808574:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614b85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.808609:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1966:x1830945721665280:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 57575us (58191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.808614:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14013 00000100:00100000:1.0:1746126623.808625:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721668096 00000100:00100000:1.0:1746126623.808627:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721668096 00000100:00100000:1.0:1746126623.808642:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14015 00000100:00100000:1.0:1746126623.808646:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+18:31531:x1830945721668096:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126623.808654:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.808663:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7de expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126623.808674:0:9686:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c71e, atime: 0x6813c71d, ctime: 0x6813c71e, blocks: 0x79f 00010000:00010000:1.0:1746126623.808683:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.808684:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.808688:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808697:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 19 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.808703:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c9800, rc 0) 00000100:00100000:1.0:1746126623.808718:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+19:31531:x1830945721668096:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.808723:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14015 00000100:00100000:0.0:1746126623.816371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.816396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.817158:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721668352 00000100:00100000:3.0:1746126623.817166:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721668352 00002000:00100000:3.0:1746126623.817201:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880099370380 x1830945721668352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.817210:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370380 with x1830945721668352 ext(3145728->4194303) 00002000:00010000:3.0:1746126623.817214:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370380 00000100:00100000:3.0:1746126623.817228:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721668608 00000100:00100000:3.0:1746126623.817230:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721668608 00002000:00100000:3.0:1746126623.817238:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (618496->622591) req@ffff880099370700 x1830945721668608/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.817249:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370700 with x1830945721668608 ext(618496->622591) 00002000:00010000:3.0:1746126623.817251:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370700 00000100:00100000:2.0:1746126623.817482:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8000 00000100:00100000:2.0:1746126623.817490:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721668352:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126623.818742:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8001 00000100:00100000:3.0:1746126623.818750:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721668608:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126623.818844:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721668608:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 96us (2447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126623.818850:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8001 00002000:00100000:3.0:1746126623.818855:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (618496->622591) req@ffff880099370700 x1830945721668608/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.818862:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370700 with x1830945721668608 ext(618496->622591) 00002000:00010000:3.0:1746126623.818866:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370700 00000100:00100000:0.0:1746126623.824769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.824873:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721668864 00000100:00100000:2.0:1746126623.824880:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721668864 00000100:00100000:2.0:1746126623.824913:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9052 00000100:00100000:2.0:1746126623.824919:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31533:x1830945721668864:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.824939:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.824954:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7e5 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.825044:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825054:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825062:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825072:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825077:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825081:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825155:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825162:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825166:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126623.825173:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126623.825227:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825232:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825240:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825244:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef64800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.825248:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825252:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825261:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.825263:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126623.825266:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825270:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64800/0xb50e825867614bd2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825297:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825301:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825305:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825309:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef64e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.825311:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825315:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825323:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126623.825324:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.825326:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825330:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64e00/0xb50e825867614bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825336:0:15560:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825339:0:15560:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825343:0:15560:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825346:0:15560:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef65400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.825348:0:15560:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825352:0:15560:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825356:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe500) 00010000:00010000:2.0:1746126623.825357:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.825359:0:15560:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825363:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65400/0xb50e825867614bcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126623.825387:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7e5 expref: 26 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.825394:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7e5 expref: 26 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.825399:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65a00, rc 0) 00000100:00100000:2.0:1746126623.825451:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31533:x1830945721668864:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 532us (689us total) trans 8589943248 rc 301/301 00000100:00100000:2.0:1746126623.825457:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9052 00000100:00100000:0.0:1746126623.827111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.827254:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721669120 00000100:00100000:2.0:1746126623.827260:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721669120 00000100:00100000:2.0:1746126623.827284:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9053 00000100:00100000:2.0:1746126623.827290:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31529:x1830945721669120:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:2.0:1746126623.827316:0:15560:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.827334:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e73a00/0xb50e825867614b5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7c9 expref: 11 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.827346:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.827349:0:15560:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.827398:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31529:x1830945721669120:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 108us (291us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746126623.827404:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9053 00000100:00100000:2.0:1746126623.833881:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721668352:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16381us (17506us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.833892:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8000 00002000:00100000:2.0:1746126623.833902:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880099370380 x1830945721668352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.833916:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099370380 with x1830945721668352 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.833920:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099370380 00000100:00100000:0.0:1746126623.841477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.841557:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721669888 00000100:00100000:2.0:1746126623.841564:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721669888 00000100:00100000:2.0:1746126623.841595:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9054 00000100:00100000:2.0:1746126623.841601:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31536:x1830945721669888:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.841620:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.841635:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65e00/0xb50e825867614be0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7ec expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.842525:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842536:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842545:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842556:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842561:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842565:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842648:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842659:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842664:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746126623.842670:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126623.842734:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842740:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842744:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842749:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef65a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.842752:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842756:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842764:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126623.842766:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126623.842769:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.842773:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65a00/0xb50e825867614bf5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843350:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843359:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843364:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843368:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef64c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.843370:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843375:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843382:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126623.843385:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.843387:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843391:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64c00/0xb50e825867614be7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843399:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843403:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843407:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843410:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef64a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126623.843412:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843420:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843424:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e3fe500) 00010000:00010000:2.0:1746126623.843426:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126623.843427:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843431:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef64a00/0xb50e825867614bee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746126623.843460:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65e00/0xb50e825867614be0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7ec expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.843466:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef65e00/0xb50e825867614be0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7ec expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.843472:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65e00, rc 0) 00000100:00100000:2.0:1746126623.845055:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31536:x1830945721669888:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3448us (3579us total) trans 8589943249 rc 301/301 00000100:00100000:2.0:1746126623.845064:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9054 00000100:00100000:0.0:1746126623.849902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.850061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.850106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.850176:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721669504 00000100:00100000:3.0:1746126623.850184:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721669504 00000100:00100000:3.0:1746126623.850227:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3849 00000100:00100000:3.0:1746126623.850234:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:31529:x1830945721669504:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:3.0:1746126623.850410:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31529:x1830945721669504:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 176us (515us total) trans 8589943250 rc 0/0 00000100:00100000:3.0:1746126623.850416:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3849 00000100:00100000:1.0:1746126623.850634:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721670016 00000100:00100000:1.0:1746126623.850639:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721670016 00000100:00100000:1.0:1746126623.850659:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14016 00000100:00100000:1.0:1746126623.850664:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:31527:x1830945721670016:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.850673:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.850689:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7f3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126623.850705:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c71f, atime: 0x6813c71f, ctime: 0x6813c71f, blocks: 0x102b 00010000:00010000:1.0:1746126623.850719:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.850721:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.850726:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.850738:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.850745:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e73a00, rc 0) 00000100:00100000:1.0:1746126623.850764:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:31527:x1830945721670016:12345-192.168.203.2@tcp:101:cat.0 Request processed in 100us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.850768:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14016 00000100:00100000:2.0:1746126623.851009:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721669632 00000100:00100000:2.0:1746126623.851021:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721669632 00002000:00100000:2.0:1746126623.851047:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (884736->888831) req@ffff88009e804a80 x1830945721669632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.851054:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804a80 with x1830945721669632 ext(884736->888831) 00002000:00010000:2.0:1746126623.851059:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804a80 00000100:00100000:2.0:1746126623.851071:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8002 00000100:00100000:2.0:1746126623.851077:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721669632:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126623.851499:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+19:1966:x1830945721669632:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 420us (1436us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126623.851506:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8002 00002000:00100000:2.0:1746126623.851511:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (884736->888831) req@ffff88009e804a80 x1830945721669632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/4536 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.851517:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e804a80 with x1830945721669632 ext(884736->888831) 00002000:00010000:2.0:1746126623.851520:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e804a80 00000100:00100000:0.0:1746126623.851722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.852035:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721670272 00000100:00100000:2.0:1746126623.852039:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721670272 00000100:00100000:2.0:1746126623.852849:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3850 00000100:00100000:2.0:1746126623.852857:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31536:x1830945721670272:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1746126623.853470:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31536:x1830945721670272:12345-192.168.203.2@tcp:35:cat.0 Request processed in 613us (1747us total) trans 8589943251 rc 0/0 00000100:00100000:2.0:1746126623.853477:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3850 00010000:00010000:0.0:1746126623.857253:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126623.868427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.869062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.869094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.869115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.869127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.869133:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721670784 00000100:00100000:0.0:1746126623.869138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.869142:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721670784 00000100:00100000:0.0:1746126623.869152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.869165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126623.869176:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3851 00000100:00100000:3.0:1746126623.869182:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31529:x1830945721670784:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:0.0:1746126623.869194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.869268:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721670912 00000100:00100000:2.0:1746126623.869272:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721670912 00000100:00100000:2.0:1746126623.869292:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671040 00000100:00100000:2.0:1746126623.869294:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671040 00000100:00100000:2.0:1746126623.869304:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671168 00000100:00100000:2.0:1746126623.869306:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671168 00000100:00100000:2.0:1746126623.869314:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671296 00000100:00100000:2.0:1746126623.869316:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671296 00000100:00100000:2.0:1746126623.869324:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671424 00000100:00100000:2.0:1746126623.869325:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671424 00000100:00100000:2.0:1746126623.869332:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671552 00000100:00100000:2.0:1746126623.869334:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671552 00000100:00100000:2.0:1746126623.869342:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14017 00000100:00100000:3.0:1746126623.869345:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31529:x1830945721670784:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 162us (282us total) trans 8589943252 rc 0/0 00000100:00100000:2.0:1746126623.869347:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721670912:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126623.869351:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3851 00010000:00010000:2.0:1746126623.869355:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126623.869361:0:31004:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671808 00000100:00100000:3.0:1746126623.869364:0:31004:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671808 00010000:00010000:2.0:1746126623.869368:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef65200/0xb50e825867614c0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e7fa expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126623.869375:0:31004:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3852 00000100:00100000:3.0:1746126623.869378:0:31004:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+237:31531:x1830945721671808:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126623.869405:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721451136:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126623.869457:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.869475:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14018 00000100:00100000:2.0:1746126623.869480:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721671040:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.869487:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.869497:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e801 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126623.869513:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c71e, atime: 0x6813c71d, ctime: 0x6813c71e, blocks: 0x821 00010000:00010000:2.0:1746126623.869522:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.869524:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.869530:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.869542:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 14 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.869550:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65400, rc 0) 00000100:00100000:1.0:1746126623.869604:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14019 00000100:00100000:1.0:1746126623.869611:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721671168:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.869618:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.869626:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e808 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126623.869637:0:9686:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71b, ctime: 0x6813c71c, blocks: 0x821 00010000:00010000:1.0:1746126623.869646:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.869647:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.869651:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 15 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.869660:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 15 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.869666:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800937c8800, rc 0) 00000100:00100000:3.0:1746126623.870054:0:31004:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27c713d7-92e0-4974-b612-500c641c1d6c+238:31531:x1830945721671808:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 673us (858us total) trans 8589943253 rc 0/0 00000100:00100000:3.0:1746126623.870059:0:31004:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3852 00000100:00100000:3.0:1746126623.870075:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14020 00000100:00100000:3.0:1746126623.870080:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721671296:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.870202:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.870211:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e80f expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126623.870224:0:10890:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71a, ctime: 0x6813c71c, blocks: 0x81f 00010000:00010000:3.0:1746126623.870232:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.870233:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.870237:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.870246:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.870252:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c79800, rc 0) 00000100:00100000:3.0:1746126623.870270:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721671296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 189us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.870275:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14020 00000100:00100000:3.0:1746126623.870286:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14021 00000100:00100000:3.0:1746126623.870290:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721671424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.870296:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.870302:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e816 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.870311:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.870312:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.870315:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.870323:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.870329:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c78600, rc 0) 00000100:00100000:3.0:1746126623.870343:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721671424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 52us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.870347:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14021 00000100:00100000:3.0:1746126623.870356:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14022 00000100:00100000:3.0:1746126623.870360:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721671552:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.870366:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.870372:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e81d expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.870382:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.870384:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.870387:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.870395:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 16 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.870400:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c78c00, rc 0) 00000100:00100000:3.0:1746126623.870414:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721671552:12345-192.168.203.2@tcp:101:cat.0 Request processed in 54us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.870418:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14022 00000100:00100000:2.0:1746126623.870902:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721671040:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1421us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.870911:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14018 00000100:00100000:2.0:1746126623.870950:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721670528 00000100:00100000:2.0:1746126623.870953:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721670528 00000100:00100000:1.0:1746126623.870962:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721671168:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1351us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.870967:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14019 00002000:00100000:2.0:1746126623.870974:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e806d80 x1830945721670528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.870982:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806d80 with x1830945721670528 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.870986:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e806d80 00000100:00100000:2.0:1746126623.870996:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8003 00000100:00100000:2.0:1746126623.870999:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721670528:12345-192.168.203.2@tcp:3:multiop.0 00002000:00010000:2.0:1746126623.882504:0:17475:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime: 1746126622 -> 1746126623 00002000:00010000:2.0:1746126623.882511:0:17475:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime: 1746126621 -> 1746126623 00002000:00010000:2.0:1746126623.882513:0:17475:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime: 1746126622 -> 1746126623 00000100:00100000:2.0:1746126623.882532:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721451136:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126623.882564:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef65200/0xb50e825867614c0a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7fa expref: 14 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.882576:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef65200/0xb50e825867614c0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7fa expref: 14 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.882603:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65200, rc 0) 00000100:00100000:2.0:1746126623.882653:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1963:x1830945721670912:12345-192.168.203.2@tcp:101:cat.0 Request processed in 13305us (13557us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126623.882661:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14017 00000100:00100000:2.0:1746126623.900167:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721670528:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 29158us (31738us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.900182:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8003 00002000:00100000:2.0:1746126623.900190:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e806d80 x1830945721670528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.900199:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e806d80 with x1830945721670528 ext(3145728->4194303) 00002000:00010000:2.0:1746126623.900204:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e806d80 00000100:00100000:0.0:1746126623.904717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.904779:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721671936 00000100:00100000:2.0:1746126623.904787:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721671936 00000100:00100000:2.0:1746126623.904917:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14023 00000100:00100000:2.0:1746126623.904924:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+13:31536:x1830945721671936:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.905343:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.905357:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e824 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.905379:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 18 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.905386:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126623.905388:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126623.905390:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 14 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.905412:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 18 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.905421:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 18 pid: 9686 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.905437:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721451264:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.905792:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.909602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.909621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.909719:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721451264:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.910046:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 14 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.910061:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64200, rc 0) 00000100:00100000:2.0:1746126623.910101:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31536:x1830945721671936:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5177us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.910107:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14023 00000100:00100000:3.0:1746126623.910425:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672320 00000100:00100000:3.0:1746126623.910430:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672320 00002000:00100000:3.0:1746126623.910466:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88012d91b480 x1830945721672320/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.910474:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b480 with x1830945721672320 ext(4194304->4976639) 00002000:00010000:3.0:1746126623.910478:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91b480 00000100:00100000:3.0:1746126623.910501:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672192 00000100:00100000:3.0:1746126623.910504:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672192 00002000:00100000:3.0:1746126623.910513:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (618496->888831) req@ffff88012d919180 x1830945721672192/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.910519:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919180 with x1830945721672192 ext(618496->888831) 00000100:00100000:0.0:1746126623.910521:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8004 00010000:00010000:3.0:1746126623.910524:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 20 pid: 9686 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126623.910529:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721672320:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:3.0:1746126623.910534:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 20 pid: 9686 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.910544:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d919180 00000100:00100000:3.0:1746126623.910556:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1834 00000100:00100000:3.0:1746126623.910561:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1966:x1830945721672192:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126623.915780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.915859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.915881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.915898:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672448 00000100:00100000:1.0:1746126623.915904:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672448 00000100:00100000:1.0:1746126623.915932:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672704 00000100:00100000:1.0:1746126623.915933:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672704 00000100:00100000:1.0:1746126623.915961:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672576 00000100:00100000:1.0:1746126623.915964:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672576 00000100:00100000:1.0:1746126623.915978:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14024 00000100:00100000:1.0:1746126623.915984:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721672448:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.915997:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.916011:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e82b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126623.916060:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721451392:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126623.916128:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126623.916145:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14025 00000100:00100000:1.0:1746126623.916150:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721672704:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.916157:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.916165:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e839 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.916176:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.916178:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.916183:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.916194:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.916201:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997db600, rc 0) 00000100:00100000:1.0:1746126623.916218:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721672704:12345-192.168.203.2@tcp:101:cat.0 Request processed in 68us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.916223:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14025 00000100:00100000:1.0:1746126623.916235:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14026 00000100:00100000:1.0:1746126623.916238:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721672576:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.916242:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.916246:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e832 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.916253:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.916255:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.916258:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.916264:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.916269:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997dba00, rc 0) 00000100:00100000:1.0:1746126623.916278:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721672576:12345-192.168.203.2@tcp:101:cat.0 Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.916284:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14026 00000100:00100000:1.0:1746126623.916318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126623.916329:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672832 00000100:00100000:1.0:1746126623.916331:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672832 00000100:00100000:1.0:1746126623.916344:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14027 00000100:00100000:1.0:1746126623.916347:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721672832:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126623.916352:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126623.916357:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e840 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126623.916364:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.916365:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126623.916368:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 26 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.916376:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 26 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126623.916381:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009394e400, rc 0) 00000100:00100000:1.0:1746126623.916392:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721672832:12345-192.168.203.2@tcp:101:cat.0 Request processed in 45us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126623.916396:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14027 00000100:00100000:1.0:1746126623.918480:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721672320:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 7947us (8879us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126623.918488:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8004 00002000:00100000:1.0:1746126623.918496:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88012d91b480 x1830945721672320/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 782336/782336 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.918506:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91b480 with x1830945721672320 ext(4194304->4976639) 00002000:00010000:1.0:1746126623.918510:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d91b480 00000100:00100000:0.0:1746126623.923241:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721451392:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126623.923265:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c3b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e82b expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.923276:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e82b expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126623.923295:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009394f800, rc 0) 00000100:00100000:0.0:1746126623.923328:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721672448:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7344us (7555us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126623.923334:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14024 00000100:00100000:3.0:1746126623.924552:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721672192:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 13985us (14925us total) trans 21474840445 rc 0/0 00000100:00100000:3.0:1746126623.924561:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1834 00002000:00100000:3.0:1746126623.924570:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (618496->888831) req@ffff88012d919180 x1830945721672192/t21474840445(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:384/0 lens 488/448 e 0 to 0 dl 1746126634 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126623.924578:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919180 with x1830945721672192 ext(618496->888831) 00010000:00010000:3.0:1746126623.924587:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 22 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126623.924609:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 22 pid: 9686 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126623.924616:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d919180 00000100:00100000:0.0:1746126623.928045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.928106:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721672960 00000100:00100000:2.0:1746126623.928113:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721672960 00000100:00100000:2.0:1746126623.928156:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14028 00000100:00100000:2.0:1746126623.928163:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721672960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126623.928178:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.928191:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4581400/0xb50e825867614c57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e847 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.928228:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721451520:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126623.928289:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126623.928917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.928976:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721673088 00000100:00100000:2.0:1746126623.928980:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721673088 00010000:00010000:2.0:1746126623.928995:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 24 pid: 9686 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.929069:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7332 00000100:00100000:2.0:1746126623.929076:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721673088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126623.929084:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126623.929099:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 24 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.929179:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 24 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.929196:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.929198:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.929203:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 13 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.929210:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 13 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.929232:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 13 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126623.929240:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721451648:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126623.929591:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00010000:00010000:2.0:1746126623.929755:0:8437:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff880134c3f800 x1830945721451520) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 24 pid: 9686 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126623.929774:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800937c9800/0xb50e825867614bb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 618496->888831) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7de expref: 24 pid: 9686 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.930312:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721451520:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126623.930332:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4581400/0xb50e825867614c57 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e847 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.930341:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4581400/0xb50e825867614c57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e847 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.930348:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4581400, rc 0) 00000100:00100000:2.0:1746126623.930646:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721672960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2482us (2605us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126623.930653:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14028 00000100:00100000:0.0:1746126623.933255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.933344:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721451648:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126623.933357:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126623.933389:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1966:x1830945721673088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4314us (4473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126623.933397:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7332 00000100:00100000:3.0:1746126623.933622:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721673216 00000100:00100000:3.0:1746126623.933627:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721673216 00000100:00100000:3.0:1746126623.933661:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14029 00000100:00100000:3.0:1746126623.933667:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721673216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126623.933681:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126623.933693:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e84e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126623.933715:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.933716:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126623.933722:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.933733:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126623.933740:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c386400, rc 0) 00000100:00100000:3.0:1746126623.933772:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721673216:12345-192.168.203.2@tcp:101:cat.0 Request processed in 105us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126623.933777:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14029 00000100:00100000:0.0:1746126623.944559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.944596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.944621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.944644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126623.944665:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721673472 00000100:00100000:0.0:1746126623.944671:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721673472 00002000:00100000:0.0:1746126623.944705:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093497800 x1830945721673472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.944714:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497800 with x1830945721673472 ext(0->1048575) 00002000:00010000:0.0:1746126623.944719:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093497800 00000100:00100000:0.0:1746126623.944746:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721673728 00000100:00100000:0.0:1746126623.944748:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721673728 00002000:00100000:0.0:1746126623.944761:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093497100 x1830945721673728/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.944767:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497100 with x1830945721673728 ext(1048576->2097151) 00002000:00010000:0.0:1746126623.944769:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093497100 00000100:00100000:0.0:1746126623.944778:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721674240 00000100:00100000:0.0:1746126623.944780:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721674240 00002000:00100000:0.0:1746126623.944794:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093494000 x1830945721674240/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126623.944800:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494000 with x1830945721674240 ext(1048576->2097151) 00002000:00010000:0.0:1746126623.944803:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093494000 00000100:00100000:0.0:1746126623.944810:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721674112 00000100:00100000:0.0:1746126623.944812:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721674112 00002000:00100000:0.0:1746126623.944821:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093495180 x1830945721674112/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/0 e 0 to 0 dl 1746126634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746126623.944883:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8005 00000100:00100000:1.0:1746126623.944892:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721673472:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126623.946081:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8006 00000100:00100000:1.0:1746126623.946089:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721673728:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:0.0:1746126623.947396:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495180 with x1830945721674112 ext(1048576->2097151) 00002000:00010000:0.0:1746126623.947401:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093495180 00000100:00100000:0.0:1746126623.947423:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8007 00000100:00100000:0.0:1746126623.947430:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721674240:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126623.947633:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8008 00000100:00100000:3.0:1746126623.947642:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721674112:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126623.971254:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721673472:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24866us (25204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126623.971271:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8005 00002000:00100000:1.0:1746126623.971284:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880093497800 x1830945721673472/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.971292:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497800 with x1830945721673472 ext(0->1048575) 00002000:00010000:1.0:1746126623.971297:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093497800 00000100:00100000:1.0:1746126623.972280:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721673728:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26189us (27679us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126623.972287:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8006 00002000:00100000:1.0:1746126623.972294:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880093497100 x1830945721673728/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126623.972301:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093497100 with x1830945721673728 ext(1048576->2097151) 00002000:00010000:1.0:1746126623.972304:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093497100 00000100:00100000:2.0:1746126623.976445:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721674112:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28796us (31791us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.976454:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8008 00002000:00100000:2.0:1746126623.976462:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff880093495180 x1830945721674112/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.976471:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093495180 with x1830945721674112 ext(1048576->2097151) 00002000:00010000:2.0:1746126623.976476:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093495180 00000100:00100000:2.0:1746126623.977809:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721674240:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30375us (33181us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126623.977817:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8007 00002000:00100000:2.0:1746126623.977854:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff880093494000 x1830945721674240/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:384/0 lens 488/440 e 0 to 0 dl 1746126634 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126623.977862:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093494000 with x1830945721674240 ext(1048576->2097151) 00002000:00010000:2.0:1746126623.977867:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093494000 00000100:00100000:0.0:1746126623.992646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126623.994099:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721674368 00000100:00100000:2.0:1746126623.994107:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721674368 00000100:00100000:2.0:1746126623.994158:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14030 00000100:00100000:2.0:1746126623.994165:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31533:x1830945721674368:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126623.994178:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126623.994247:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e855 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.994273:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.994280:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.994285:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.994287:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126623.994289:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3936256->4194303] (req 3936256->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.994311:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126623.994320:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126623.994330:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721451776:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126623.995107:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126623.995117:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 23 pid: 8437 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126623.995125:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721451904:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126623.995150:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126623.998251:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721451776:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126624.001201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.001237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.001867:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721674624 00000100:00100000:2.0:1746126624.001873:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721674624 00000100:00080000:2.0:1746126624.001899:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746126624.001928:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee38380 x1830945721674624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.001937:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38380 with x1830945721674624 ext(2097152->3145727) 00002000:00010000:2.0:1746126624.001941:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38380 00000100:00100000:1.0:1746126624.002038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.002345:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721675136 00000100:00100000:2.0:1746126624.002345:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721674880 00000100:00100000:2.0:1746126624.002349:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721674880 00000100:00100000:3.0:1746126624.002350:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721675136 00002000:00100000:2.0:1746126624.002368:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee3b800 x1830945721674880/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.002375:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3b800 with x1830945721674880 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.002377:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3b800 00002000:00100000:3.0:1746126624.002379:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880091da3b80 x1830945721675136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.002386:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3b80 with x1830945721675136 ext(2097152->3145727) 00000100:00080000:2.0:1746126624.002387:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746126624.002393:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 16 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126624.002397:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8009 00000100:00100000:2.0:1746126624.002402:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721674624:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:3.0:1746126624.002405:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 16 pid: 10890 timeout: 845 lvb_type: 1 00002000:00010000:3.0:1746126624.002414:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091da3b80 00000100:00100000:3.0:1746126624.002432:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1835 00000100:00100000:3.0:1746126624.002437:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721675136:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.002613:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8010 00000100:00100000:1.0:1746126624.002773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.002892:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721451904:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126624.002916:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3936256->4194303] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.002927:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009394e600, rc 0) 00000100:00100000:1.0:1746126624.002960:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31533:x1830945721674368:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8796us (10321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.002966:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14030 00000100:00100000:0.0:1746126624.003242:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721675392 00000100:00100000:0.0:1746126624.003246:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721675392 00002000:00100000:0.0:1746126624.003262:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880091da3480 x1830945721675392/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.003270:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3480 with x1830945721675392 ext(3145728->4194303) 00010000:00010000:0.0:1746126624.003274:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 18 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746126624.003282:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 18 pid: 10890 timeout: 845 lvb_type: 1 00002000:00010000:0.0:1746126624.003287:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091da3480 00000100:00100000:0.0:1746126624.003299:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1836 00000100:00100000:0.0:1746126624.003304:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721675392:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.010730:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721674880:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126624.014354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.014736:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721675520 00000100:00100000:2.0:1746126624.014744:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721675520 00010000:00010000:2.0:1746126624.014780:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 24 pid: 8437 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746126624.014819:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7333 00000100:00100000:2.0:1746126624.014842:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721675520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.014854:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.014868:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 24 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126624.014884:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 24 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126624.014908:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e73a00/0xb50e825867614c03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7f3 expref: 24 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126624.014923:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746126624.014996:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746126624.015036:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721675520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 210us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.015043:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7333 00000100:00100000:3.0:1746126624.015054:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721675136:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 12615us (13014us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.015063:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1835 00002000:00100000:3.0:1746126624.015070:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880091da3b80 x1830945721675136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.015078:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3b80 with x1830945721675136 ext(2097152->3145727) 00010000:00010000:3.0:1746126624.015083:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 17 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746126624.015094:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 17 pid: 10890 timeout: 845 lvb_type: 1 00002000:00010000:3.0:1746126624.015099:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091da3b80 00000100:00100000:2.0:1746126624.019687:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721675392:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 16373us (16904us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.019697:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1836 00002000:00100000:2.0:1746126624.019706:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880091da3480 x1830945721675392/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.019714:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da3480 with x1830945721675392 ext(3145728->4194303) 00010000:00010000:2.0:1746126624.019723:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.019735:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00002000:00010000:2.0:1746126624.019742:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091da3480 00000100:00100000:2.0:1746126624.026198:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721674880:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23569us (24950us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.026209:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8010 00002000:00100000:2.0:1746126624.026219:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009ee3b800 x1830945721674880/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.026228:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3b800 with x1830945721674880 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.026233:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee3b800 00000100:00100000:0.0:1746126624.026350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.026443:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721674624:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 24039us (25245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.026450:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8009 00002000:00100000:3.0:1746126624.026455:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009ee38380 x1830945721674624/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.026462:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee38380 with x1830945721674624 ext(2097152->3145727) 00002000:00010000:3.0:1746126624.026464:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee38380 00000100:00100000:1.0:1746126624.026810:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721675776 00000100:00100000:1.0:1746126624.026817:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721675776 00000100:00100000:1.0:1746126624.026881:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9055 00000100:00100000:1.0:1746126624.026887:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+238:31541:x1830945721675776:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126624.026902:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.026916:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1a00/0xb50e825867614c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e85c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.026992:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00000100:00080000:0.0:1746126624.027045:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746126624.027426:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027437:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027448:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027453:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027461:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027538:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027544:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027549:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126624.027554:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126624.027610:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027615:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027620:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027625:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c2a0800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126624.027628:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027634:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027643:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126624.027645:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126624.027648:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027656:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0800/0xb50e825867614c73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027670:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027674:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027678:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027681:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c2a1600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126624.027683:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027686:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027691:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ed3d100) 00010000:00010000:1.0:1746126624.027693:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126624.027694:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027698:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1600/0xb50e825867614c7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.027728:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a1a00/0xb50e825867614c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.027738:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 240 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.027747:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126624.027748:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126624.027750:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a0e00, rc 0) 00000100:00100000:1.0:1746126624.027777:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27c713d7-92e0-4974-b612-500c641c1d6c+240:31541:x1830945721675776:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 891us (1428us total) trans 8589943254 rc 0/0 00000100:00100000:1.0:1746126624.027782:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9055 00000100:00100000:0.0:1746126624.033170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.033221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.033291:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721675904 00000100:00100000:2.0:1746126624.033299:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721675904 00010000:00010000:2.0:1746126624.033330:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126624.033355:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7334 00000100:00100000:2.0:1746126624.033362:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721675904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.033373:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.033390:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.033401:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.033419:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c78c00/0xb50e825867614c2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e81d expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.033434:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.033436:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.033441:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.033448:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.033482:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 14 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.033492:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721452032:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.033562:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.033694:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721676032 00000100:00100000:1.0:1746126624.033697:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721676032 00000100:00100000:1.0:1746126624.033719:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14031 00000100:00100000:1.0:1746126624.033724:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31536:x1830945721676032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126624.033734:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.033744:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e863 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.033758:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.033764:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126624.033765:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126624.033767:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.033782:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.033791:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 16 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126624.033799:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721452160:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126624.033847:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.038026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.038084:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721676288 00000100:00100000:3.0:1746126624.038090:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721676288 00002000:00100000:3.0:1746126624.038126:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3936256->3940351) req@ffff8801367ebb80 x1830945721676288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.038134:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ebb80 with x1830945721676288 ext(3936256->3940351) 00010000:00010000:3.0:1746126624.038142:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126624.038153:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126624.038159:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801367ebb80 00000100:00100000:3.0:1746126624.038176:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1837 00000100:00100000:3.0:1746126624.038182:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721676288:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.038238:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721452032:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.038252:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.038287:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721675904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4925us (5065us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.038294:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7334 00000100:00100000:3.0:1746126624.038325:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1966:x1830945721676288:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 142us (313us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.038330:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1837 00002000:00100000:3.0:1746126624.038334:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3936256->3940351) req@ffff8801367ebb80 x1830945721676288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.038340:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367ebb80 with x1830945721676288 ext(3936256->3940351) 00010000:00010000:3.0:1746126624.038344:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 16 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126624.038353:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 16 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746126624.038363:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801367ebb80 00000100:00100000:1.0:1746126624.040025:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721452160:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126624.040048:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.040060:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2a0000, rc 0) 00000100:00100000:1.0:1746126624.040090:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31536:x1830945721676032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6366us (6927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.040689:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14031 00000100:00100000:0.0:1746126624.044781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.044855:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721676672 00000100:00100000:1.0:1746126624.044863:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721676672 00000100:00100000:1.0:1746126624.044908:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14032 00000100:00100000:1.0:1746126624.044915:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31533:x1830945721676672:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126624.044930:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.044943:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e86a expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.044965:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.044973:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126624.044983:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.044985:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.044987:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4849663] (req 4194304->4849663) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.045020:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126624.045030:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746126624.045041:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452288:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126624.046009:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.046026:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 21 pid: 8438 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746126624.046034:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452416:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126624.046688:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.046735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.046775:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721676544 00000100:00100000:0.0:1746126624.046780:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721676544 00002000:00100000:0.0:1746126624.046803:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3936256->4194303) req@ffff88012ddaf100 x1830945721676544/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.046816:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaf100 with x1830945721676544 ext(3936256->4194303) 00010000:00010000:0.0:1746126624.046822:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 15 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126624.046845:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 15 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746126624.046851:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ddaf100 00000100:00100000:0.0:1746126624.046874:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1838 00000100:00100000:0.0:1746126624.046880:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721676544:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126624.050621:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452288:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126624.050631:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452416:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126624.050654:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4849663] (req 4194304->4849663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.050672:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009394f800, rc 0) 00000100:00100000:1.0:1746126624.050719:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31533:x1830945721676672:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5804us (5943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.050727:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14032 00000100:00100000:0.0:1746126624.051284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.051503:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721676800 00000100:00100000:2.0:1746126624.051507:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721676800 00010000:00010000:2.0:1746126624.051527:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746126624.051601:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7335 00000100:00100000:2.0:1746126624.051608:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721676800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.051618:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.051632:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.051640:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.051661:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c78600/0xb50e825867614c26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e816 expref: 15 pid: 10890 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746126624.051790:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.051812:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1966:x1830945721676800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 204us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.051818:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7335 00000100:00100000:0.0:1746126624.053182:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721676544:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 6299us (6445us total) trans 17179873298 rc 0/0 00000100:00100000:0.0:1746126624.053189:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1838 00002000:00100000:0.0:1746126624.053196:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3936256->4194303) req@ffff88012ddaf100 x1830945721676544/t17179873298(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.053203:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddaf100 with x1830945721676544 ext(3936256->4194303) 00010000:00010000:0.0:1746126624.053210:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746126624.053218:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746126624.053223:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ddaf100 00000100:00100000:0.0:1746126624.054988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.055135:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721676928 00000100:00100000:2.0:1746126624.055141:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721676928 00010000:00010000:2.0:1746126624.055186:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 22 pid: 8438 timeout: 845 lvb_type: 0 00000100:00080000:1.0:1746126624.055333:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746126624.055435:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7336 00000100:00100000:2.0:1746126624.055442:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721676928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.055452:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.055467:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 22 pid: 8438 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126624.055476:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 22 pid: 8438 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746126624.055485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.055522:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721677056 00000100:00100000:3.0:1746126624.055525:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721677056 00010000:00010000:3.0:1746126624.055540:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746126624.055555:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7337 00000100:00100000:3.0:1746126624.055558:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721677056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.055565:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.055575:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126624.055587:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746126624.055587:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800937c9400/0xb50e825867614baf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e7d7 expref: 22 pid: 8438 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126624.055598:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009394e600/0xb50e825867614c65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e855 expref: 17 pid: 23766 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746126624.055610:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.055610:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.055612:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.055612:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.055617:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.055618:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.055624:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.055624:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.055648:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.055648:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.055658:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721452544:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.055658:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721452672:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.055813:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b1c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.056040:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.059549:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721452672:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.059566:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.059597:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721676928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4155us (4612us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.059605:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7336 00000100:00100000:3.0:1746126624.059697:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721452544:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126624.059706:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126624.059719:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721677056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4160us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.059723:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7337 00000100:00100000:0.0:1746126624.068515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.068552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.068577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.068608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.069106:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721677312 00000100:00100000:3.0:1746126624.069117:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721677312 00002000:00100000:3.0:1746126624.069153:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e9880 x1830945721677312/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.069165:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9880 with x1830945721677312 ext(2097152->3145727) 00002000:00010000:3.0:1746126624.069170:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9880 00000100:00100000:3.0:1746126624.069187:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721677568 00000100:00100000:3.0:1746126624.069189:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721677568 00002000:00100000:3.0:1746126624.069197:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8801367eb800 x1830945721677568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.069204:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb800 with x1830945721677568 ext(3145728->4194303) 00002000:00010000:3.0:1746126624.069206:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367eb800 00000100:00100000:3.0:1746126624.069217:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721677824 00000100:00100000:3.0:1746126624.069219:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721677824 00002000:00100000:3.0:1746126624.069227:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8801367e8380 x1830945721677824/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.069233:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8380 with x1830945721677824 ext(3145728->4194303) 00002000:00010000:3.0:1746126624.069235:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e8380 00000100:00100000:3.0:1746126624.069246:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721678080 00000100:00100000:3.0:1746126624.069247:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721678080 00002000:00100000:3.0:1746126624.069255:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (4845568->4849663) req@ffff8801367e9c00 x1830945721678080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.069262:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9c00 with x1830945721678080 ext(4845568->4849663) 00002000:00010000:3.0:1746126624.069264:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e9c00 00000100:00100000:3.0:1746126624.069277:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8011 00000100:00100000:3.0:1746126624.069283:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721677312:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.069746:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8012 00000100:00100000:2.0:1746126624.069754:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721677568:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126624.069937:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8013 00000100:00100000:0.0:1746126624.069944:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1963:x1830945721677824:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126624.071303:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8014 00000100:00100000:1.0:1746126624.071312:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721678080:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126624.071408:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721678080:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 97us (2799us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126624.071414:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8014 00002000:00100000:1.0:1746126624.071420:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4845568->4849663) req@ffff8801367e9c00 x1830945721678080/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.071427:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9c00 with x1830945721678080 ext(4845568->4849663) 00002000:00010000:1.0:1746126624.071432:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e9c00 00000100:00100000:2.0:1746126624.090423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.090677:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721677312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 21392us (22167us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.090687:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8011 00000100:00100000:0.0:1746126624.090687:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721678336 00000100:00100000:0.0:1746126624.090694:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721678336 00002000:00100000:3.0:1746126624.090696:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8801367e9880 x1830945721677312/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.090703:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e9880 with x1830945721677312 ext(2097152->3145727) 00002000:00010000:3.0:1746126624.090708:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367e9880 00000100:00100000:0.0:1746126624.090728:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3853 00000100:00100000:0.0:1746126624.090734:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31533:x1830945721678336:12345-192.168.203.2@tcp:35:multiop.0 00000100:00080000:1.0:1746126624.090763:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126624.090903:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31533:x1830945721678336:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 169us (485us total) trans 8589943255 rc 0/0 00000100:00100000:0.0:1746126624.090909:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3853 00000100:00100000:3.0:1746126624.098313:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721677568:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 28553us (29752us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.098322:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8012 00002000:00100000:3.0:1746126624.098331:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8801367eb800 x1830945721677568/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.098344:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb800 with x1830945721677568 ext(3145728->4194303) 00002000:00010000:3.0:1746126624.098349:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801367eb800 00000100:00100000:2.0:1746126624.098419:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721677824:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 28475us (29840us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.098426:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8013 00002000:00100000:2.0:1746126624.098430:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8801367e8380 x1830945721677824/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.098441:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8380 with x1830945721677824 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.098444:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367e8380 00000100:00100000:0.0:1746126624.105413:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.105560:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721678592 00000100:00100000:2.0:1746126624.105568:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721678592 00002000:00100000:2.0:1746126624.105610:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4849664->4976639) req@ffff8801367eb480 x1830945721678592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.105619:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb480 with x1830945721678592 ext(4849664->4976639) 00002000:00010000:2.0:1746126624.105624:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb480 00000100:00100000:2.0:1746126624.105665:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8015 00000100:00100000:2.0:1746126624.105672:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721678592:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.110895:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1964:x1830945721678592:12345-192.168.203.2@tcp:3:cat.0 Request processed in 5215us (5481us total) trans 0 rc 126976/126976 00000100:00100000:2.0:1746126624.110905:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8015 00002000:00100000:2.0:1746126624.110915:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4849664->4976639) req@ffff8801367eb480 x1830945721678592/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 126976/126976 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.110922:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb480 with x1830945721678592 ext(4849664->4976639) 00002000:00010000:2.0:1746126624.110928:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb480 00000100:00100000:0.0:1746126624.114438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.115766:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721678720 00000100:00100000:1.0:1746126624.115774:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721678720 00000100:00100000:1.0:1746126624.115862:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14033 00000100:00100000:1.0:1746126624.115870:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:31541:x1830945721678720:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126624.115886:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.115900:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e871 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.115921:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.115928:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126624.115929:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126624.115932:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2527232->3117055] (req 2527232->3117055) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.115952:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 13 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.115961:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 13 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.115971:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452800:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126624.116056:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.122477:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452800:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126624.122504:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2527232->3117055] (req 2527232->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.122518:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e43800, rc 0) 00000100:00100000:1.0:1746126624.122716:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:31541:x1830945721678720:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6846us (8283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.122724:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14033 00000100:00100000:0.0:1746126624.123198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.123551:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721678848 00000100:00100000:2.0:1746126624.123557:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721678848 00002000:00100000:2.0:1746126624.123587:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4849663) req@ffff8800937b8a80 x1830945721678848/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.123595:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8a80 with x1830945721678848 ext(4194304->4849663) 00010000:00010000:2.0:1746126624.123601:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 14 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.123613:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 14 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.123619:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937b8a80 00000100:00100000:2.0:1746126624.123645:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1839 00000100:00100000:2.0:1746126624.123651:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1963:x1830945721678848:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126624.149628:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721678848:12345-192.168.203.2@tcp:4:cat.0 Request processed in 25967us (26421us total) trans 21474840446 rc 0/0 00000100:00100000:3.0:1746126624.149638:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1839 00002000:00100000:3.0:1746126624.149646:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4849663) req@ffff8800937b8a80 x1830945721678848/t21474840446(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.149654:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8a80 with x1830945721678848 ext(4194304->4849663) 00010000:00010000:3.0:1746126624.149663:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.149674:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.149680:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937b8a80 00000100:00100000:0.0:1746126624.154234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.154286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.154364:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721678976 00000100:00100000:2.0:1746126624.154371:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721678976 00000100:00100000:2.0:1746126624.154589:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721679104 00000100:00100000:2.0:1746126624.154592:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721679104 00000100:00100000:1.0:1746126624.154621:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14034 00000100:00100000:1.0:1746126624.154629:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721678976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126624.154644:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.154659:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b40a00/0xb50e825867614ca4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e878 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126624.154700:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452928:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126624.154886:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14035 00000100:00100000:0.0:1746126624.154892:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721679104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126624.154900:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126624.154908:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e87f expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.154922:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.154924:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.154930:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.154943:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.154951:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f16f200, rc 0) 00000100:00100000:0.0:1746126624.154988:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721679104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 96us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126624.154994:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14035 00000100:00100000:1.0:1746126624.155512:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.161389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.161762:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721679232 00000100:00100000:3.0:1746126624.161770:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721679232 00010000:00010000:3.0:1746126624.161798:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.161858:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7338 00000100:00100000:3.0:1746126624.161865:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721679232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.161876:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746126624.161890:0:7073:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126622 -> 1746126623 00010000:00010000:3.0:1746126624.161897:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.161907:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.161928:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.161929:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.161935:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.161942:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.161969:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.161981:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721453056:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126624.162071:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746126624.163041:0:23766:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff8800a448d880 x1830945721452928) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.163059:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009394f800/0xb50e825867614c96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4849663) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e86a expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.163085:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721452928:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126624.163106:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b40a00/0xb50e825867614ca4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e878 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126624.163115:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b40a00/0xb50e825867614ca4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e878 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126624.163121:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b40a00, rc 0) 00000100:00100000:1.0:1746126624.163160:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721678976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8532us (8933us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126624.163167:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14034 00000100:00100000:0.0:1746126624.174153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.174211:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721679488 00000100:00100000:2.0:1746126624.174217:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721679488 00002000:00100000:2.0:1746126624.174250:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2527232->2531327) req@ffff8800937bbb80 x1830945721679488/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.174258:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bbb80 with x1830945721679488 ext(2527232->2531327) 00002000:00010000:2.0:1746126624.174262:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937bbb80 00000100:00100000:2.0:1746126624.174275:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8016 00000100:00100000:2.0:1746126624.174280:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721679488:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.174399:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721679488:12345-192.168.203.2@tcp:3:cat.0 Request processed in 119us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126624.174404:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8016 00002000:00100000:2.0:1746126624.174408:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2527232->2531327) req@ffff8800937bbb80 x1830945721679488/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.174415:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bbb80 with x1830945721679488 ext(2527232->2531327) 00002000:00010000:2.0:1746126624.174418:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937bbb80 00000100:00100000:2.0:1746126624.174459:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721453056:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.174473:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.174491:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1964:x1830945721679232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 12627us (13111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.174498:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7338 00000100:00100000:0.0:1746126624.182397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.182435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.182463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.182675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.182763:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721679744 00000100:00100000:3.0:1746126624.182770:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721679744 00002000:00100000:3.0:1746126624.182806:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800937ba680 x1830945721679744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.182814:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ba680 with x1830945721679744 ext(0->1048575) 00002000:00010000:3.0:1746126624.182819:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ba680 00000100:00100000:3.0:1746126624.182870:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721680000 00000100:00100000:3.0:1746126624.182874:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721680000 00002000:00100000:3.0:1746126624.182889:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800937b8700 x1830945721680000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.182896:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8700 with x1830945721680000 ext(1048576->2097151) 00002000:00010000:3.0:1746126624.182899:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937b8700 00000100:00100000:3.0:1746126624.182907:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721680256 00000100:00100000:3.0:1746126624.182909:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721680256 00002000:00100000:3.0:1746126624.182916:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800937b9180 x1830945721680256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.182921:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9180 with x1830945721680256 ext(1048576->2097151) 00002000:00010000:3.0:1746126624.182923:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937b9180 00000100:00100000:3.0:1746126624.182930:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721680512 00000100:00100000:3.0:1746126624.182931:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721680512 00002000:00100000:3.0:1746126624.182938:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800937b9500 x1830945721680512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.182943:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9500 with x1830945721680512 ext(1048576->2097151) 00002000:00010000:3.0:1746126624.182946:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9500 00000100:00100000:3.0:1746126624.182955:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8017 00000100:00100000:3.0:1746126624.182960:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721679744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126624.183797:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8018 00000100:00100000:1.0:1746126624.183805:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721680000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.184481:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8019 00000100:00100000:2.0:1746126624.184489:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721680256:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126624.184726:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8020 00000100:00100000:1.0:1746126624.184733:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721680512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.185373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.185388:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721680768 00000100:00100000:0.0:1746126624.185392:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721680768 00002000:00100000:0.0:1746126624.185412:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3112960->3117055) req@ffff880092ad1880 x1830945721680768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.185420:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1880 with x1830945721680768 ext(3112960->3117055) 00002000:00010000:0.0:1746126624.185424:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad1880 00000100:00100000:0.0:1746126624.185434:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8021 00000100:00100000:0.0:1746126624.185439:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721680768:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.185509:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721680768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 69us (137us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126624.185514:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8021 00002000:00100000:0.0:1746126624.185518:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x321:0x0] (3112960->3117055) req@ffff880092ad1880 x1830945721680768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.185524:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1880 with x1830945721680768 ext(3112960->3117055) 00002000:00010000:0.0:1746126624.185526:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad1880 00000100:00100000:1.0:1746126624.197638:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721680000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13825us (15192us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.197647:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8018 00002000:00100000:1.0:1746126624.197656:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800937b8700 x1830945721680000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.197665:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8700 with x1830945721680000 ext(1048576->2097151) 00002000:00010000:1.0:1746126624.197671:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937b8700 00000100:00100000:0.0:1746126624.199088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.200250:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721681024 00000100:00100000:1.0:1746126624.200257:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721681024 00000100:00100000:1.0:1746126624.200293:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3854 00000100:00100000:1.0:1746126624.200299:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+240:31541:x1830945721681024:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126624.200454:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+241:31541:x1830945721681024:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 155us (1368us total) trans 8589943256 rc 0/0 00000100:00100000:1.0:1746126624.200460:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3854 00000100:00100000:3.0:1746126624.201591:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721679744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18627us (19199us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.201600:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8017 00002000:00100000:3.0:1746126624.201607:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800937ba680 x1830945721679744/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.201615:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ba680 with x1830945721679744 ext(0->1048575) 00002000:00010000:3.0:1746126624.201620:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937ba680 00000100:00100000:2.0:1746126624.211708:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721680256:12345-192.168.203.2@tcp:3:cat.0 Request processed in 27213us (29236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.211989:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8019 00002000:00100000:2.0:1746126624.212000:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800937b9180 x1830945721680256/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.212008:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9180 with x1830945721680256 ext(1048576->2097151) 00002000:00010000:2.0:1746126624.212021:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937b9180 00000100:00100000:0.0:1746126624.220991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.221053:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721681280 00000100:00100000:1.0:1746126624.221061:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721681280 00000100:00100000:2.0:1746126624.221248:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721680512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36514us (38572us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.221256:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8020 00002000:00100000:2.0:1746126624.221266:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800937b9500 x1830945721680512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.221273:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b9500 with x1830945721680512 ext(1048576->2097151) 00002000:00010000:2.0:1746126624.221279:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937b9500 00000100:00100000:1.0:1746126624.221312:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9056 00000100:00100000:1.0:1746126624.221319:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31549:x1830945721681280:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126624.221335:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.221351:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31800/0xb50e825867614cb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e886 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.221432:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221447:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221457:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221467:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221472:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221476:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221557:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221565:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221571:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746126624.221578:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126624.221643:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221649:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221654:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221662:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed31a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126624.221665:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221670:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221679:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126624.221681:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126624.221685:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221689:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31a00/0xb50e825867614cb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221714:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221719:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221723:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221727:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed30a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126624.221729:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221733:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221739:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ed3d600) 00010000:00010000:1.0:1746126624.221741:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126624.221744:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221747:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30a00/0xb50e825867614cc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746126624.221775:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed31800/0xb50e825867614cb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 31 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.221784:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 30 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.221790:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126624.221792:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126624.221793:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed30800, rc 0) 00000100:00100000:1.0:1746126624.221816:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:31549:x1830945721681280:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 498us (832us total) trans 8589943257 rc 0/0 00000100:00100000:1.0:1746126624.221821:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9056 00000100:00100000:0.0:1746126624.242989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.243124:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721681408 00000100:00100000:1.0:1746126624.243132:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721681408 00000100:00100000:1.0:1746126624.243182:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14036 00000100:00100000:1.0:1746126624.243191:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721681408:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126624.243205:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.243219:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed31400/0xb50e825867614cd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e88d expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126624.243264:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721453184:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126624.243351:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.246070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.246103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.246128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.246154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.246349:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721681664 00000100:00100000:2.0:1746126624.246356:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721681664 00002000:00100000:2.0:1746126624.246391:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3735551) req@ffff8800a448f480 x1830945721681664/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 504/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.246400:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448f480 with x1830945721681664 ext(2097152->3735551) 00002000:00010000:2.0:1746126624.246405:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a448f480 00000100:00100000:2.0:1746126624.246417:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721681920 00000100:00100000:2.0:1746126624.246419:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721681920 00002000:00100000:2.0:1746126624.246429:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3735552->4194303) req@ffff88008dabaa00 x1830945721681920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.246435:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabaa00 with x1830945721681920 ext(3735552->4194303) 00002000:00010000:2.0:1746126624.246438:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabaa00 00000100:00100000:2.0:1746126624.246445:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721682176 00000100:00100000:2.0:1746126624.246447:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721682176 00002000:00100000:2.0:1746126624.246457:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dab8700 x1830945721682176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.246462:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8700 with x1830945721682176 ext(2097152->3145727) 00002000:00010000:2.0:1746126624.246465:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab8700 00000100:00100000:2.0:1746126624.246474:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721682432 00000100:00100000:2.0:1746126624.246475:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721682432 00002000:00100000:2.0:1746126624.246483:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008dab9f80 x1830945721682432/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.246489:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9f80 with x1830945721682432 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.246491:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dab9f80 00000100:00100000:2.0:1746126624.246501:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8022 00000100:00100000:2.0:1746126624.246507:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721681664:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126624.246730:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8023 00000100:00100000:3.0:1746126624.246740:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721681920:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126624.246901:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8024 00000100:00100000:3.0:1746126624.246908:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721682176:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.247089:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8025 00000100:00100000:0.0:1746126624.247096:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721682432:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126624.248788:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721453184:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126624.248812:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed31400/0xb50e825867614cd5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e88d expref: 16 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126624.248822:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed31400/0xb50e825867614cd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e88d expref: 16 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126624.248855:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed31400, rc 0) 00000100:00100000:1.0:1746126624.248913:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1966:x1830945721681408:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5723us (5931us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126624.248920:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14036 00000100:00100000:2.0:1746126624.256902:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721681920:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10157us (10790us total) trans 0 rc 458752/458752 00000100:00100000:2.0:1746126624.256913:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8023 00002000:00100000:2.0:1746126624.256923:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3735552->4194303) req@ffff88008dabaa00 x1830945721681920/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 458752/458752 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.256932:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabaa00 with x1830945721681920 ext(3735552->4194303) 00002000:00010000:2.0:1746126624.256937:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabaa00 00000100:00100000:0.0:1746126624.263458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.264282:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721682560 00000100:00100000:1.0:1746126624.264290:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721682560 00000100:00100000:1.0:1746126624.264330:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14037 00000100:00100000:1.0:1746126624.264338:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31553:x1830945721682560:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126624.264350:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.264368:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e894 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.264392:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.264399:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126624.264400:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126624.264404:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.264427:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.264436:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.264446:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721453312:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126624.264467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.264516:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.264551:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721682688 00000100:00100000:2.0:1746126624.264555:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721682688 00000100:00100000:2.0:1746126624.264576:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14038 00000100:00100000:2.0:1746126624.264582:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31549:x1830945721682688:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126624.264589:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.264598:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e89b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.264612:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.264620:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 27 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.264625:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.264626:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.264628:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2973696->3145727] (req 2973696->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.264643:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 27 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.264655:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 27 pid: 4640 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746126624.264663:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721453440:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.264693:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.264701:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.264709:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721453568:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.264728:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.265795:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721682432:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18697us (19637us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.265803:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8025 00002000:00100000:1.0:1746126624.265810:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008dab9f80 x1830945721682432/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.265818:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9f80 with x1830945721682432 ext(3145728->4194303) 00010000:00010000:1.0:1746126624.265824:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 26 pid: 4640 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.265853:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 26 pid: 4640 timeout: 846 lvb_type: 1 00002000:00010000:1.0:1746126624.265858:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dab9f80 00000100:00100000:1.0:1746126624.266820:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a448d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721453312:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126624.266861:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.266872:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed30400, rc 0) 00000100:00100000:1.0:1746126624.266898:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31553:x1830945721682560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2561us (3447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.266903:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14037 00000100:00100000:3.0:1746126624.268437:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721682176:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21525us (22303us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.268445:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8024 00002000:00100000:3.0:1746126624.268452:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008dab8700 x1830945721682176/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.268460:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8700 with x1830945721682176 ext(2097152->3145727) 00010000:00010000:3.0:1746126624.268467:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746126624.268476:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 846 lvb_type: 1 00002000:00010000:3.0:1746126624.268482:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008dab8700 00000100:00100000:0.0:1746126624.269394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.269693:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721682816 00000100:00100000:3.0:1746126624.269699:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721682816 00002000:00100000:3.0:1746126624.269723:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2527232->3117055) req@ffff880092ad0700 x1830945721682816/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.269730:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0700 with x1830945721682816 ext(2527232->3117055) 00010000:00010000:3.0:1746126624.269737:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.269749:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.269755:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad0700 00000100:00100000:2.0:1746126624.269882:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721453440:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.269892:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721453568:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.269911:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2973696->3145727] (req 2973696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.269923:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac15a00, rc 0) 00000100:00100000:2.0:1746126624.269951:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31549:x1830945721682688:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5368us (5484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.269958:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14038 00000100:00100000:3.0:1746126624.269983:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1840 00000100:00100000:3.0:1746126624.269989:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721682816:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126624.270323:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721681664:12345-192.168.203.2@tcp:3:cat.0 Request processed in 23816us (24257us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.270331:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8022 00002000:00100000:2.0:1746126624.270336:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3735551) req@ffff8800a448f480 x1830945721681664/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 504/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.270343:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a448f480 with x1830945721681664 ext(2097152->3735551) 00010000:00010000:2.0:1746126624.270347:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.270354:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 23 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.270359:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a448f480 00000100:00100000:0.0:1746126624.272751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.273324:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721682944 00000100:00100000:2.0:1746126624.273330:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721682944 00010000:00010000:2.0:1746126624.273357:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.274002:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7339 00000100:00100000:2.0:1746126624.274017:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721682944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.274028:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.274044:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.274055:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.274077:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2a0000/0xb50e825867614c8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e863 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.274109:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.274965:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721682944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 954us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.274972:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7339 00000100:00100000:0.0:1746126624.277196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.277450:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721683072 00000100:00100000:2.0:1746126624.277458:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721683072 00010000:00010000:2.0:1746126624.277922:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746126624.277944:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7340 00000100:00100000:2.0:1746126624.277951:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721683072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.277960:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.277976:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746126624.277986:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746126624.278003:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f16f200/0xb50e825867614cab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e87f expref: 24 pid: 4640 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746126624.278026:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.278029:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.278035:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.278042:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.278070:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.278082:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721453696:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.278155:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.278781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.279081:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721683200 00000100:00100000:3.0:1746126624.279086:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721683200 00000100:00100000:3.0:1746126624.279108:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14039 00000100:00100000:3.0:1746126624.279113:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31546:x1830945721683200:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.279124:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.279134:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8a2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.279150:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.279156:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.279157:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.279160:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.279178:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.279186:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 15 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.279195:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721453824:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126624.279231:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.280611:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721682816:12345-192.168.203.2@tcp:4:cat.0 Request processed in 10618us (11216us total) trans 21474840447 rc 0/0 00000100:00100000:3.0:1746126624.280620:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1840 00002000:00100000:3.0:1746126624.280628:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (2527232->3117055) req@ffff880092ad0700 x1830945721682816/t21474840447(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.280635:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad0700 with x1830945721682816 ext(2527232->3117055) 00010000:00010000:3.0:1746126624.280643:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.280650:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.280656:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad0700 00000100:00100000:2.0:1746126624.281412:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721453696:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.281425:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.281461:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721683072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3510us (4269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.281804:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7340 00000100:00100000:3.0:1746126624.282537:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721453824:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126624.282552:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.282564:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c889e00, rc 0) 00000100:00100000:3.0:1746126624.282585:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31546:x1830945721683200:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3471us (3805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.282590:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14039 00000100:00100000:2.0:1746126624.285520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.285760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.285883:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721683584 00000100:00100000:2.0:1746126624.285891:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721683584 00010000:00010000:2.0:1746126624.285920:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.285930:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721683456 00000100:00100000:3.0:1746126624.285934:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721683456 00000100:00100000:2.0:1746126624.285954:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7341 00002000:00100000:3.0:1746126624.285961:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2973696->2977791) req@ffff880134c3f800 x1830945721683456/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746126624.285961:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721683584:12345-192.168.203.2@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746126624.285969:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3f800 with x1830945721683456 ext(2973696->2977791) 00010000:00010000:2.0:1746126624.285971:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.285976:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.285985:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.285989:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.285990:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c3f800 00010000:00010000:2.0:1746126624.286000:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.286026:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e43800/0xb50e825867614c9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3117055) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e871 expref: 24 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.286742:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1841 00000100:00100000:3.0:1746126624.286749:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721683456:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.287084:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721683456:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 335us (1570us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.287090:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1841 00002000:00100000:3.0:1746126624.287096:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2973696->2977791) req@ffff880134c3f800 x1830945721683456/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.287102:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3f800 with x1830945721683456 ext(2973696->2977791) 00010000:00010000:3.0:1746126624.287106:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.287115:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.287125:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134c3f800 00010000:00010000:2.0:1746126624.287488:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.287490:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.287496:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.287503:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.287528:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.287538:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721453952:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.287759:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.292318:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721453952:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.292334:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.292511:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721683584:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6548us (6749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.292519:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7341 00000100:00100000:0.0:1746126624.292672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.292856:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721683840 00000100:00100000:2.0:1746126624.292861:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721683840 00002000:00100000:2.0:1746126624.292886:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2973696->3145727) req@ffff8800a5967480 x1830945721683840/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.292895:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967480 with x1830945721683840 ext(2973696->3145727) 00010000:00010000:2.0:1746126624.292901:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.292912:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.292918:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5967480 00000100:00100000:2.0:1746126624.293470:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1842 00000100:00100000:2.0:1746126624.293478:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721683840:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126624.294461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.294951:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721684096 00000100:00100000:1.0:1746126624.294957:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721684096 00002000:00100000:1.0:1746126624.294981:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5965180 x1830945721684096/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.294989:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965180 with x1830945721684096 ext(2097152->3145727) 00002000:00010000:1.0:1746126624.294993:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965180 00000100:00100000:1.0:1746126624.295023:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8026 00000100:00100000:1.0:1746126624.295029:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721684096:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.302313:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721683840:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 8828us (9633us total) trans 17179873299 rc 0/0 00000100:00100000:2.0:1746126624.302324:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1842 00002000:00100000:2.0:1746126624.302335:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2973696->3145727) req@ffff8800a5967480 x1830945721683840/t17179873299(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.302344:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967480 with x1830945721683840 ext(2973696->3145727) 00010000:00010000:2.0:1746126624.302353:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 18 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.302366:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 18 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.302375:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5967480 00000100:00100000:1.0:1746126624.303873:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1965:x1830945721684096:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 8839us (9409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.303880:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8026 00002000:00100000:1.0:1746126624.303886:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5965180 x1830945721684096/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.303894:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965180 with x1830945721684096 ext(2097152->3145727) 00002000:00010000:1.0:1746126624.303898:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965180 00000100:00100000:0.0:1746126624.304637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.304706:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721684224 00000100:00100000:2.0:1746126624.304712:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721684224 00010000:00010000:2.0:1746126624.304734:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 18 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.304764:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7342 00000100:00100000:2.0:1746126624.304769:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721684224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.304779:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126624.304791:0:7073:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126623 -> 1746126624 00002000:00010000:2.0:1746126624.304793:0:7073:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126623 -> 1746126624 00010000:00010000:2.0:1746126624.304798:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 18 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.304807:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 18 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.304843:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15a00/0xb50e825867614ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2973696->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e89b expref: 18 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.304866:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.304868:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.304874:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.304881:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.304906:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.304916:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721454080:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.304981:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.307606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.307641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.307855:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721684352 00000100:00100000:1.0:1746126624.307862:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721684352 00000100:00100000:1.0:1746126624.307890:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721684480 00000100:00100000:1.0:1746126624.307893:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721684480 00000100:00100000:1.0:1746126624.307907:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14040 00000100:00100000:1.0:1746126624.307912:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31553:x1830945721684352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126624.307924:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.307937:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8a9 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.307954:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.307955:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.307961:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.307972:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.307980:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed31800, rc 0) 00000100:00100000:1.0:1746126624.308023:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31553:x1830945721684352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 99us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.308029:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14040 00000100:00100000:1.0:1746126624.308040:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14041 00000100:00100000:1.0:1746126624.308045:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31549:x1830945721684480:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126624.308051:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126624.308058:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8b0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.308070:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.308080:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.308081:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.308083:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->3530751] (req 3145728->3530751) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.308103:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.308112:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.308122:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454208:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126624.308166:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.308241:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721454080:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.308253:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.308270:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721684224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3501us (3634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.308276:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7342 00000100:00100000:0.0:1746126624.309875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.309937:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721684736 00000100:00100000:1.0:1746126624.309943:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721684736 00002000:00100000:1.0:1746126624.309970:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008f1e3800 x1830945721684736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.309978:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3800 with x1830945721684736 ext(2097152->3145727) 00002000:00010000:1.0:1746126624.309982:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e3800 00000100:00100000:1.0:1746126624.310905:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8027 00000100:00100000:1.0:1746126624.310917:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721684736:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.312021:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454208:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.312042:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->3530751] (req 3145728->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.312055:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed30a00, rc 0) 00000100:00100000:2.0:1746126624.312089:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31549:x1830945721684480:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4043us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.312095:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14041 00000100:00100000:0.0:1746126624.312359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.313819:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721684992 00000100:00100000:3.0:1746126624.313849:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721684992 00002000:00100000:3.0:1746126624.313880:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008f1e0700 x1830945721684992/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.313888:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0700 with x1830945721684992 ext(2097152->3145727) 00002000:00010000:3.0:1746126624.313892:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e0700 00000100:00100000:3.0:1746126624.313910:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8028 00000100:00100000:3.0:1746126624.313916:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721684992:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.316851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.317729:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721685120 00000100:00100000:3.0:1746126624.317736:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721685120 00010000:00010000:3.0:1746126624.317768:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.317808:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7343 00000100:00100000:3.0:1746126624.317815:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721685120:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.317844:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.317861:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.317871:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.317891:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30400/0xb50e825867614cdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e894 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.317907:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.317909:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.317916:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.317923:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.317952:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.317963:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721454336:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126624.318038:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.320608:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721684736:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9690us (10729us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.320618:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8027 00002000:00100000:1.0:1746126624.320627:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008f1e3800 x1830945721684736/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.320635:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3800 with x1830945721684736 ext(2097152->3145727) 00002000:00010000:1.0:1746126624.320640:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e3800 00000100:00100000:3.0:1746126624.327134:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721684992:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 13209us (14766us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.327145:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8028 00002000:00100000:3.0:1746126624.327155:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008f1e0700 x1830945721684992/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.327163:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0700 with x1830945721684992 ext(2097152->3145727) 00002000:00010000:3.0:1746126624.327173:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e0700 00000100:00100000:2.0:1746126624.327217:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721454336:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.327232:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.327251:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721685120:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9437us (10407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.327258:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7343 00000100:00100000:0.0:1746126624.334177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.334230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.334313:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721685248 00000100:00100000:2.0:1746126624.334320:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721685248 00000100:00100000:2.0:1746126624.334354:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14042 00000100:00100000:2.0:1746126624.334361:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:31546:x1830945721685248:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.334375:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.334390:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8b7 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.334411:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.334417:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.334419:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.334422:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 24 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.334446:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.334455:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 15 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.334466:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454464:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.334879:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4833900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.337691:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721685504 00000100:00100000:3.0:1746126624.337700:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721685504 00002000:00100000:3.0:1746126624.337736:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3526656->3530751) req@ffff88008f1e1880 x1830945721685504/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.337751:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1880 with x1830945721685504 ext(3526656->3530751) 00010000:00010000:3.0:1746126624.337759:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.337770:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.337776:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e1880 00000100:00100000:3.0:1746126624.337808:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1843 00000100:00100000:3.0:1746126624.337814:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721685504:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.338603:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721685504:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 787us (4370us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126624.338610:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1843 00002000:00100000:2.0:1746126624.338616:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3526656->3530751) req@ffff88008f1e1880 x1830945721685504/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.338629:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1880 with x1830945721685504 ext(3526656->3530751) 00010000:00010000:2.0:1746126624.338634:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.338644:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 16 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.338649:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e1880 00000100:00100000:0.0:1746126624.347895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.347924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.347950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.348021:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721685888 00000100:00100000:1.0:1746126624.348021:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721686016 00000100:00100000:3.0:1746126624.348028:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721685888 00000100:00100000:1.0:1746126624.348028:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721686016 00002000:00100000:3.0:1746126624.348064:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3530752->4194303) req@ffff88008f1e0000 x1830945721685888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.348072:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0000 with x1830945721685888 ext(3530752->4194303) 00000100:00100000:2.0:1746126624.348076:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721686272 00000100:00100000:2.0:1746126624.348079:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721686272 00010000:00010000:3.0:1746126624.348080:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.348091:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.348097:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e0000 00000100:00100000:3.0:1746126624.348119:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1844 00000100:00100000:3.0:1746126624.348125:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721685888:12345-192.168.203.2@tcp:3:multiop.0 00002000:00100000:1.0:1746126624.348179:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f1e3480 x1830945721686016/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.348186:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3480 with x1830945721686016 ext(4194304->4976639) 00010000:00010000:1.0:1746126624.348190:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.348198:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746126624.348203:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e3480 00000100:00100000:1.0:1746126624.348223:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1845 00000100:00100000:1.0:1746126624.348228:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1966:x1830945721686016:12345-192.168.203.2@tcp:3:multiop.0 00002000:00100000:2.0:1746126624.348513:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f1e2d80 x1830945721686272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.348520:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2d80 with x1830945721686272 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.348522:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e2d80 00000100:00100000:2.0:1746126624.348538:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8029 00000100:00100000:2.0:1746126624.348543:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721686272:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126624.351228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.353251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.353275:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721686656 00000100:00100000:0.0:1746126624.353282:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721686656 00000100:00100000:2.0:1746126624.353444:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454464:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.353468:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 24 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.353481:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099212200, rc 0) 00000100:00100000:2.0:1746126624.353512:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:31546:x1830945721685248:12345-192.168.203.2@tcp:101:cat.0 Request processed in 19153us (19343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.353520:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14042 00000100:00100000:1.0:1746126624.353636:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721686528 00000100:00100000:1.0:1746126624.353640:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721686528 00000100:00100000:1.0:1746126624.353662:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3855 00000100:00100000:1.0:1746126624.353667:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+30:31549:x1830945721686528:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126624.353842:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+31:31549:x1830945721686528:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 174us (2621us total) trans 8589943258 rc 0/0 00000100:00100000:1.0:1746126624.353847:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3855 00002000:00100000:0.0:1746126624.355813:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3530751) req@ffff88008f1e3b80 x1830945721686656/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.355824:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3b80 with x1830945721686656 ext(3145728->3530751) 00010000:00010000:0.0:1746126624.355847:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.355860:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746126624.355866:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e3b80 00000100:00100000:0.0:1746126624.355899:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1846 00000100:00100000:0.0:1746126624.355907:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721686656:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126624.367971:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721685888:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 19837us (20074us total) trans 0 rc 663552/663552 00000100:00100000:3.0:1746126624.367981:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1844 00002000:00100000:3.0:1746126624.367990:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3530752->4194303) req@ffff88008f1e0000 x1830945721685888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 663552/663552 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.367998:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e0000 with x1830945721685888 ext(3530752->4194303) 00010000:00010000:3.0:1746126624.368006:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.368029:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.368036:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e0000 00000100:00100000:1.0:1746126624.368277:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721686016:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 20047us (20350us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126624.368283:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1845 00002000:00100000:1.0:1746126624.368288:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f1e3480 x1830945721686016/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.368294:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3480 with x1830945721686016 ext(4194304->4976639) 00010000:00010000:1.0:1746126624.368298:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.368308:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746126624.368313:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e3480 00000100:00100000:2.0:1746126624.370087:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1966:x1830945721686272:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 21538us (22130us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.370095:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8029 00002000:00100000:2.0:1746126624.370102:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f1e2d80 x1830945721686272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.370110:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2d80 with x1830945721686272 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.370114:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e2d80 00000100:00100000:0.0:1746126624.371331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.371431:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721686912 00000100:00100000:2.0:1746126624.371438:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721686912 00000100:00100000:2.0:1746126624.371607:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9057 00000100:00100000:2.0:1746126624.371613:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+241:31555:x1830945721686912:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126624.371628:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.371641:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ba00/0xb50e825867614d06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8be expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.371709:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126624.371720:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 242 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.371727:0:15560:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 30 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.371732:0:15560:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126624.371758:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 30 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.371767:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 30 pid: 14549 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.371776:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721454592:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.372778:0:15560:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 242 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.372786:0:15560:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 242 pid: 14549 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.372794:0:15560:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721454720:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.372815:0:15560:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.374072:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721686656:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 18163us (20823us total) trans 21474840448 rc 0/0 00000100:00100000:0.0:1746126624.374082:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1846 00002000:00100000:0.0:1746126624.374089:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3530751) req@ffff88008f1e3b80 x1830945721686656/t21474840448(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.374097:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e3b80 with x1830945721686656 ext(3145728->3530751) 00010000:00010000:0.0:1746126624.374105:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.374114:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746126624.374120:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1e3b80 00000100:00100000:0.0:1746126624.375929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.375953:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721454592:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.375961:0:15560:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15560:1830945721454720:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.375978:0:15560:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000100:00100000:0.0:1746126624.376647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.377211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.377289:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721687296 00000100:00100000:2.0:1746126624.377294:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721687296 00000100:00100000:3.0:1746126624.377296:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721687040 00000100:00100000:3.0:1746126624.377300:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721687040 00010000:00010000:3.0:1746126624.377320:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 31 pid: 14549 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.377324:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14043 00000100:00100000:2.0:1746126624.377330:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721687296:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126624.377342:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721687168 00000100:00100000:3.0:1746126624.377344:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721687168 00000100:00100000:2.0:1746126624.377345:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7344 00000100:00100000:2.0:1746126624.377349:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721687040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.377352:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 243 pid: 14549 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.377359:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.377366:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 31 pid: 14549 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.377374:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 31 pid: 14549 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.377390:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30800/0xb50e825867614cc7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e886 expref: 31 pid: 14549 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.377774:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7345 00000100:00100000:3.0:1746126624.377781:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+243:1964:x1830945721687168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.377788:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.377793:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 243 pid: 14549 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.377801:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 243 pid: 14549 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.377812:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2a0e00/0xb50e825867614c81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e85c expref: 243 pid: 14549 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.377894:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126624.377899:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126624.377907:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126624.377913:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126624.377929:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.377960:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945721687040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 610us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.377966:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7344 00010000:00010000:2.0:1746126624.378056:0:15560:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00010000:00010000:2.0:1746126624.378062:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:2.0:1746126624.378075:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126624.378175:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ba00/0xb50e825867614d06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 244 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.378191:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 243 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.378196:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126624.378198:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126624.378200:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a000, rc 0) 00000100:00100000:2.0:1746126624.378221:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+243:31555:x1830945721686912:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6609us (6893us total) trans 8589943259 rc 0/0 00000100:00100000:2.0:1746126624.378226:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9057 00010000:00010000:2.0:1746126624.378242:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.378253:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e85400/0xb50e825867614d1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8c5 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.378282:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454848:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.378334:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00010000:00010000:3.0:1746126624.378730:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126624.378734:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126624.378756:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+242:1964:x1830945721687168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 975us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.378762:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7345 00000100:00100000:1.0:1746126624.380936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.382276:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721687424 00000100:00100000:3.0:1746126624.382282:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721687424 00010000:00010000:2.0:1746126624.382289:0:23766:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from glimpse AST (req@ffff880134c3d500 x1830945721454848) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.382306:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.382323:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126623 -> 1746126624 00002000:00010000:2.0:1746126624.382327:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126623 -> 1746126624 00000100:00100000:3.0:1746126624.382329:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7346 00000100:00100000:3.0:1746126624.382335:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721687424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.382337:0:23766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.382345:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.382357:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed30a00/0xb50e825867614cf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3530751) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b0 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.382358:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454848:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126624.382367:0:7073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b50e825867614cf8) 00010000:00010000:3.0:1746126624.382368:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126624.382378:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.382381:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.382388:0:23766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.382396:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.382403:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721687424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (1472us total) trans 0 rc 116/116 00000100:00100000:3.0:1746126624.382409:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7346 00010000:00010000:2.0:1746126624.382426:0:23766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.382438:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454976:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.382531:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.385251:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721454976:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.385278:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e85400/0xb50e825867614d1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8c5 expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.385290:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e85400/0xb50e825867614d1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8c5 expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.385298:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e85400, rc 0) 00000100:00100000:2.0:1746126624.385971:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721687296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8639us (8758us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126624.385978:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14043 00000100:00100000:0.0:1746126624.388344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.388381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.388465:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721687808 00000100:00100000:3.0:1746126624.388476:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721687808 00000100:00100000:2.0:1746126624.388557:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721687936 00000100:00100000:2.0:1746126624.388561:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721687936 00002000:00100000:3.0:1746126624.388739:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880136a81f80 x1830945721687808/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.388750:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81f80 with x1830945721687808 ext(3145728->4194303) 00002000:00010000:3.0:1746126624.388756:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a81f80 00000100:00100000:3.0:1746126624.388801:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8030 00000100:00100000:3.0:1746126624.388811:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721687808:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:2.0:1746126624.389036:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880136a80e00 x1830945721687936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.389051:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80e00 with x1830945721687936 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.389054:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a80e00 00000100:00100000:2.0:1746126624.390395:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8031 00000100:00100000:2.0:1746126624.390406:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721687936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.405655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.405938:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721688064 00000100:00100000:2.0:1746126624.405945:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721688064 00000100:00100000:2.0:1746126624.405976:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14044 00000100:00100000:2.0:1746126624.405982:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31553:x1830945721688064:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.405995:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.406007:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8cc expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.406055:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.406056:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.406062:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.406074:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.406082:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e84000, rc 0) 00000100:00100000:3.0:1746126624.406095:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721687808:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17284us (17753us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.406098:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31553:x1830945721688064:12345-192.168.203.2@tcp:101:cat.0 Request processed in 117us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.406103:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8030 00000100:00100000:2.0:1746126624.406103:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14044 00002000:00100000:3.0:1746126624.406111:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880136a81f80 x1830945721687808/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.406119:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a81f80 with x1830945721687808 ext(3145728->4194303) 00002000:00010000:3.0:1746126624.406124:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a81f80 00000100:00100000:2.0:1746126624.406441:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721687936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16038us (18059us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.406449:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8031 00002000:00100000:2.0:1746126624.406454:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880136a80e00 x1830945721687936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.406461:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a80e00 with x1830945721687936 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.406464:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a80e00 00000100:00100000:2.0:1746126624.414334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.414397:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721688320 00000100:00100000:0.0:1746126624.414404:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721688320 00002000:00100000:0.0:1746126624.414443:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880134c3d500 x1830945721688320/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.414451:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d500 with x1830945721688320 ext(4194304->4976639) 00002000:00010000:0.0:1746126624.414455:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3d500 00000100:00100000:0.0:1746126624.414580:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8032 00000100:00100000:0.0:1746126624.414587:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721688320:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.425747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.425918:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721688576 00000100:00100000:3.0:1746126624.425925:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721688576 00002000:00100000:3.0:1746126624.425955:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880136a82a00 x1830945721688576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.425963:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82a00 with x1830945721688576 ext(4194304->4976639) 00002000:00010000:3.0:1746126624.425968:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a82a00 00000100:00100000:3.0:1746126624.425993:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8033 00000100:00100000:3.0:1746126624.425998:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721688576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.429488:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721688320:12345-192.168.203.2@tcp:3:cat.0 Request processed in 14893us (15154us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126624.429498:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8032 00002000:00100000:2.0:1746126624.429507:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880134c3d500 x1830945721688320/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.429515:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3d500 with x1830945721688320 ext(4194304->4976639) 00002000:00010000:2.0:1746126624.429520:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3d500 00000100:00100000:3.0:1746126624.439995:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721688576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13989us (14248us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126624.440006:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8033 00002000:00100000:3.0:1746126624.440026:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880136a82a00 x1830945721688576/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.440791:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82a00 with x1830945721688576 ext(4194304->4976639) 00002000:00010000:3.0:1746126624.440798:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a82a00 00000100:00100000:0.0:1746126624.481134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.481220:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721688704 00000100:00100000:2.0:1746126624.481227:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721688704 00000100:00100000:2.0:1746126624.481269:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14045 00000100:00100000:2.0:1746126624.481275:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31555:x1830945721688704:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126624.481290:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.481302:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8d3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.481325:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.481337:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.481342:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.481344:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.481346:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.481368:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.481378:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.481387:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721455104:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.482653:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.482663:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.482672:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721455232:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.482978:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.484020:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721455104:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.484029:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721455232:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.484049:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.484062:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b40c00, rc 0) 00000100:00100000:2.0:1746126624.484201:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:31555:x1830945721688704:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2924us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.484208:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14045 00000100:00100000:0.0:1746126624.488136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.488172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.488405:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721688832 00000100:00100000:1.0:1746126624.488412:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721688832 00010000:00010000:1.0:1746126624.488439:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.488460:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7347 00000100:00100000:1.0:1746126624.488465:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721688832:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.488474:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126624.488491:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.488500:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.488521:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614cf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a9 expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.488538:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126624.488573:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721688832:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.488579:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7347 00000100:00100000:3.0:1746126624.488785:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721689088 00000100:00100000:3.0:1746126624.488789:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721689088 00000100:00100000:3.0:1746126624.488813:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9058 00000100:00100000:3.0:1746126624.488818:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+30:31560:x1830945721689088:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126624.488857:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.488870:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867614d30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8da expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.488942:0:15560:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126624.488953:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15560 initiator: MDT0 00010000:00010000:3.0:1746126624.488961:0:15560:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15560 initiator: MDT0 00000004:00200000:3.0:1746126624.488969:0:15560:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126624.489066:0:15560:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4f600/0xb50e825867614d30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 33 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.490063:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 32 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.490070:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126624.490073:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126624.490075:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d4e800, rc 0) 00000100:00100000:3.0:1746126624.490318:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+32:31560:x1830945721689088:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1498us (2143us total) trans 8589943260 rc 0/0 00000100:00100000:3.0:1746126624.490324:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9058 00000100:00100000:2.0:1746126624.492665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.492923:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721689216 00000100:00100000:0.0:1746126624.492931:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721689216 00010000:00010000:0.0:1746126624.492956:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746126624.492994:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7348 00000100:00100000:0.0:1746126624.493001:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721689216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126624.493020:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126624.493038:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.493049:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.493069:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c889e00/0xb50e825867614cea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8a2 expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.493094:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.493096:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.493101:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.493108:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.493133:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126624.493143:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721455360:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126624.493670:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.496516:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721455360:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.496534:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.496582:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721689216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3579us (3921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.496590:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7348 00000100:00100000:0.0:1746126624.497660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.497760:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721689472 00000100:00100000:3.0:1746126624.497766:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721689472 00002000:00100000:3.0:1746126624.497798:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2625536->2629631) req@ffff880136a82680 x1830945721689472/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.497808:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82680 with x1830945721689472 ext(2625536->2629631) 00002000:00010000:3.0:1746126624.497813:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a82680 00000100:00100000:3.0:1746126624.500601:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8034 00000100:00100000:3.0:1746126624.500617:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721689472:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.500783:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721689472:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 171us (3123us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.500789:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8034 00002000:00100000:3.0:1746126624.500796:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2625536->2629631) req@ffff880136a82680 x1830945721689472/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.500804:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a82680 with x1830945721689472 ext(2625536->2629631) 00002000:00010000:3.0:1746126624.500809:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a82680 00000100:00100000:0.0:1746126624.511391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.511459:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721689600 00000100:00100000:2.0:1746126624.511468:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721689600 00000100:00100000:2.0:1746126624.511515:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14046 00000100:00100000:2.0:1746126624.511521:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:31555:x1830945721689600:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126624.511536:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.511549:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8e1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.511574:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.511582:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.511592:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.511594:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.511597:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.511619:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.511630:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 17 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.511640:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721455488:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.511730:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.511738:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.512274:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721455616:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.512312:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.514312:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721455488:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.514322:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721455616:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.514345:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.514361:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e43c00, rc 0) 00000100:00100000:2.0:1746126624.514398:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:31555:x1830945721689600:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2876us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.514404:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14046 00000100:00100000:0.0:1746126624.520776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.520862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.521043:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721689856 00000100:00100000:1.0:1746126624.521050:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721689856 00010000:00010000:1.0:1746126624.521077:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.521111:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721689728 00000100:00100000:1.0:1746126624.521114:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721689728 00010000:00010000:1.0:1746126624.521124:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.521139:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7349 00000100:00100000:1.0:1746126624.521145:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721689856:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.521156:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126624.521159:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7350 00000100:00100000:3.0:1746126624.521168:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1965:x1830945721689728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.521172:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.521176:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126624.521181:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.521678:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.521685:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099212200/0xb50e825867614cff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8b7 expref: 25 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.521690:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.521702:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e84000/0xb50e825867614d22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8cc expref: 18 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.521712:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.521713:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.525454:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.525481:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.525847:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126624.525912:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1965:x1830945721689728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4742us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.525921:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7350 00010000:00010000:1.0:1746126624.526214:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126624.526226:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721455744:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126624.528439:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.532299:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721455744:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126624.532317:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126624.532355:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721689856:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 11208us (11585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.532363:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7349 00000100:00100000:0.0:1746126624.539200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.539300:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721690112 00000100:00100000:3.0:1746126624.539308:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721690112 00002000:00100000:3.0:1746126624.539345:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3403776->3407871) req@ffff880136a83480 x1830945721690112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.539354:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83480 with x1830945721690112 ext(3403776->3407871) 00002000:00010000:3.0:1746126624.539358:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83480 00000100:00100000:3.0:1746126624.539388:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8035 00000100:00100000:3.0:1746126624.539395:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721690112:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.539538:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721690112:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 143us (344us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.539544:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8035 00002000:00100000:3.0:1746126624.539548:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3403776->3407871) req@ffff880136a83480 x1830945721690112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.539554:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a83480 with x1830945721690112 ext(3403776->3407871) 00002000:00010000:3.0:1746126624.539557:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a83480 00000100:00100000:0.0:1746126624.575386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.575447:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721690240 00000100:00100000:2.0:1746126624.575455:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721690240 00000100:00100000:2.0:1746126624.575501:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14047 00000100:00100000:2.0:1746126624.575509:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31560:x1830945721690240:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126624.575525:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.575539:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8e8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.575560:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.575567:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 23 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.575573:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.575575:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.575578:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1966080->2097151] (req 1966080->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.575601:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 23 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.575615:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 23 pid: 9686 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746126624.575626:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721455872:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.575729:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.575737:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746126624.575745:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456000:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.575767:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.578228:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721455872:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.578237:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456000:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.578261:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1966080->2097151] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.578274:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b40a00, rc 0) 00000100:00100000:2.0:1746126624.578316:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31560:x1830945721690240:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2807us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.578324:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14047 00000100:00100000:0.0:1746126624.580218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.580277:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721690368 00000100:00100000:1.0:1746126624.580283:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721690368 00010000:00010000:1.0:1746126624.580310:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746126624.580348:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7351 00000100:00100000:1.0:1746126624.580354:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721690368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.580365:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126624.580381:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.580390:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.580407:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65400/0xb50e825867614c11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e801 expref: 18 pid: 4642 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.580429:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126624.580458:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721690368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.580464:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7351 00000100:00100000:0.0:1746126624.583701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.583751:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721690496 00000100:00100000:1.0:1746126624.583758:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721690496 00010000:00010000:1.0:1746126624.583785:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 24 pid: 9686 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746126624.583821:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7352 00000100:00100000:1.0:1746126624.583853:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721690496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.583865:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126624.583882:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 24 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.583892:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 24 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.583910:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997dba00/0xb50e825867614c49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e832 expref: 24 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.583922:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.583924:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.583929:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.583936:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.583961:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126624.583971:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721456128:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126624.584681:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.585522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.585559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.585603:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721690752 00000100:00100000:3.0:1746126624.585608:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721690752 00000100:00100000:2.0:1746126624.585612:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721691008 00000100:00100000:2.0:1746126624.585615:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721691008 00002000:00100000:3.0:1746126624.585636:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008e721c00 x1830945721690752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.585636:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3407872->4194303) req@ffff88008e723480 x1830945721691008/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.585644:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721c00 with x1830945721690752 ext(2097152->3145727) 00002000:00100000:2.0:1746126624.585644:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e723480 with x1830945721691008 ext(3407872->4194303) 00002000:00010000:3.0:1746126624.585648:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e721c00 00002000:00010000:2.0:1746126624.585648:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e723480 00000100:00100000:3.0:1746126624.585715:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8036 00000100:00100000:3.0:1746126624.585721:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721691008:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.585769:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8037 00000100:00100000:2.0:1746126624.585778:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721690752:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.587480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.587847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.587848:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721691264 00000100:00100000:1.0:1746126624.587854:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721691264 00000100:00100000:3.0:1746126624.587886:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721691520 00000100:00100000:3.0:1746126624.587890:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721691520 00002000:00100000:3.0:1746126624.587916:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3665920->4194303) req@ffff88008e721500 x1830945721691520/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.587925:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721500 with x1830945721691520 ext(3665920->4194303) 00002000:00010000:3.0:1746126624.587929:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e721500 00000100:00100000:3.0:1746126624.587946:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8038 00000100:00100000:3.0:1746126624.587952:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721691520:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:1.0:1746126624.588454:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3665919) req@ffff88008e722a00 x1830945721691264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 504/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.588460:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722a00 with x1830945721691264 ext(2097152->3665919) 00002000:00010000:1.0:1746126624.588463:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722a00 00000100:00100000:1.0:1746126624.588474:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8039 00000100:00100000:1.0:1746126624.588478:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721691264:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126624.595252:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721456128:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126624.595273:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126624.595310:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721690496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 11482us (11615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.595320:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7352 00000100:00100000:0.0:1746126624.598225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.598648:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721691776 00000100:00100000:3.0:1746126624.598656:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721691776 00002000:00100000:3.0:1746126624.598691:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1966080->1970175) req@ffff88008e720e00 x1830945721691776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.598699:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720e00 with x1830945721691776 ext(1966080->1970175) 00002000:00010000:3.0:1746126624.598704:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e720e00 00000100:00100000:3.0:1746126624.598735:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8040 00000100:00100000:3.0:1746126624.598741:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721691776:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.598905:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721691776:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 163us (684us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.598910:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8040 00002000:00100000:3.0:1746126624.598915:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1966080->1970175) req@ffff88008e720e00 x1830945721691776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.598922:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720e00 with x1830945721691776 ext(1966080->1970175) 00002000:00010000:3.0:1746126624.598924:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e720e00 00000100:00100000:3.0:1746126624.601682:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1965:x1830945721691008:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15953us (16113us total) trans 0 rc 786432/786432 00000100:00100000:3.0:1746126624.601693:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8036 00002000:00100000:3.0:1746126624.601701:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3407872->4194303) req@ffff88008e723480 x1830945721691008/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.601710:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e723480 with x1830945721691008 ext(3407872->4194303) 00002000:00010000:3.0:1746126624.601715:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e723480 00000100:00100000:2.0:1746126624.602327:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721690752:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16550us (16804us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.602335:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8037 00002000:00100000:2.0:1746126624.602341:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008e721c00 x1830945721690752/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.602348:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721c00 with x1830945721690752 ext(2097152->3145727) 00002000:00010000:2.0:1746126624.602351:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e721c00 00000100:00100000:0.0:1746126624.607324:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+25:1966:x1830945721691520:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19364us (19470us total) trans 0 rc 528384/528384 00000100:00100000:0.0:1746126624.607334:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8038 00002000:00100000:0.0:1746126624.607344:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3665920->4194303) req@ffff88008e721500 x1830945721691520/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.607352:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e721500 with x1830945721691520 ext(3665920->4194303) 00002000:00010000:0.0:1746126624.607357:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e721500 00000100:00100000:1.0:1746126624.608450:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721691264:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19968us (20970us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.608457:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8039 00002000:00100000:1.0:1746126624.608463:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3665919) req@ffff88008e722a00 x1830945721691264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 504/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.608470:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e722a00 with x1830945721691264 ext(2097152->3665919) 00002000:00010000:1.0:1746126624.608474:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e722a00 00000100:00100000:2.0:1746126624.608767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.608989:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721691904 00000100:00100000:0.0:1746126624.608995:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721691904 00000100:00100000:0.0:1746126624.609107:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14048 00000100:00100000:0.0:1746126624.609114:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31560:x1830945721691904:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126624.609125:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126624.609139:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8ef expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.609158:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.609166:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 22 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.609172:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.609174:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.609176:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.609200:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 22 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.609210:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 22 pid: 9686 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746126624.609220:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e720380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456256:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126624.609916:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.609925:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746126624.609933:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456384:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126624.609955:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.610065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.610396:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721692160 00000100:00100000:1.0:1746126624.610460:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721692160 00002000:00100000:1.0:1746126624.613475:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880134c3c380 x1830945721692160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.613486:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3c380 with x1830945721692160 ext(4194304->4976639) 00002000:00010000:1.0:1746126624.613491:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3c380 00000100:00100000:1.0:1746126624.613525:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8041 00000100:00100000:1.0:1746126624.613532:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721692160:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.616940:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e720380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456256:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.616953:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456384:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.616975:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.616989:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b0000, rc 0) 00000100:00100000:2.0:1746126624.617137:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31560:x1830945721691904:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8022us (8370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.617145:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14048 00000100:00100000:1.0:1746126624.620643:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721692160:12345-192.168.203.2@tcp:3:cat.0 Request processed in 7104us (10571us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746126624.620655:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8041 00002000:00100000:1.0:1746126624.620664:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff880134c3c380 x1830945721692160/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.620671:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3c380 with x1830945721692160 ext(4194304->4976639) 00002000:00010000:1.0:1746126624.620676:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3c380 00000100:00100000:3.0:1746126624.622026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.622125:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721692288 00000100:00100000:1.0:1746126624.622132:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721692288 00010000:00010000:1.0:1746126624.622155:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 23 pid: 9686 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746126624.622176:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7353 00000100:00100000:1.0:1746126624.622181:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721692288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.622190:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126624.622207:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 23 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.622216:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 23 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.622236:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997db600/0xb50e825867614c42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e839 expref: 23 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746126624.622258:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126624.622282:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721692288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126624.622290:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7353 00000100:00100000:0.0:1746126624.624000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.624204:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721692416 00000100:00100000:3.0:1746126624.624209:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721692416 00010000:00010000:3.0:1746126624.624229:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746126624.624260:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7354 00000100:00100000:3.0:1746126624.624266:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721692416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.624274:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.624288:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746126624.624298:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746126624.624313:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800937c8800/0xb50e825867614c18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e808 expref: 18 pid: 9686 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746126624.624339:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.624341:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.624347:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.624354:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.624380:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.624391:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721456512:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126624.624456:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.627659:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721456512:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126624.627676:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126624.627714:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721692416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3446us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.627722:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7354 00000100:00100000:1.0:1746126624.629616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.629645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.629718:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721692544 00000100:00100000:3.0:1746126624.629725:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721692544 00000100:00100000:3.0:1746126624.629761:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721692672 00000100:00100000:3.0:1746126624.629763:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721692672 00000100:00100000:3.0:1746126624.629777:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14049 00000100:00100000:3.0:1746126624.629783:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721692544:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.629797:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.629811:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec80400/0xb50e825867614d5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8f6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.629873:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456640:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.629890:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14050 00000100:00100000:2.0:1746126624.629898:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721692672:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.629906:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.629913:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e8fd expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.629936:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.629936:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721456768:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.629960:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00002000:00010000:3.0:1746126624.632971:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126622 -> 1746126624 00002000:00010000:3.0:1746126624.632976:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126621 -> 1746126624 00002000:00010000:3.0:1746126624.632978:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126622 -> 1746126624 00000100:00100000:3.0:1746126624.633000:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721456640:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126624.633031:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec80400/0xb50e825867614d5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8f6 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.633044:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec80400/0xb50e825867614d5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8f6 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.633071:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec80400, rc 0) 00000100:00100000:3.0:1746126624.633549:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721692544:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3763us (3935us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126624.633557:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14049 00000100:00100000:0.0:1746126624.633886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.633942:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721692928 00000100:00100000:1.0:1746126624.633947:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721692928 00002000:00100000:1.0:1746126624.633977:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1527808->1531903) req@ffff88008e720380 x1830945721692928/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.633985:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720380 with x1830945721692928 ext(1527808->1531903) 00002000:00010000:1.0:1746126624.633989:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e720380 00000100:00100000:1.0:1746126624.634002:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8042 00000100:00100000:1.0:1746126624.634007:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721692928:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126624.634135:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721692928:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 127us (249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126624.634140:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8042 00002000:00100000:1.0:1746126624.634145:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1527808->1531903) req@ffff88008e720380 x1830945721692928/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.634153:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e720380 with x1830945721692928 ext(1527808->1531903) 00002000:00010000:1.0:1746126624.634155:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e720380 00002000:00010000:2.0:1746126624.634335:0:23766:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126620 -> 1746126624 00002000:00010000:2.0:1746126624.634338:0:23766:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126619 -> 1746126624 00002000:00010000:2.0:1746126624.634340:0:23766:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126620 -> 1746126624 00000100:00100000:2.0:1746126624.634348:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721456768:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126624.634365:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d61 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8fd expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.634374:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8fd expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.634396:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4bc00, rc 0) 00000100:00100000:2.0:1746126624.634416:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721692672:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4519us (4770us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126624.634424:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14050 00000100:00100000:0.0:1746126624.644375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.644424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.644453:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693056 00000100:00100000:2.0:1746126624.644462:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693056 00000100:00100000:2.0:1746126624.644494:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693184 00000100:00100000:2.0:1746126624.644496:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693184 00000100:00100000:2.0:1746126624.644510:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14051 00000100:00100000:2.0:1746126624.644515:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721693056:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126624.644520:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14052 00000100:00100000:3.0:1746126624.644527:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+23:1965:x1830945721693184:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.644529:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.644533:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.644542:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec81e00/0xb50e825867614d6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e90b expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.644542:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a4aa00/0xb50e825867614d68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e904 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.644580:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721457024:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126624.644581:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721456896:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.644654:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.644994:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.649642:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721457024:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126624.649670:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a4aa00/0xb50e825867614d68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e904 expref: 25 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.649682:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a4aa00/0xb50e825867614d68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e904 expref: 25 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.649734:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4aa00, rc 0) 00000100:00100000:2.0:1746126624.651583:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721693056:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7060us (7209us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126624.651592:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14051 00000100:00100000:3.0:1746126624.656848:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721456896:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126624.656877:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81e00/0xb50e825867614d6f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e90b expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.656889:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81e00/0xb50e825867614d6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e90b expref: 23 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.656913:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec81e00, rc 0) 00000100:00100000:3.0:1746126624.656958:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721693184:12345-192.168.203.2@tcp:101:cat.0 Request processed in 12430us (12532us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126624.656965:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14052 00000100:00100000:0.0:1746126624.660935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.661006:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693312 00000100:00100000:2.0:1746126624.661023:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693312 00000100:00100000:2.0:1746126624.661060:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14053 00000100:00100000:2.0:1746126624.661067:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721693312:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.661080:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.661095:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099290a00/0xb50e825867614d76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e912 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.661144:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721457152:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.661201:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.662213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.663627:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693440 00000100:00100000:2.0:1746126624.663634:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693440 00000100:00100000:2.0:1746126624.663677:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14054 00000100:00100000:2.0:1746126624.663685:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721693440:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.663698:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.663711:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e919 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.663751:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721457280:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.663809:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.664665:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721457152:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126624.664684:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099290a00/0xb50e825867614d76 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e912 expref: 25 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.664699:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099290a00/0xb50e825867614d76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e912 expref: 25 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.665398:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099290a00, rc 0) 00000100:00100000:2.0:1746126624.665438:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1966:x1830945721693312:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4371us (4509us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126624.665445:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14053 00000100:00100000:2.0:1746126624.669619:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721457280:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126624.669648:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e919 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.669661:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e919 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.669684:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4bc00, rc 0) 00000100:00100000:2.0:1746126624.670521:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:1966:x1830945721693440:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6835us (8308us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126624.670528:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14054 00000100:00100000:0.0:1746126624.674194:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.674250:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693568 00000100:00100000:2.0:1746126624.674258:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693568 00000100:00100000:2.0:1746126624.674292:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14055 00000100:00100000:2.0:1746126624.674298:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721693568:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.674311:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.674324:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a4be00/0xb50e825867614d84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e920 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.674362:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721457408:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.674426:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.676461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:3.0:1746126624.676823:0:17475:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime: 1746126623 -> 1746126624 00000100:00100000:3.0:1746126624.676862:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721457408:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.676870:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693696 00000100:00100000:2.0:1746126624.676875:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693696 00010000:00010000:3.0:1746126624.676887:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a4be00/0xb50e825867614d84 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e920 expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.676899:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a4be00/0xb50e825867614d84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e920 expref: 18 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126624.676904:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14056 00000100:00100000:2.0:1746126624.676911:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721693696:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.676921:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4be00, rc 0) 00010000:00010000:2.0:1746126624.676921:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.676931:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a4b400/0xb50e825867614d8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e927 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.676955:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721693568:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2657us (2768us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126624.676961:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14055 00000100:00100000:2.0:1746126624.676964:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721457536:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.677006:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.685223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.686673:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693824 00000100:00100000:2.0:1746126624.686682:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693824 00000100:00100000:2.0:1746126624.686728:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14057 00000100:00100000:2.0:1746126624.686734:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:31570:x1830945721693824:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126624.686748:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.686761:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e92e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.686789:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.686796:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.686798:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.686801:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1855488->2047999] (req 1855488->2047999) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.686822:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126624.686992:0:23766:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126623 -> 1746126624 00000100:00100000:3.0:1746126624.687017:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721457536:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126624.687036:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a4b400/0xb50e825867614d8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e927 expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.687046:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a4b400/0xb50e825867614d8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e927 expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.687057:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4b400, rc 0) 00000100:00100000:3.0:1746126624.687099:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721693696:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10188us (10643us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126624.687104:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14056 00010000:00010000:2.0:1746126624.687437:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 16 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.687448:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721457664:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.688871:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.691452:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721457664:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.691476:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1855488->2047999] (req 1855488->2047999) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.691489:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a4bc00, rc 0) 00000100:00100000:2.0:1746126624.691538:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+23:31570:x1830945721693824:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4803us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.691545:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14057 00000100:00100000:0.0:1746126624.693200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.693393:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721693952 00000100:00100000:2.0:1746126624.693399:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721693952 00002000:00100000:2.0:1746126624.693428:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1531903) req@ffff88012b192a00 x1830945721693952/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.693436:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192a00 with x1830945721693952 ext(1048576->1531903) 00010000:00010000:2.0:1746126624.693443:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 17 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.693741:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 17 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.693747:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b192a00 00000100:00100000:2.0:1746126624.693775:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1847 00000100:00100000:2.0:1746126624.693782:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721693952:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126624.699473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.699676:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721694208 00000100:00100000:2.0:1746126624.699683:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721694208 00002000:00100000:2.0:1746126624.699716:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1966079) req@ffff880093df5500 x1830945721694208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.699725:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5500 with x1830945721694208 ext(1048576->1966079) 00002000:00010000:2.0:1746126624.699729:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093df5500 00000100:00100000:2.0:1746126624.699760:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8043 00000100:00100000:2.0:1746126624.699767:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721694208:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126624.711904:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721694208:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12129us (12428us total) trans 0 rc 917504/917504 00000100:00100000:3.0:1746126624.711916:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8043 00002000:00100000:3.0:1746126624.711925:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->1966079) req@ffff880093df5500 x1830945721694208/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.711933:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093df5500 with x1830945721694208 ext(1048576->1966079) 00002000:00010000:3.0:1746126624.711939:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093df5500 00000100:00100000:2.0:1746126624.713024:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721693952:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 19240us (19823us total) trans 17179873300 rc 0/0 00000100:00100000:2.0:1746126624.713032:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1847 00002000:00100000:2.0:1746126624.713037:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1531903) req@ffff88012b192a00 x1830945721693952/t17179873300(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.713044:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192a00 with x1830945721693952 ext(1048576->1531903) 00010000:00010000:2.0:1746126624.713052:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.713065:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.713071:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b192a00 00000100:00100000:0.0:1746126624.717650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.717766:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721694336 00000100:00100000:3.0:1746126624.717773:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721694336 00010000:00010000:3.0:1746126624.717799:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.717854:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7355 00000100:00100000:3.0:1746126624.717860:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721694336:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126624.717871:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126624.717886:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.717896:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.717914:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0000/0xb50e825867614d53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8ef expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.717932:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.717934:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.717940:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.717950:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.717973:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.717985:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721457792:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126624.718322:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.720088:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721457792:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126624.720100:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126624.720130:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721694336:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2270us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.720139:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7355 00000100:00100000:0.0:1746126624.720420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.720470:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721694592 00000100:00100000:2.0:1746126624.720476:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721694592 00002000:00100000:2.0:1746126624.720504:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1855488->1859583) req@ffff88012b191880 x1830945721694592/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.720512:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191880 with x1830945721694592 ext(1855488->1859583) 00002000:00010000:2.0:1746126624.720516:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b191880 00000100:00100000:2.0:1746126624.720529:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8044 00000100:00100000:2.0:1746126624.720536:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721694592:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.720666:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+23:1966:x1830945721694592:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 130us (246us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126624.720671:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8044 00002000:00100000:2.0:1746126624.720676:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x323:0x0] (1855488->1859583) req@ffff88012b191880 x1830945721694592/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.720683:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191880 with x1830945721694592 ext(1855488->1859583) 00002000:00010000:2.0:1746126624.720686:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b191880 00000100:00100000:0.0:1746126624.721721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.721777:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721694720 00000100:00100000:2.0:1746126624.721782:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721694720 00000100:00100000:2.0:1746126624.722688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14058 00000100:00100000:2.0:1746126624.722695:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31569:x1830945721694720:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126624.722706:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.722719:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e935 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.722739:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.722745:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.722746:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.722749:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.722771:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.722780:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.722789:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721457920:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.722860:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.725801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.726861:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721694976 00000100:00100000:3.0:1746126624.726869:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721694976 00002000:00100000:3.0:1746126624.726904:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (2043904->2047999) req@ffff8800a5954000 x1830945721694976/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.726913:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954000 with x1830945721694976 ext(2043904->2047999) 00010000:00010000:3.0:1746126624.726921:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.726932:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.726941:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5954000 00000100:00100000:3.0:1746126624.726968:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1848 00000100:00100000:3.0:1746126624.726973:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721694976:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.727209:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721694976:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 234us (1412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.727215:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1848 00002000:00100000:3.0:1746126624.727220:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (2043904->2047999) req@ffff8800a5954000 x1830945721694976/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.727226:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954000 with x1830945721694976 ext(2043904->2047999) 00010000:00010000:3.0:1746126624.727232:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.727242:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.727246:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5954000 00000100:00100000:2.0:1746126624.730868:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721457920:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.730896:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.730911:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adb0600, rc 0) 00000100:00100000:2.0:1746126624.730946:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31569:x1830945721694720:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8251us (9226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.730953:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14058 00000100:00100000:0.0:1746126624.731050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.732905:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721695232 00000100:00100000:3.0:1746126624.732913:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721695232 00002000:00100000:3.0:1746126624.732943:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1855488->2047999) req@ffff8800a5954380 x1830945721695232/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.732951:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954380 with x1830945721695232 ext(1855488->2047999) 00010000:00010000:3.0:1746126624.732958:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.732973:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.732978:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5954380 00000100:00100000:3.0:1746126624.733006:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1849 00000100:00100000:3.0:1746126624.733020:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721695232:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126624.744250:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721695232:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 11222us (13194us total) trans 17179873301 rc 0/0 00000100:00100000:3.0:1746126624.744261:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1849 00002000:00100000:3.0:1746126624.744271:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1855488->2047999) req@ffff8800a5954380 x1830945721695232/t17179873301(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.744279:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954380 with x1830945721695232 ext(1855488->2047999) 00010000:00010000:3.0:1746126624.744288:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.744302:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.744309:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5954380 00000100:00100000:0.0:1746126624.748299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.748700:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721695360 00000100:00100000:3.0:1746126624.748708:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721695360 00010000:00010000:3.0:1746126624.748737:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.749650:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7356 00000100:00100000:2.0:1746126624.749660:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1965:x1830945721695360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.749671:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.749689:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.749699:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.749716:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a4bc00/0xb50e825867614d92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2047999) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e92e expref: 25 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.749972:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.749975:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.749980:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.749988:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.750024:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.750036:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721458048:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.750533:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.755369:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721458048:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126624.755424:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126624.755480:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1965:x1830945721695360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5821us (7186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126624.755490:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7356 00000100:00100000:0.0:1746126624.756547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.756646:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721695616 00000100:00100000:3.0:1746126624.756655:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721695616 00002000:00100000:3.0:1746126624.756705:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5956a00 x1830945721695616/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.756715:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956a00 with x1830945721695616 ext(1048576->2097151) 00002000:00010000:3.0:1746126624.756719:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5956a00 00000100:00100000:3.0:1746126624.756751:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8045 00000100:00100000:3.0:1746126624.756758:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721695616:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126624.765947:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721695616:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9179us (9395us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.765959:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8045 00002000:00100000:3.0:1746126624.765971:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a5956a00 x1830945721695616/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.765980:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5956a00 with x1830945721695616 ext(1048576->2097151) 00002000:00010000:3.0:1746126624.765986:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5956a00 00000100:00100000:0.0:1746126624.773061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.773112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.773210:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721695872 00000100:00100000:2.0:1746126624.773221:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721695872 00000100:00100000:2.0:1746126624.773299:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721695744 00000100:00100000:2.0:1746126624.773302:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721695744 00000100:00100000:2.0:1746126624.773333:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14059 00000100:00100000:2.0:1746126624.773341:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721695872:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126624.773346:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14060 00000100:00100000:3.0:1746126624.773352:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721695744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.773360:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.773360:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.773376:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec81800/0xb50e825867614da7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e93c expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.773376:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614da0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e943 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126624.773425:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721458176:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.773425:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721458304:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126624.773742:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.773820:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.777817:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721458304:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126624.777890:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614da0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e943 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.777904:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed31800/0xb50e825867614da0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e943 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126624.777922:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed31800, rc 0) 00000100:00100000:2.0:1746126624.777980:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721695872:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4638us (4928us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126624.777989:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14059 00000100:00100000:3.0:1746126624.778300:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721458176:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126624.778320:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec81800/0xb50e825867614da7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e93c expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.778330:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec81800/0xb50e825867614da7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e93c expref: 18 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126624.778342:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec81800, rc 0) 00000100:00100000:3.0:1746126624.778379:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721695744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5026us (5266us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126624.778385:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14060 00000100:00100000:0.0:1746126624.781651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.781747:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696000 00000100:00100000:3.0:1746126624.781757:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696000 00000100:00100000:3.0:1746126624.782005:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14061 00000100:00100000:3.0:1746126624.782023:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31569:x1830945721696000:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.782042:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.782058:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e94a expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.782088:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.782095:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.782097:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.782100:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.782133:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.782145:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.782156:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721458432:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126624.782917:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.785391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.785593:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721458432:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126624.785624:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.785640:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c066a00, rc 0) 00000100:00100000:3.0:1746126624.785679:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31569:x1830945721696000:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3658us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.785688:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14061 00000100:00100000:2.0:1746126624.785770:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696128 00000100:00100000:2.0:1746126624.785777:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696128 00002000:00100000:2.0:1746126624.785817:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3407871) req@ffff8800a5954a80 x1830945721696128/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.785860:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954a80 with x1830945721696128 ext(3145728->3407871) 00010000:00010000:2.0:1746126624.785867:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 24 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.785878:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 24 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.785884:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5954a80 00000100:00100000:2.0:1746126624.785921:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1850 00000100:00100000:2.0:1746126624.785927:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721696128:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:2.0:1746126624.790681:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721696128:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 4742us (5287us total) trans 21474840449 rc 0/0 00000100:00100000:2.0:1746126624.790697:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1850 00002000:00100000:2.0:1746126624.790707:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3407871) req@ffff8800a5954a80 x1830945721696128/t21474840449(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.790716:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954a80 with x1830945721696128 ext(3145728->3407871) 00010000:00010000:2.0:1746126624.790725:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.790739:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.790746:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5954a80 00000100:00100000:0.0:1746126624.795281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.795380:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696256 00000100:00100000:2.0:1746126624.795389:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696256 00010000:00010000:2.0:1746126624.795426:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.795464:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7357 00000100:00100000:2.0:1746126624.795471:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721696256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.795485:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.795508:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.795520:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.795548:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e43c00/0xb50e825867614d45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e1 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.796746:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.796749:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.796757:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.796767:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.796809:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 17 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.796825:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721458560:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.796966:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.798991:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721458560:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.799018:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.799067:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721696256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3595us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.799077:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7357 00000100:00100000:0.0:1746126624.804965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.805097:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696512 00000100:00100000:2.0:1746126624.805107:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696512 00002000:00100000:2.0:1746126624.805150:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5957b80 x1830945721696512/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.805164:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5957b80 with x1830945721696512 ext(2097152->3145727) 00002000:00010000:2.0:1746126624.805169:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5957b80 00000100:00100000:2.0:1746126624.805193:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8046 00000100:00100000:2.0:1746126624.805199:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721696512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126624.817901:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721696512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12690us (12934us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126624.817913:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8046 00002000:00100000:2.0:1746126624.817924:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5957b80 x1830945721696512/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.817933:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5957b80 with x1830945721696512 ext(2097152->3145727) 00002000:00010000:2.0:1746126624.817940:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5957b80 00000100:00100000:0.0:1746126624.822267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.824317:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696640 00000100:00100000:3.0:1746126624.824332:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696640 00000100:00100000:3.0:1746126624.824412:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14062 00000100:00100000:3.0:1746126624.824422:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31569:x1830945721696640:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.824444:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.824465:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e951 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.824501:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.824509:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.824511:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.824515:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 20 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.824554:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.824566:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 23 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.824580:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721458688:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126624.824683:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.829438:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721458688:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126624.829479:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 20 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.829500:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c067400, rc 0) 00000100:00100000:3.0:1746126624.829591:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31569:x1830945721696640:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5168us (7328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.829601:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14062 00000100:00100000:0.0:1746126624.835944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.836059:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696768 00000100:00100000:2.0:1746126624.836069:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696768 00002000:00100000:2.0:1746126624.836124:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2625536->3145727) req@ffff8800a5957100 x1830945721696768/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.836134:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5957100 with x1830945721696768 ext(2625536->3145727) 00010000:00010000:2.0:1746126624.836143:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 24 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.836156:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 24 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.836162:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5957100 00000100:00100000:3.0:1746126624.837310:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1851 00000100:00100000:3.0:1746126624.837323:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721696768:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126624.858503:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721696768:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 21172us (22557us total) trans 17179873302 rc 0/0 00000100:00100000:3.0:1746126624.858516:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1851 00002000:00100000:3.0:1746126624.858528:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2625536->3145727) req@ffff8800a5957100 x1830945721696768/t17179873302(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.858537:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5957100 with x1830945721696768 ext(2625536->3145727) 00010000:00010000:3.0:1746126624.858547:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.858563:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.858975:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5957100 00010000:00010000:0.0:1746126624.859063:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126624.869726:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.869863:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721696896 00000100:00100000:2.0:1746126624.869874:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721696896 00010000:00010000:2.0:1746126624.869912:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.869949:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7358 00000100:00100000:2.0:1746126624.869956:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721696896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.869974:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.869998:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.870017:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.870049:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614d29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8d3 expref: 26 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.870068:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.870071:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.870078:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.870085:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.870119:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.870130:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721458816:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.870234:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.876511:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721458816:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.876536:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.877077:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721696896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7119us (9151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.877088:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7358 00000100:00100000:0.0:1746126624.880056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.880201:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721697024 00000100:00100000:3.0:1746126624.880211:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721697024 00000100:00100000:3.0:1746126624.880283:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14063 00000100:00100000:3.0:1746126624.880291:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31575:x1830945721697024:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126624.880311:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.880330:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e958 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.880358:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.880365:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.880367:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126624.880370:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3366912->3538943] (req 3366912->3538943) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.880400:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.880412:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.880423:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721458944:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126624.880505:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.890489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.890527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.890564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.890650:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721697280 00000100:00100000:2.0:1746126624.890658:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721697280 00002000:00100000:2.0:1746126624.890711:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5954e00 x1830945721697280/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.890721:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954e00 with x1830945721697280 ext(2097152->3145727) 00002000:00010000:2.0:1746126624.890726:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5954e00 00000100:00100000:2.0:1746126624.890741:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721697792 00000100:00100000:2.0:1746126624.890743:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721697792 00002000:00100000:2.0:1746126624.890752:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e8ca680 x1830945721697792/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.890757:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8ca680 with x1830945721697792 ext(3145728->4194303) 00010000:00010000:2.0:1746126624.890764:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.890776:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746126624.890781:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e8ca680 00000100:00100000:2.0:1746126624.890802:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721697536 00000100:00100000:2.0:1746126624.890804:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721697536 00002000:00100000:2.0:1746126624.890814:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e8cb800 x1830945721697536/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126624.890819:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb800 with x1830945721697536 ext(3145728->4194303) 00002000:00010000:2.0:1746126624.890821:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cb800 00000100:00100000:2.0:1746126624.890860:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1852 00000100:00100000:2.0:1746126624.890866:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721697792:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126624.892237:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8047 00000100:00100000:2.0:1746126624.892246:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721697280:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126624.892441:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8048 00000100:00100000:1.0:1746126624.892450:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721697536:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.897385:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721458944:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126624.897417:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3366912->3538943] (req 3366912->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.897434:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcc200, rc 0) 00000100:00100000:3.0:1746126624.899302:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31575:x1830945721697024:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 19002us (19247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.899313:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14063 00000100:00100000:0.0:1746126624.910796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.910824:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.910848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.910865:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721697920 00000100:00100000:0.0:1746126624.910874:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721697920 00000100:00100000:0.0:1746126624.910911:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698048 00000100:00100000:0.0:1746126624.910913:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698048 00000100:00100000:0.0:1746126624.910923:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698176 00000100:00100000:0.0:1746126624.910924:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698176 00000100:00100000:0.0:1746126624.910940:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14064 00000100:00100000:0.0:1746126624.910947:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721697920:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126624.910965:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126624.910983:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b1200/0xb50e825867614dc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e95f expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126624.911046:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721459072:192.168.203.2@tcp:106: 00000100:00100000:0.0:1746126624.911115:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14065 00000100:00100000:0.0:1746126624.911120:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721698048:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126624.911127:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126624.911134:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e966 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.911145:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.911147:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.911155:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.911169:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.911179:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec81800, rc 0) 00000100:00100000:0.0:1746126624.911199:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721698048:12345-192.168.203.2@tcp:101:cat.0 Request processed in 78us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126624.911205:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14065 00000100:00100000:0.0:1746126624.911219:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14066 00000100:00100000:0.0:1746126624.911224:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721698176:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126624.911231:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126624.911240:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801348b1e00/0xb50e825867614dd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e96d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.911250:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.911257:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801348b1e00/0xb50e825867614dd1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e96d expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.911270:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348b1e00/0xb50e825867614dd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e96d expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.911285:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1e00, rc 0) 00000100:00100000:0.0:1746126624.911297:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721698176:12345-192.168.203.2@tcp:101:cat.0 Request processed in 74us (449us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126624.911303:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14066 00000100:00100000:0.0:1746126624.911325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.911337:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698304 00000100:00100000:0.0:1746126624.911339:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698304 00000100:00100000:0.0:1746126624.911351:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14067 00000100:00100000:0.0:1746126624.911355:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721698304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126624.911360:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126624.911366:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e974 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126624.911375:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.911377:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126624.911380:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.911387:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.911394:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b40c00, rc 0) 00000100:00100000:0.0:1746126624.911406:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721698304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126624.911411:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14067 00000100:00100000:0.0:1746126624.911896:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721697792:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 21028us (21366us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126624.911903:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1852 00002000:00100000:0.0:1746126624.911911:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e8ca680 x1830945721697792/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.911920:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8ca680 with x1830945721697792 ext(3145728->4194303) 00010000:00010000:0.0:1746126624.911927:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.911939:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746126624.911945:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e8ca680 00000100:00100000:0.0:1746126624.912543:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126624.920026:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721697536:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 27557us (29440us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.920042:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8048 00002000:00100000:1.0:1746126624.920053:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e8cb800 x1830945721697536/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.920061:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb800 with x1830945721697536 ext(3145728->4194303) 00002000:00010000:1.0:1746126624.920067:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cb800 00000100:00100000:0.0:1746126624.922243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.922585:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721697280:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 30339us (32103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126624.922596:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8047 00002000:00100000:3.0:1746126624.922607:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff8800a5954e00 x1830945721697280/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.922616:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5954e00 with x1830945721697280 ext(2097152->3145727) 00002000:00010000:3.0:1746126624.922622:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5954e00 00000100:00100000:2.0:1746126624.923978:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698432 00000100:00100000:2.0:1746126624.923988:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698432 00010000:00010000:2.0:1746126624.924024:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.924058:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7359 00000100:00100000:2.0:1746126624.924065:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721698432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.924078:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.924098:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.924108:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.924130:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c066a00/0xb50e825867614dae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e94a expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.924151:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.924154:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.924160:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.924168:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.924196:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 18 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.924207:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721459200:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.924276:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.925344:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721459072:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126624.925374:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b1200/0xb50e825867614dc3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e95f expref: 28 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.925386:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b1200/0xb50e825867614dc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e95f expref: 28 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126624.925399:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b1200, rc 0) 00000100:00100000:0.0:1746126624.925430:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721697920:12345-192.168.203.2@tcp:101:cat.0 Request processed in 14483us (14644us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126624.925439:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14064 00000100:00100000:0.0:1746126624.931230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.931267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.931302:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698560 00000100:00100000:2.0:1746126624.931311:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698560 00000100:00100000:2.0:1746126624.931349:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698688 00000100:00100000:2.0:1746126624.931351:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698688 00000100:00100000:3.0:1746126624.931359:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14068 00000100:00100000:3.0:1746126624.931369:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31569:x1830945721698560:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:2.0:1746126624.931373:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14069 00000100:00100000:2.0:1746126624.931378:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+27:31578:x1830945721698688:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126624.931388:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126624.931388:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126624.931404:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e97b expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.931404:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e982 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.931430:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 20 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.931430:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.931438:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.931440:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.931442:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126624.931443:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.931444:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126624.931446:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.931471:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.931472:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 20 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.931482:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.931483:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 19 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746126624.931494:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721459456:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.931496:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721459328:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126624.931655:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126624.931662:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.932107:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721459200:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126624.932121:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126624.932151:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721698432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8086us (9917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.932160:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7359 00000100:00100000:0.0:1746126624.936973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.937072:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721698944 00000100:00100000:3.0:1746126624.937083:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721698944 00002000:00100000:3.0:1746126624.937133:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3366912->3371007) req@ffff88009e8ca300 x1830945721698944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.937149:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8ca300 with x1830945721698944 ext(3366912->3371007) 00010000:00010000:3.0:1746126624.937158:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.937170:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 20 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.937177:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e8ca300 00000100:00100000:0.0:1746126624.937384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.937449:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721459328:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126624.937475:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 28 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.937490:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e4eba00, rc 0) 00000100:00100000:2.0:1746126624.937737:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:31578:x1830945721698688:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6357us (6467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126624.937747:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14069 00000100:00100000:3.0:1746126624.937756:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721459456:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126624.937771:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126624.937780:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093778e00, rc 0) 00000100:00100000:3.0:1746126624.937799:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31569:x1830945721698560:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6432us (6579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.937804:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14068 00000100:00100000:3.0:1746126624.938676:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721699072 00000100:00100000:3.0:1746126624.938684:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721699072 00000100:00100000:0.0:1746126624.938705:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1853 00002000:00100000:3.0:1746126624.938711:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1966080->2097151) req@ffff88009e8cb480 x1830945721699072/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746126624.938715:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721698944:12345-192.168.203.2@tcp:3:multiop.0 00002000:00100000:3.0:1746126624.938719:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb480 with x1830945721699072 ext(1966080->2097151) 00010000:00010000:3.0:1746126624.938726:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 20 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.938735:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 20 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.938742:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e8cb480 00000100:00100000:3.0:1746126624.938758:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1854 00000100:00100000:3.0:1746126624.938764:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721699072:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126624.938893:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721698944:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 180us (1930us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126624.938900:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1853 00002000:00100000:0.0:1746126624.938905:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3366912->3371007) req@ffff88009e8ca300 x1830945721698944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.938913:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8ca300 with x1830945721698944 ext(3366912->3371007) 00010000:00010000:0.0:1746126624.938918:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.938927:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746126624.938932:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e8ca300 00000100:00100000:3.0:1746126624.943085:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721699072:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 4308us (5688us total) trans 17179873303 rc 0/0 00000100:00100000:3.0:1746126624.943097:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1854 00002000:00100000:3.0:1746126624.943109:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1966080->2097151) req@ffff88009e8cb480 x1830945721699072/t17179873303(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.943119:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb480 with x1830945721699072 ext(1966080->2097151) 00010000:00010000:3.0:1746126624.943128:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.943140:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.943147:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e8cb480 00000100:00100000:0.0:1746126624.944666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.945324:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721699328 00000100:00100000:3.0:1746126624.945332:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721699328 00002000:00100000:3.0:1746126624.945366:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3534848->3538943) req@ffff88009e8c8000 x1830945721699328/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.945374:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8000 with x1830945721699328 ext(3534848->3538943) 00010000:00010000:3.0:1746126624.945382:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.945446:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.945452:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e8c8000 00000100:00100000:3.0:1746126624.945600:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1855 00000100:00100000:3.0:1746126624.945608:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721699328:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126624.945799:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721699328:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 191us (1135us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126624.945805:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1855 00002000:00100000:3.0:1746126624.945811:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3534848->3538943) req@ffff88009e8c8000 x1830945721699328/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/4536 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126624.945817:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8000 with x1830945721699328 ext(3534848->3538943) 00010000:00010000:3.0:1746126624.945822:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746126624.945852:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746126624.945857:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e8c8000 00000100:00100000:0.0:1746126624.950572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126624.951676:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721699456 00000100:00100000:2.0:1746126624.951688:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721699456 00010000:00010000:2.0:1746126624.951732:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746126624.951777:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7360 00000100:00100000:2.0:1746126624.951784:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721699456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126624.951799:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126624.951821:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.951856:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.951881:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40a00/0xb50e825867614d4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8e8 expref: 22 pid: 8437 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746126624.951904:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.951906:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126624.951913:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.951921:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126624.951954:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126624.951966:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721459584:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126624.952060:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126624.952641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.952857:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721699712 00000100:00100000:0.0:1746126624.952863:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721699712 00002000:00100000:0.0:1746126624.952894:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3366912->3538943) req@ffff8801367e8700 x1830945721699712/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.952903:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8700 with x1830945721699712 ext(3366912->3538943) 00010000:00010000:0.0:1746126624.952910:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746126624.952920:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 19 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746126624.952925:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801367e8700 00000100:00100000:0.0:1746126624.952948:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1856 00000100:00100000:0.0:1746126624.952953:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721699712:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:3.0:1746126624.954650:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721459584:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126624.954673:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126624.955108:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721699456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3321us (4543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126624.955121:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7360 00000100:00100000:0.0:1746126624.960875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.961913:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721699712:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 8955us (9268us total) trans 21474840450 rc 0/0 00000100:00100000:1.0:1746126624.961924:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1856 00002000:00100000:1.0:1746126624.961935:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3366912->3538943) req@ffff8801367e8700 x1830945721699712/t21474840450(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/448 e 0 to 0 dl 1746126635 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.961944:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367e8700 with x1830945721699712 ext(3366912->3538943) 00010000:00010000:1.0:1746126624.961954:0:21460:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.961968:0:21460:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746126624.961975:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801367e8700 00000100:00100000:0.0:1746126624.962126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126624.965445:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721699968 00000100:00100000:1.0:1746126624.965460:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721699968 00002000:00100000:1.0:1746126624.965514:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e8c9880 x1830945721699968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.965523:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c9880 with x1830945721699968 ext(1048576->2097151) 00002000:00010000:1.0:1746126624.965527:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c9880 00000100:00100000:1.0:1746126624.965559:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8049 00000100:00100000:1.0:1746126624.965567:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721699968:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.966537:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721700096 00000100:00100000:0.0:1746126624.966543:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721700096 00002000:00100000:0.0:1746126624.966566:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e8c8e00 x1830945721700096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.966573:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8e00 with x1830945721700096 ext(1048576->2097151) 00002000:00010000:0.0:1746126624.966576:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c8e00 00000100:00100000:0.0:1746126624.966602:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8050 00000100:00100000:0.0:1746126624.966608:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721700096:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126624.975143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126624.975213:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721700352 00000100:00100000:3.0:1746126624.975222:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721700352 00010000:00010000:3.0:1746126624.975258:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746126624.975631:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7361 00000100:00100000:1.0:1746126624.975650:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721700352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126624.975668:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126624.975701:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.975713:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.975740:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc200/0xb50e825867614dbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3538943) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e958 expref: 21 pid: 23766 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746126624.975772:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.975775:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126624.975782:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.975790:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126624.975848:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126624.975861:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721459712:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126624.975946:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126624.985478:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721700096:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18857us (23339us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126624.985490:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8050 00002000:00100000:0.0:1746126624.985503:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e8c8e00 x1830945721700096/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126624.985511:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8e00 with x1830945721700096 ext(1048576->2097151) 00002000:00010000:0.0:1746126624.985517:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c8e00 00000100:00100000:1.0:1746126624.986707:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721699968:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21138us (25840us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126624.986716:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8049 00002000:00100000:1.0:1746126624.986722:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e8c9880 x1830945721699968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.986730:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c9880 with x1830945721699968 ext(1048576->2097151) 00002000:00010000:1.0:1746126624.986733:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c9880 00000100:00100000:2.0:1746126624.986897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126624.986989:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721459712:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126624.987019:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126624.987480:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721700608 00000100:00100000:1.0:1746126624.987488:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721700608 00002000:00100000:1.0:1746126624.987522:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8801367eb100 x1830945721700608/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/0 e 0 to 0 dl 1746126635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126624.987529:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb100 with x1830945721700608 ext(3145728->4194303) 00002000:00010000:1.0:1746126624.987532:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb100 00000100:00100000:1.0:1746126624.987551:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8051 00000100:00100000:1.0:1746126624.987558:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721700608:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126624.988557:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721700352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 12909us (13418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126624.988567:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7361 00000100:00100000:1.0:1746126625.005946:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721700608:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 18376us (19036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126625.005959:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8051 00002000:00100000:1.0:1746126625.005972:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8801367eb100 x1830945721700608/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:385/0 lens 488/440 e 0 to 0 dl 1746126635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.005981:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801367eb100 with x1830945721700608 ext(3145728->4194303) 00002000:00010000:1.0:1746126625.005987:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801367eb100 00000100:00100000:3.0:1746126625.006138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.006479:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721700736 00000100:00100000:0.0:1746126625.006487:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721700736 00000100:00100000:0.0:1746126625.006531:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14070 00000100:00100000:0.0:1746126625.006538:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+25:31578:x1830945721700736:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126625.006553:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.006570:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e989 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.006594:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.006596:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.006603:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.006616:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.006627:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b55c00, rc 0) 00000100:00100000:0.0:1746126625.006650:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:31578:x1830945721700736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 113us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.006656:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14070 00000100:00100000:0.0:1746126625.015458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.015533:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721700864 00000100:00100000:2.0:1746126625.015543:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721700864 00000100:00100000:2.0:1746126625.015599:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14071 00000100:00100000:2.0:1746126625.015608:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1966:x1830945721700864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.015626:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.015643:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e990 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.015668:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.015670:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.015678:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.015693:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 22 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.015706:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f189400, rc 0) 00000100:00100000:2.0:1746126625.015764:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721700864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 157us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.015770:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14071 00000100:00100000:0.0:1746126625.022300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.022599:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721701120 00000100:00100000:1.0:1746126625.022610:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721701120 00002000:00100000:1.0:1746126625.022661:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009f11c000 x1830945721701120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.022671:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c000 with x1830945721701120 ext(4194304->4976639) 00002000:00010000:1.0:1746126625.022677:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11c000 00000100:00100000:1.0:1746126625.022696:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8052 00000100:00100000:1.0:1746126625.022703:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721701120:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.029326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.029370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.029403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.029444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.030138:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721701632 00000100:00100000:1.0:1746126625.030148:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721701632 00002000:00100000:1.0:1746126625.030193:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009f11c380 x1830945721701632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.030202:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c380 with x1830945721701632 ext(3145728->4194303) 00002000:00010000:1.0:1746126625.030207:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11c380 00000100:00100000:1.0:1746126625.030226:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721701504 00000100:00100000:1.0:1746126625.030228:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721701504 00000100:00100000:3.0:1746126625.030234:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721701760 00000100:00100000:3.0:1746126625.030239:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721701760 00002000:00100000:1.0:1746126625.030240:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009f11f800 x1830945721701504/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.030247:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11f800 with x1830945721701504 ext(2097152->3145727) 00002000:00010000:1.0:1746126625.030250:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11f800 00000100:00100000:1.0:1746126625.030260:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721702016 00002000:00100000:3.0:1746126625.030261:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f11fb80 x1830945721701760/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746126625.030262:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721702016 00002000:00100000:3.0:1746126625.030269:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11fb80 with x1830945721701760 ext(2097152->3145727) 00002000:00010000:3.0:1746126625.030272:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11fb80 00000100:00100000:3.0:1746126625.030301:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8053 00000100:00100000:1.0:1746126625.030308:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8054 00000100:00100000:3.0:1746126625.030309:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721701632:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126625.030315:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721701504:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:1.0:1746126625.030371:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f11ed80 x1830945721702016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.030383:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11ed80 with x1830945721702016 ext(3145728->4194303) 00002000:00010000:1.0:1746126625.030386:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11ed80 00000100:00100000:0.0:1746126625.030494:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8055 00000100:00100000:0.0:1746126625.030501:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+27:1965:x1830945721701760:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.030553:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8056 00000100:00100000:3.0:1746126625.030587:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721702016:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.038417:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721701120:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15702us (16115us total) trans 0 rc 782336/782336 00000100:00100000:0.0:1746126625.038430:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8052 00002000:00100000:0.0:1746126625.038443:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009f11c000 x1830945721701120/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.038453:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c000 with x1830945721701120 ext(4194304->4976639) 00002000:00010000:0.0:1746126625.038459:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11c000 00000100:00100000:1.0:1746126625.059732:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721701504:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29406us (30350us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126625.059745:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8054 00002000:00100000:1.0:1746126625.059757:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009f11f800 x1830945721701504/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.059767:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11f800 with x1830945721701504 ext(2097152->3145727) 00000100:00100000:2.0:1746126625.059771:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721701760:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29269us (30365us total) trans 0 rc 1048576/1048576 00002000:00010000:1.0:1746126625.059773:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11f800 00000100:00100000:2.0:1746126625.059779:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8055 00002000:00100000:2.0:1746126625.059785:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009f11fb80 x1830945721701760/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.059792:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11fb80 with x1830945721701760 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.059796:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11fb80 00000100:00100000:3.0:1746126625.060176:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721701632:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29867us (30859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.060183:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8053 00002000:00100000:3.0:1746126625.060187:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009f11c380 x1830945721701632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.060193:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11c380 with x1830945721701632 ext(3145728->4194303) 00002000:00010000:3.0:1746126625.060196:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f11c380 00000100:00100000:2.0:1746126625.067794:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721702016:12345-192.168.203.2@tcp:3:cat.0 Request processed in 37222us (38336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.067807:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8056 00002000:00100000:2.0:1746126625.067819:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f11ed80 x1830945721702016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.067841:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11ed80 with x1830945721702016 ext(3145728->4194303) 00002000:00010000:2.0:1746126625.067847:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11ed80 00000100:00100000:0.0:1746126625.080324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.081138:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721702400 00000100:00100000:2.0:1746126625.081149:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721702400 00002000:00100000:2.0:1746126625.081202:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009bb2c700 x1830945721702400/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.081212:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830945721702400 ext(4194304->4976639) 00002000:00010000:2.0:1746126625.081218:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c700 00000100:00100000:2.0:1746126625.081248:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8057 00000100:00100000:2.0:1746126625.081256:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721702400:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.089538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.089760:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721702528 00000100:00100000:2.0:1746126625.089942:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721702528 00000100:00100000:2.0:1746126625.089986:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14072 00000100:00100000:2.0:1746126625.089993:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:31581:x1830945721702528:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126625.090022:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.090040:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e997 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.090067:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.090075:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.090080:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.090081:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.090084:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2605056->3145727] (req 2605056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 29 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.090548:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.090562:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 29 pid: 8438 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.090575:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721459840:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.091282:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721702400:12345-192.168.203.2@tcp:3:cat.0 Request processed in 10024us (10968us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126625.091398:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8057 00002000:00100000:3.0:1746126625.091408:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009bb2c700 x1830945721702400/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.091416:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830945721702400 ext(4194304->4976639) 00002000:00010000:3.0:1746126625.091421:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c700 00010000:00010000:2.0:1746126625.091769:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.091782:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 21 pid: 23766 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.091799:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721459968:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.092525:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126625.096318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.096408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.096434:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721702784 00000100:00100000:0.0:1746126625.096441:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721702784 00000100:00100000:0.0:1746126625.096492:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14073 00000100:00100000:0.0:1746126625.096500:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721702784:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126625.096518:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.096534:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dfd7600/0xb50e825867614e02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e99e expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.096555:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.096564:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dfd7600/0xb50e825867614e02 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e99e expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.096573:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dfd7600/0xb50e825867614e02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e99e expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.096585:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dfd7600, rc 0) 00000100:00100000:0.0:1746126625.096625:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721702784:12345-192.168.203.2@tcp:101:cat.0 Request processed in 125us (217us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126625.096630:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14073 00000100:00100000:1.0:1746126625.097070:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721702656 00000100:00100000:1.0:1746126625.097075:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721702656 00010000:00010000:1.0:1746126625.097094:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 30 pid: 8438 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.097188:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721459840:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.097304:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7362 00000100:00100000:1.0:1746126625.097310:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721702656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.097319:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.097341:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 30 pid: 8438 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.097351:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 30 pid: 8438 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.097368:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b40c00/0xb50e825867614dd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e974 expref: 30 pid: 8438 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.097384:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.097763:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721702656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 98us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.097770:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7362 00000100:00100000:2.0:1746126625.097852:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4640:1830945721459968:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.097875:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2605056->3145727] (req 2605056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.097884:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f188400, rc 0) 00000100:00100000:2.0:1746126625.097906:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:31581:x1830945721702528:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7913us (8378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.097911:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14072 00000100:00100000:0.0:1746126625.100113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.100220:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721702912 00000100:00100000:2.0:1746126625.100228:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721702912 00000100:00100000:2.0:1746126625.100321:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14074 00000100:00100000:2.0:1746126625.100329:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721702912:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.100345:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.100360:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f188a00/0xb50e825867614e09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9a5 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.100382:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.100391:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f188a00/0xb50e825867614e09 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9a5 expref: 29 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.100401:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f188a00/0xb50e825867614e09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9a5 expref: 29 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.100569:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f188a00, rc 0) 00000100:00100000:2.0:1746126625.100620:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721702912:12345-192.168.203.2@tcp:101:cat.0 Request processed in 291us (513us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126625.100626:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14074 00000100:00100000:2.0:1746126625.102339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.102401:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721703040 00000100:00100000:3.0:1746126625.102408:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721703040 00010000:00010000:3.0:1746126625.102436:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 22 pid: 23766 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.102469:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7363 00000100:00100000:3.0:1746126625.102475:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721703040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.102487:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.102508:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 22 pid: 23766 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.102519:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 22 pid: 23766 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.102539:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c067400/0xb50e825867614db5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e951 expref: 22 pid: 23766 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.102563:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.102564:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.102572:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.102579:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.102609:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.102619:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721460096:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126625.102687:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126625.105993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.106097:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721460096:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126625.106116:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.106170:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1964:x1830945721703040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3691us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.106182:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7363 00000100:00100000:2.0:1746126625.106260:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721703296 00000100:00100000:2.0:1746126625.106266:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721703296 00002000:00100000:2.0:1746126625.106310:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2605056->2609151) req@ffff88009bb2d180 x1830945721703296/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.106320:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d180 with x1830945721703296 ext(2605056->2609151) 00002000:00010000:2.0:1746126625.106324:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2d180 00000100:00100000:2.0:1746126625.106347:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8058 00000100:00100000:2.0:1746126625.106354:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721703296:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126625.106506:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721703296:12345-192.168.203.2@tcp:3:cat.0 Request processed in 151us (521us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126625.106511:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8058 00002000:00100000:2.0:1746126625.106516:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2605056->2609151) req@ffff88009bb2d180 x1830945721703296/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.106523:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d180 with x1830945721703296 ext(2605056->2609151) 00002000:00010000:2.0:1746126625.106526:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2d180 00000100:00100000:0.0:1746126625.116128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.116466:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721703424 00000100:00100000:2.0:1746126625.116475:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721703424 00000100:00100000:2.0:1746126625.116533:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14075 00000100:00100000:2.0:1746126625.116541:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:31581:x1830945721703424:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126625.116559:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.116577:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9ac expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.116607:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.116615:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.116621:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.116623:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.116626:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.116655:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.116667:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 27 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.116678:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721460224:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.116776:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 19 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.116918:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 19 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.116936:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721460352:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.116959:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126625.123190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.123300:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721703552 00000100:00100000:3.0:1746126625.123309:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721703552 00010000:00010000:3.0:1746126625.123348:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.123392:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7364 00000100:00100000:3.0:1746126625.123399:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721703552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.123413:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.123436:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.123452:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.123479:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126625.123503:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b55c00/0xb50e825867614ded lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e989 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.123520:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721703552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 121us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.123520:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721460224:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.123526:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7364 00000100:00100000:3.0:1746126625.124568:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721460352:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.124592:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.124602:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f188800, rc 0) 00000100:00100000:3.0:1746126625.124636:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:31581:x1830945721703424:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 8097us (8519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.124643:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14075 00000100:00100000:3.0:1746126625.125333:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2fb79569-8691-41f9-a471-439cf21ba3b2:3295:1830945721460480:0@lo:400:kworker.0 00000100:00100000:3.0:1746126625.125371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.125434:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721460864:0@lo:400:kworker.0 00000100:00100000:2.0:1746126625.125459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.125482:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746126625.125486:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721460992:0@lo:400:kworker.0 00000100:00100000:2.0:1746126625.125503:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.125522:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1830945721460608:0@lo:400:kworker.0 00000100:00100000:2.0:1746126625.125543:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.125556:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830945721461120:0@lo:400:kworker.0 00000100:00100000:2.0:1746126625.125568:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.125591:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746126625.125596:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721460736:0@lo:400:kworker.0 00000100:00100000:2.0:1746126625.125612:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.125659:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460864 00000100:00100000:3.0:1746126625.125663:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460864 00000100:00100000:1.0:1746126625.127630:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460608 00000100:00100000:1.0:1746126625.127639:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460608 00000100:00100000:1.0:1746126625.127671:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461120 00000100:00100000:1.0:1746126625.127673:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461120 00000100:00100000:1.0:1746126625.127685:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460736 00000100:00100000:1.0:1746126625.127686:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460736 00000100:00100000:1.0:1746126625.127698:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746126625.127704:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830945721460608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126625.127754:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830945721460608:12345-0@lo:400:kworker.0 Request processed in 51us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.127759:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746126625.127770:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1746126625.127773:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830945721461120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126625.127790:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830945721461120:12345-0@lo:400:kworker.0 Request processed in 16us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.127794:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1746126625.127800:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1746126625.127804:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721460736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126625.127823:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721460736:12345-0@lo:400:kworker.0 Request processed in 19us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.127842:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1746126625.127857:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746126625.127861:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126625.127944:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460992 00000100:00100000:3.0:1746126625.127948:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460992 00000100:00100000:3.0:1746126625.127982:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1746126625.127988:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3294:x1830945721460864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126625.128027:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3294:x1830945721460864:12345-0@lo:400:kworker.0 Request processed in 40us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.128035:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1746126625.128035:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721460736:0@lo:400:kworker.0 00000100:00100000:3.0:1746126625.128044:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1746126625.128045:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1830945721460608:0@lo:400:kworker.0 00000100:00100000:3.0:1746126625.128048:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746126625.128053:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830945721461120:0@lo:400:kworker.0 00000100:00100000:3.0:1746126625.128067:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830945721460992:12345-0@lo:400:kworker.0 Request processed in 19us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.128071:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1746126625.128082:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873274 gen 2 00000004:00080000:2.0:1746126625.128087:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15e300, transno 17179873223 00000004:00080000:2.0:1746126625.128094:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15c000, transno 17179873224 00000004:00080000:2.0:1746126625.128096:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801367e9f80, transno 17179873225 00000004:00080000:2.0:1746126625.128098:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15ce00, transno 17179873226 00000004:00080000:2.0:1746126625.128101:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801367eaa00, transno 17179873227 00000004:00080000:2.0:1746126625.128103:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15d180, transno 17179873228 00000004:00080000:2.0:1746126625.128105:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15d500, transno 17179873229 00000004:00080000:2.0:1746126625.128106:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15c700, transno 17179873230 00000004:00080000:2.0:1746126625.128108:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f15fb80, transno 17179873231 00000004:00080000:2.0:1746126625.128110:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f134000, transno 17179873244 00000004:00080000:2.0:1746126625.128112:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af6d80, transno 17179873245 00000004:00080000:2.0:1746126625.128114:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f136d80, transno 17179873246 00000004:00080000:2.0:1746126625.128116:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af6680, transno 17179873247 00000004:00080000:2.0:1746126625.128119:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f135500, transno 17179873248 00000004:00080000:2.0:1746126625.128121:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093af5880, transno 17179873249 00000004:00080000:2.0:1746126625.128123:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcce00, transno 17179873250 00000004:00080000:2.0:1746126625.128125:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f135880, transno 17179873251 00000004:00080000:2.0:1746126625.128127:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f135c00, transno 17179873252 00000004:00080000:2.0:1746126625.128129:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009220b100, transno 17179873253 00000004:00080000:2.0:1746126625.128132:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d5c00, transno 17179873254 00000004:00080000:2.0:1746126625.128134:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11d180, transno 17179873255 00000004:00080000:2.0:1746126625.128136:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009220b800, transno 17179873256 00000004:00080000:2.0:1746126625.128138:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d7800, transno 17179873257 00000004:00080000:2.0:1746126625.128140:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9d6680, transno 17179873258 00000004:00080000:2.0:1746126625.128142:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f11d880, transno 17179873259 00000004:00080000:2.0:1746126625.128145:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092209500, transno 17179873260 00000004:00080000:2.0:1746126625.128147:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801367e9180, transno 17179873261 00000004:00080000:2.0:1746126625.128149:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f54000, transno 17179873266 00000004:00080000:2.0:1746126625.128151:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f55500, transno 17179873267 00000004:00080000:2.0:1746126625.128153:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f54700, transno 17179873268 00000004:00080000:2.0:1746126625.128156:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f56300, transno 17179873269 00000004:00080000:2.0:1746126625.128158:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f54380, transno 17179873270 00000004:00080000:2.0:1746126625.128160:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f254e00, transno 17179873271 00000004:00080000:2.0:1746126625.128162:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f55f80, transno 17179873272 00000004:00080000:2.0:1746126625.128164:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f257480, transno 17179873273 00000004:00080000:2.0:1746126625.128166:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f255500, transno 17179873274 00000100:00100000:2.0:1746126625.128172:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880092b15c00 x1830945721435648/t17179873275(17179873275) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126638 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:2.0:1746126625.128181:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721460992:0@lo:400:kworker.0 00000100:00080000:1.0:1746126625.128265:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126625.128430:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721460480 00000100:00100000:0.0:1746126625.128435:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721460480 00000100:00100000:0.0:1746126625.128455:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1746126625.128460:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3295:x1830945721460480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126625.128493:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3295:x1830945721460480:12345-0@lo:400:kworker.0 Request processed in 33us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.128498:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1746126625.128508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.128523:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721703680 00000100:00100000:1.0:1746126625.128525:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721703680 00010000:00010000:1.0:1746126625.128542:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.128655:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7365 00000100:00100000:1.0:1746126625.128660:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721703680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.128669:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.128689:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.128700:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.128722:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093778e00/0xb50e825867614de6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e97b expref: 20 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.128737:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.128739:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.128746:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.128754:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.128787:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126625.128797:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721461248:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126625.128851:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.129057:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840438 gen 2 00000004:00080000:2.0:1746126625.129062:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8f100, transno 21474840371 00000004:00080000:3.0:1746126625.129071:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 46 in progress, 0 in flight, 8 done 00000004:00080000:2.0:1746126625.129072:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3ca80, transno 21474840372 00000004:00080000:2.0:1746126625.129075:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8ea00, transno 21474840373 00000004:00080000:2.0:1746126625.129078:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3c000, transno 21474840374 00000004:00080000:2.0:1746126625.129080:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8ed80, transno 21474840375 00000004:00080000:2.0:1746126625.129082:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8e680, transno 21474840376 00000004:00080000:2.0:1746126625.129084:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8f480, transno 21474840377 00000004:00080000:2.0:1746126625.129086:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134c3df80, transno 21474840378 00000004:00080000:2.0:1746126625.129089:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e9180, transno 21474840394 00000004:00080000:2.0:1746126625.129091:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8000, transno 21474840395 00000004:00080000:2.0:1746126625.129093:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918eaa00, transno 21474840396 00000004:00080000:2.0:1746126625.129095:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8380, transno 21474840397 00000004:00080000:2.0:1746126625.129097:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8e00, transno 21474840398 00000004:00080000:2.0:1746126625.129099:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8700, transno 21474840399 00000004:00080000:2.0:1746126625.129101:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918e8a80, transno 21474840400 00000004:00080000:2.0:1746126625.129103:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800918eb100, transno 21474840401 00000004:00080000:2.0:1746126625.129105:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6300, transno 21474840402 00000004:00080000:2.0:1746126625.129108:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f7800, transno 21474840403 00000004:00080000:2.0:1746126625.129111:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5f80, transno 21474840404 00000004:00080000:2.0:1746126625.129113:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5500, transno 21474840405 00000004:00080000:2.0:1746126625.129115:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4700, transno 21474840406 00000004:00080000:2.0:1746126625.129117:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f6680, transno 21474840407 00000004:00080000:2.0:1746126625.129118:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f4e00, transno 21474840408 00000004:00080000:2.0:1746126625.129120:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e3f5880, transno 21474840409 00000004:00080000:2.0:1746126625.129122:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fd180, transno 21474840415 00000004:00080000:2.0:1746126625.129124:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fdc00, transno 21474840416 00000004:00080000:2.0:1746126625.129126:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fe680, transno 21474840417 00000004:00080000:2.0:1746126625.129128:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ffb80, transno 21474840418 00000004:00080000:2.0:1746126625.129130:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff800, transno 21474840419 00000004:00080000:2.0:1746126625.129132:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fd880, transno 21474840420 00000004:00080000:2.0:1746126625.129134:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fc000, transno 21474840421 00000004:00080000:2.0:1746126625.129136:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fea00, transno 21474840422 00000004:00080000:2.0:1746126625.129138:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fd500, transno 21474840423 00000004:00080000:2.0:1746126625.129140:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff480, transno 21474840424 00000004:00080000:2.0:1746126625.129142:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fdf80, transno 21474840425 00000004:00080000:2.0:1746126625.129145:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9ff100, transno 21474840426 00000004:00080000:2.0:1746126625.129147:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fc380, transno 21474840427 00000004:00080000:2.0:1746126625.129148:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fce00, transno 21474840428 00000004:00080000:2.0:1746126625.129150:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fe300, transno 21474840429 00000004:00080000:2.0:1746126625.129153:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fca80, transno 21474840430 00000004:00080000:2.0:1746126625.129155:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dabb800, transno 21474840431 00000004:00080000:2.0:1746126625.129156:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dab8e00, transno 21474840432 00000004:00080000:2.0:1746126625.129158:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dabbb80, transno 21474840433 00000004:00080000:2.0:1746126625.129160:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dabb100, transno 21474840434 00000004:00080000:2.0:1746126625.129162:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dab9c00, transno 21474840435 00000004:00080000:2.0:1746126625.129164:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dab8380, transno 21474840436 00000004:00080000:2.0:1746126625.129165:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008dabb480, transno 21474840437 00000004:00080000:2.0:1746126625.129168:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008daba680, transno 21474840438 00000100:00100000:2.0:1746126625.129172:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721460864:0@lo:400:kworker.0 00000004:00080000:3.0:1746126625.129211:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 18 in progress, 0 in flight, 28 done 00000100:00100000:2.0:1746126625.129213:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2fb79569-8691-41f9-a471-439cf21ba3b2:3295:1830945721460480:0@lo:400:kworker.0 00000004:00080000:2.0:1746126625.130186:0:14592:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 48 done 00000100:00100000:1.0:1746126625.131679:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721461248:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126625.131699:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.131745:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721703680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3084us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.131754:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7365 00000100:00100000:0.0:1746126625.133187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.133250:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721703936 00000100:00100000:3.0:1746126625.133259:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721703936 00002000:00100000:3.0:1746126625.133316:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3252224->3256319) req@ffff88009bb2f480 x1830945721703936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.133325:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f480 with x1830945721703936 ext(3252224->3256319) 00002000:00010000:3.0:1746126625.133330:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f480 00000100:00100000:3.0:1746126625.133359:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8059 00000100:00100000:3.0:1746126625.133366:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721703936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.133534:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721703936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 167us (352us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126625.133540:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8059 00002000:00100000:3.0:1746126625.133545:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3252224->3256319) req@ffff88009bb2f480 x1830945721703936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.133552:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f480 with x1830945721703936 ext(3252224->3256319) 00002000:00010000:3.0:1746126625.133555:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f480 00000100:00100000:0.0:1746126625.148741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.148980:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721704064 00000100:00100000:2.0:1746126625.148989:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721704064 00000100:00100000:3.0:1746126625.149227:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9059 00000100:00100000:3.0:1746126625.149236:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31584:x1830945721704064:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.149260:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.149278:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc400/0xb50e825867614e17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9b3 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.149337:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149350:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149361:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149373:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149378:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149383:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149492:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149502:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 241 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.149509:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 31 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.149515:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.149544:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 31 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.149555:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 31 pid: 15560 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.149566:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721461376:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.149658:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 241 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.149667:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 241 pid: 15560 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.149675:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721461504:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.149693:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af199c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746126625.149759:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746126625.151138:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721461376:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.151148:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721461504:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.151165:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.152263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.152452:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721704320 00000100:00100000:1.0:1746126625.152459:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721704320 00000100:00100000:2.0:1746126625.152722:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3856 00000100:00100000:2.0:1746126625.152734:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+32:15413:x1830945721704320:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746126625.152821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.152895:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721704576 00000100:00100000:1.0:1746126625.152898:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721704576 00000100:00100000:1.0:1746126625.152928:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3857 00000100:00100000:1.0:1746126625.152934:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+242:26823:x1830945721704576:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746126625.153054:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+33:15413:x1830945721704320:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 320us (794us total) trans 8589943261 rc 0/0 00000100:00100000:2.0:1746126625.153061:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3856 00000100:00100000:1.0:1746126625.153179:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+243:26823:x1830945721704576:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 244us (356us total) trans 8589943262 rc 0/0 00000100:00100000:1.0:1746126625.153185:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3857 00000100:00100000:0.0:1746126625.155315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.155495:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721704704 00000100:00100000:1.0:1746126625.155508:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721704704 00010000:00010000:1.0:1746126625.155542:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 33 pid: 15560 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.155890:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7366 00000100:00100000:1.0:1746126625.155898:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+33:1964:x1830945721704704:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.155912:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.155918:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 33 pid: 15560 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.155928:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 33 pid: 15560 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.155949:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614d37 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8da expref: 33 pid: 15560 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.155965:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.156146:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.156156:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.156161:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.156166:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.156425:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1964:x1830945721704704:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 312us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.156432:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7366 00000100:00100000:2.0:1746126625.156917:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746126625.156924:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746126625.156930:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721461632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746126625.156931:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721461760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746126625.156966:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.156988:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461632 00000100:00100000:3.0:1746126625.156992:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461632 00000100:00100000:3.0:1746126625.157034:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1746126625.157039:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830945721461632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746126625.157060:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 623968256 pending 18743296 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746126625.157099:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830945721461632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.157104:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1746126625.157120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.157129:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721461760 00000100:00100000:1.0:1746126625.157132:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721461760 00000100:00100000:1.0:1746126625.157152:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1746126625.157157:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830945721461760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746126625.157180:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 615579648 pending 20447232 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746126625.157207:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830945721461760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.157212:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1746126625.157336:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721461760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746126625.157748:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721461632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746126625.157824:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.158201:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721704832 00000100:00100000:2.0:1746126625.158205:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721704832 00010000:00010000:2.0:1746126625.158226:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 243 pid: 15560 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.158258:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7367 00000100:00100000:2.0:1746126625.158263:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+243:1963:x1830945721704832:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.158273:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.158278:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 243 pid: 15560 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.158294:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 243 pid: 15560 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.158312:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a000/0xb50e825867614d0d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e8be expref: 243 pid: 15560 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.158326:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.158331:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.158340:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.158346:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.158370:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.158403:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+242:1963:x1830945721704832:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 139us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.158408:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7367 00010000:00010000:3.0:1746126625.159591:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159604:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126625.159648:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126625.159653:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126625.159670:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159681:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159691:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159697:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159703:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159708:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fcc600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126625.159711:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159721:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159732:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126625.159734:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126625.159737:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159741:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159761:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159767:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159771:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159774:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fcc000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126625.159776:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159781:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159786:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ecc1000) 00010000:00010000:3.0:1746126625.159788:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126625.159790:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159795:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc000/0xb50e825867614e25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.159848:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc400/0xb50e825867614e17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.159860:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 13 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.159866:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.159868:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126625.159870:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcd200, rc 0) 00000100:00100000:3.0:1746126625.159911:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31584:x1830945721704064:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 10676us (11179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.159917:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9059 00000100:00100000:0.0:1746126625.162357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.162535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.162799:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721704960 00000100:00100000:2.0:1746126625.162810:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721704960 00000100:00100000:3.0:1746126625.162939:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705088 00000100:00100000:3.0:1746126625.162943:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705088 00000100:00100000:0.0:1746126625.162984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.163087:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705216 00000100:00100000:2.0:1746126625.163090:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705216 00000100:00100000:2.0:1746126625.163105:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14076 00000100:00100000:2.0:1746126625.163113:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1964:x1830945721704960:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126625.163129:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.163147:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9ba expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.163270:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14077 00000100:00100000:3.0:1746126625.163276:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721705216:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.163283:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.163294:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9c8 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746126625.163296:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746126625.163299:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746126625.163310:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.163312:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.163320:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.163335:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.163351:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcc800, rc 0) 00010000:00010000:2.0:1746126625.163355:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.163357:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.163362:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 6 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.163372:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 6 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.163378:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f189c00, rc 0) 00000100:00100000:3.0:1746126625.163403:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721705216:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 127us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.163409:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14077 00000100:00100000:3.0:1746126625.163442:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14078 00000100:00100000:3.0:1746126625.163447:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721705088:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.163452:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.163459:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9c1 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.163469:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.163470:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.163474:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.163482:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.163488:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcd800, rc 0) 00000100:00100000:2.0:1746126625.163518:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721704960:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 405us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.163523:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14076 00000100:00100000:3.0:1746126625.163568:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721705088:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 120us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.163572:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14078 00000100:00100000:0.0:1746126625.163647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.163702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.163780:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705344 00000100:00100000:3.0:1746126625.163783:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705344 00000100:00100000:3.0:1746126625.163795:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705472 00000100:00100000:3.0:1746126625.163797:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705472 00000100:00100000:0.0:1746126625.163797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.163807:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705600 00000100:00100000:3.0:1746126625.163809:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705600 00000100:00100000:3.0:1746126625.163820:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14079 00000100:00100000:3.0:1746126625.163824:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721705344:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.163852:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.163859:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9cf expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.163869:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.163871:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.163875:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.163884:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.163891:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcda00, rc 0) 00000100:00100000:3.0:1746126625.163917:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721705344:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.163922:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14079 00000100:00100000:3.0:1746126625.163931:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14080 00000100:00100000:3.0:1746126625.163936:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721705472:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.163942:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.163948:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fcd600/0xb50e825867614e4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9d6 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.163982:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721461888:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126625.164049:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14081 00000100:00100000:2.0:1746126625.164055:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721705600:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:2.0:1746126625.164061:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.164067:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f188c00/0xb50e825867614e56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9dd expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.164090:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721462016:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126625.164123:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126625.164291:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126625.165383:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4641:1830945721462016:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126625.165387:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721461888:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126625.165405:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f188c00/0xb50e825867614e56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9dd expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.165405:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092fcd600/0xb50e825867614e4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9d6 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.165415:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f188c00/0xb50e825867614e56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9dd expref: 9 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.165415:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fcd600/0xb50e825867614e4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9d6 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.165424:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f188c00, rc 0) 00010000:00010000:2.0:1746126625.165424:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcd600, rc 0) 00000100:00100000:2.0:1746126625.165458:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721705472:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 1520us (1754us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126625.165464:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14080 00000100:00100000:3.0:1746126625.165511:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721705600:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 1456us (1713us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126625.165516:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14081 00000100:00100000:0.0:1746126625.167766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.167862:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705856 00000100:00100000:3.0:1746126625.167869:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705856 00000100:00100000:3.0:1746126625.167916:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9060 00000100:00100000:3.0:1746126625.167922:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31584:x1830945721705856:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.167936:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.167950:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc200/0xb50e825867614e5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9e4 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.168045:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.168057:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.168063:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.168091:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.168102:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 14 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.168112:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721462144:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.168187:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126625.170260:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721462144:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.170279:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.170542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.170659:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721705984 00000100:00100000:2.0:1746126625.170665:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721705984 00010000:00010000:2.0:1746126625.170692:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 15 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.170726:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7368 00000100:00100000:2.0:1746126625.170733:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721705984:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.170745:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.170751:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 15 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.170762:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 15 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.170781:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcd200/0xb50e825867614e2c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9b3 expref: 15 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.170794:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.170798:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.170806:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.170813:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.170852:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.170882:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721705984:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.170888:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7368 00010000:00010000:3.0:1746126625.170950:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.170956:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126625.170972:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126625.171108:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc200/0xb50e825867614e5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9e4 expref: 15 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.171121:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9e4 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.171127:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.171130:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126625.171132:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fccc00, rc 0) 00000100:00100000:3.0:1746126625.171167:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31584:x1830945721705856:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 3245us (3406us total) trans 8589943263 rc 0/0 00000100:00100000:3.0:1746126625.171174:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9060 00000100:00100000:0.0:1746126625.172892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.172990:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721706240 00000100:00100000:3.0:1746126625.172996:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721706240 00000100:00100000:3.0:1746126625.173278:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9061 00000100:00100000:3.0:1746126625.173285:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31584:x1830945721706240:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.173302:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.173305:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746126625.173321:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fccc00/0xb50e825867614e64 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9e4 expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.173332:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.173335:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126625.173344:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614e72 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9eb expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.173417:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcde00/0xb50e825867614e79 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.173433:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcde00/0xb50e825867614e79 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.173442:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcde00/0xb50e825867614e79 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126625.173452:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126625.173529:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614e72 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9eb expref: 16 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.173545:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcde00/0xb50e825867614e79 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9eb expref: 15 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.173550:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.173553:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126625.173554:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcde00, rc 0) 00000100:00100000:3.0:1746126625.173620:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31584:x1830945721706240:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 335us (731us total) trans 8589943264 rc 0/0 00000100:00100000:3.0:1746126625.173626:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9061 00000100:00100000:0.0:1746126625.174908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.174993:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721706368 00000100:00100000:3.0:1746126625.174998:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721706368 00000100:00100000:3.0:1746126625.175044:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9062 00000100:00100000:3.0:1746126625.175050:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31584:x1830945721706368:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126625.175064:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.175074:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9f2 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.175113:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f2 expref: 16 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.175123:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f2 expref: 16 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.175137:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.175140:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126625.175142:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcc600, rc 0) 00000100:00100000:3.0:1746126625.175556:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:31584:x1830945721706368:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 504us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.175562:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9062 00000100:00100000:0.0:1746126625.177557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.177594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.177639:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721706624 00000100:00100000:2.0:1746126625.177648:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721706624 00000100:00100000:3.0:1746126625.177664:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721706880 00000100:00100000:3.0:1746126625.177668:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721706880 00000100:00100000:2.0:1746126625.177686:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14082 00000100:00100000:2.0:1746126625.177691:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721706624:12345-192.168.203.2@tcp:1:mirror_io.0 00000100:00100000:0.0:1746126625.177727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126625.177729:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.177746:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.177754:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.177760:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 20 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.177766:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.177767:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.177770:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.177803:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 20 pid: 17475 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126625.177811:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14083 00010000:00010000:2.0:1746126625.177814:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 20 pid: 17475 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.177817:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721706880:12345-192.168.203.2@tcp:1:mirror_io.0 00000100:00100000:2.0:1746126625.177843:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721462272:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.177855:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.177864:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 18 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.177870:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.177877:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 25 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.177882:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.177883:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.177885:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.178013:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 25 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.178021:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 25 pid: 9686 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.178030:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721462400:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.179089:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.179099:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 7 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.179120:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721462528:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.179266:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 8 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.179275:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 8 pid: 4641 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.179283:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721462656:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.179311:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.179319:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 27 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.179327:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721462784:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.179343:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093015780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.179363:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707136 00000100:00100000:2.0:1746126625.179367:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707136 00000100:00100000:2.0:1746126625.179399:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14084 00000100:00100000:2.0:1746126625.179405:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721707136:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:2.0:1746126625.179428:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.179439:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.179445:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126625.179446:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126625.179449:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.179465:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 27 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.179472:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 27 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.179479:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721462912:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.179501:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cce480 going to sleep for 11 seconds 00010000:00010000:3.0:1746126625.179548:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 18 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.179556:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 18 pid: 10890 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.179564:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721463040:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.179580:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126625.179760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.179790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.179818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.180145:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721706496 00000100:00100000:3.0:1746126625.180148:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721706496 00000100:00100000:3.0:1746126625.180431:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721706752 00000100:00100000:2.0:1746126625.180432:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707008 00000100:00100000:3.0:1746126625.180435:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721706752 00000100:00100000:2.0:1746126625.180436:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707008 00000100:00100000:2.0:1746126625.180462:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14085 00000100:00100000:2.0:1746126625.180467:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721706496:12345-192.168.203.2@tcp:1:mirror_io.0 00000100:00100000:3.0:1746126625.180469:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14086 00000100:00100000:3.0:1746126625.180474:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721706752:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:3.0:1746126625.180491:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.180491:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180506:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.180506:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180513:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.180513:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 9 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.180519:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 27 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.180519:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.180524:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.180525:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.180525:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.180526:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.180527:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180528:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180544:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 27 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.180545:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.180551:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 27 pid: 8438 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.180552:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 25 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.180558:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721463168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.180560:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721463296:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.180601:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 10 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.180610:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 10 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.180610:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 9 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.180617:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 9 pid: 17475 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.180622:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721463424:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.180628:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721463552:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.180647:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.180650:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180654:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.180657:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.180661:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721463680:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.180663:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721463808:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.180677:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.180679:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6900 going to sleep for 11 seconds 00000100:00100000:3.0:1746126625.180690:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14087 00000100:00100000:3.0:1746126625.180695:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721707008:12345-192.168.203.2@tcp:1:mirror_io.0 00010000:00010000:3.0:1746126625.180710:0:4640:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180720:0:4640:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180725:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126625.180726:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126625.180728:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180744:0:4640:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.180755:0:4640:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.180762:0:4640:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721463936:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.180780:0:4640:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.183776:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721462272:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.183795:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721462656:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126625.189727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.189749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.189763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.189797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.189822:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707648 00000100:00100000:0.0:1746126625.189859:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707648 00000100:00100000:2.0:1746126625.189988:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721462912:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.190013:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721462400:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.190022:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.190037:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707520 00000100:00100000:3.0:1746126625.190040:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707520 00000100:00100000:2.0:1746126625.190049:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721462784:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.190067:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.190082:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707392 00000100:00100000:2.0:1746126625.190085:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707392 00010000:00010000:2.0:1746126625.190105:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 26 pid: 9686 timeout: 847 lvb_type: 1 00002000:00100000:3.0:1746126625.190121:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2605056->3145727) req@ffff88008e3a8e00 x1830945721707520/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.190131:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8e00 with x1830945721707520 ext(2605056->3145727) 00000100:00100000:2.0:1746126625.190136:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707264 00000100:00100000:2.0:1746126625.190138:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707264 00010000:00010000:3.0:1746126625.190140:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.190148:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 21 pid: 17475 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.190163:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7369 00000100:00100000:2.0:1746126625.190169:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721707392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.190182:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.190189:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.190196:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3a8e00 00010000:00010000:2.0:1746126625.190202:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 26 pid: 9686 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.190211:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 26 pid: 9686 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.190212:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1857 00000100:00100000:3.0:1746126625.190218:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721707520:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126625.190229:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7370 00010000:00010000:2.0:1746126625.190230:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009394e400/0xb50e825867614c50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e840 expref: 26 pid: 9686 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.190237:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721707264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.190245:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.190248:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126625.190257:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 21 pid: 17475 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.190266:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 21 pid: 17475 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.190279:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f189400/0xb50e825867614df4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e990 expref: 21 pid: 17475 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.190287:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721707392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 117us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.190293:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7369 00010000:00010000:1.0:1746126625.190293:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.190310:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721707264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 74us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.190318:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7370 00000100:00100000:1.0:1746126625.190359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.190371:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707776 00000100:00100000:1.0:1746126625.190373:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707776 00010000:00010000:1.0:1746126625.190383:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 29 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.190395:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7371 00000100:00100000:1.0:1746126625.190399:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721707776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.190406:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.190412:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 29 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.190419:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 29 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.190430:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e4eba00/0xb50e825867614ddf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e982 expref: 29 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.190437:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.190450:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721707776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.190455:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7371 00010000:00010000:0.0:1746126625.190463:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 11 pid: 4641 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.190490:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7372 00000100:00100000:1.0:1746126625.190496:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1966:x1830945721707648:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.190504:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.190511:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 11 pid: 4641 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.190519:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 11 pid: 4641 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.190529:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092fcd800/0xb50e825867614e41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c1 expref: 11 pid: 4641 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.190537:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.190539:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.190543:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.190551:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.190567:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.190581:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1966:x1830945721707648:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 85us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.190586:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7372 00010000:00010000:2.0:1746126625.191292:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191301:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191324:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191330:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191337:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191343:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f188000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126625.191346:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191352:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191364:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.191369:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f188000/0xb50e825867614e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.191431:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721706624:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 13738us (13881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.191438:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14082 00000100:00100000:2.0:1746126625.191868:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721463296:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.192164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.192181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.192223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.192237:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708032 00000100:00100000:1.0:1746126625.192242:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708032 00010000:00010000:1.0:1746126625.192263:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 10 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.192281:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721707904 00000100:00100000:1.0:1746126625.192283:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721707904 00010000:00010000:1.0:1746126625.192294:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 28 pid: 8438 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.192305:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708160 00000100:00100000:1.0:1746126625.192307:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708160 00010000:00010000:1.0:1746126625.192315:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 19 pid: 10890 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.192335:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7373 00000100:00100000:1.0:1746126625.192340:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721708032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.192349:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.192364:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 10 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192372:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 10 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192386:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.192406:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1965:x1830945721708032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.192412:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7373 00000100:00100000:1.0:1746126625.192423:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7374 00000100:00100000:1.0:1746126625.192427:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721707904:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.192437:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.192447:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 28 pid: 8438 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192456:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 28 pid: 8438 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192467:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.192482:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+29:1965:x1830945721707904:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 54us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.192487:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7374 00000100:00100000:1.0:1746126625.192497:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7375 00000100:00100000:1.0:1746126625.192502:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721708160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.192508:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126625.192509:0:4640:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4640:1830945721463936:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126625.192515:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 19 pid: 10890 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192524:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 19 pid: 10890 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746126625.192527:0:4640:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.192535:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.192536:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.192541:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.192548:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.192565:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.192578:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721708160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.192582:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7375 00000100:00100000:1.0:1746126625.192647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.192661:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708416 00000100:00100000:1.0:1746126625.192664:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708416 00010000:00010000:1.0:1746126625.192675:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 10 pid: 17475 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.192690:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7376 00000100:00100000:1.0:1746126625.192694:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721708416:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.192700:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.192709:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 10 pid: 17475 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192716:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 10 pid: 17475 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.192726:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126625.192860:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec81800/0xb50e825867614dca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e966 expref: 28 pid: 8438 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.192869:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721463168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.192879:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721463424:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.192886:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721463680:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.192907:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.192928:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f189c00/0xb50e825867614e33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ba expref: 10 pid: 17475 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.192937:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721463552:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.192945:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721463808:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.192963:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.192981:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614e48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9cf expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.192988:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721462528:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.193001:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c79800/0xb50e825867614c1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e80f expref: 18 pid: 10890 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.193022:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f11d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721463040:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.193042:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193049:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193055:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193071:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193077:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193083:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193089:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fcc400 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126625.193092:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193098:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193112:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.193117:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fcc400/0xb50e825867614e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.193155:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721706880:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 15338us (15560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.193162:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14083 00000100:00100000:1.0:1746126625.193594:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721708416:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 897us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.193600:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7376 00000100:00100000:0.0:1746126625.195381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.195501:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708672 00000100:00100000:3.0:1746126625.195508:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708672 00002000:00100000:3.0:1746126625.195543:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3256319) req@ffff88008e3a9880 x1830945721708672/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.195554:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9880 with x1830945721708672 ext(3145728->3256319) 00010000:00010000:3.0:1746126625.195562:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.195574:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 25 pid: 4640 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.195582:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e3a9880 00000100:00100000:3.0:1746126625.195608:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1858 00000100:00100000:3.0:1746126625.195615:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721708672:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126625.195616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.195634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.195647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.195660:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708288 00000100:00100000:0.0:1746126625.195664:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708288 00010000:00010000:0.0:1746126625.195682:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126625.195698:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708544 00000100:00100000:0.0:1746126625.195700:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708544 00010000:00010000:0.0:1746126625.195708:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746126625.195720:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708928 00000100:00100000:0.0:1746126625.195722:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708928 00000100:00100000:3.0:1746126625.195876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.195892:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721708800 00000100:00100000:3.0:1746126625.195895:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721708800 00010000:00010000:3.0:1746126625.195906:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.195918:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7377 00000100:00100000:3.0:1746126625.195923:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721708288:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.195930:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126625.196000:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7378 00000100:00100000:1.0:1746126625.196015:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721708544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.196026:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.196035:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.196038:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.196044:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.196057:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.196098:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7379 00000100:00100000:2.0:1746126625.196104:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1964:x1830945721708800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.196215:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.196226:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.196234:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.196251:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614c34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e824 expref: 18 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.196265:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.196285:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721708800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 182us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.196759:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7379 00010000:00010000:1.0:1746126625.197169:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adb0600/0xb50e825867614d99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e935 expref: 20 pid: 8437 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.197178:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092fcc800/0xb50e825867614e3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9c8 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.197182:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.197184:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.197188:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.197195:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.197203:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126625.197217:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.197224:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721708288:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1301us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.197229:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7377 00000100:00100000:1.0:1746126625.197237:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721708544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1222us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.197243:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7378 00010000:00010000:0.0:1746126625.197600:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 26 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126625.197627:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7380 00000100:00100000:0.0:1746126625.197636:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+27:1966:x1830945721708928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126625.197646:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126625.197660:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 27 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.197848:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197857:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197884:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197891:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197897:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197903:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570fa00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126625.197907:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197914:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197925:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.197930:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614eaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.197990:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721706752:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 17514us (18198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.197998:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14086 00010000:00010000:0.0:1746126625.198319:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 27 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.198333:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c386400/0xb50e825867614c5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e84e expref: 27 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.198564:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.198567:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.198570:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.198577:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.198635:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126625.199466:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199476:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199499:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199506:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199512:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199517:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009915d800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126625.199521:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199527:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199538:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.199543:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009915d800/0xb50e825867614ea3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.200266:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721706496:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 19793us (20501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.200276:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14085 00000100:00100000:0.0:1746126625.200824:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1966:x1830945721708928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3187us (5172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.200846:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7380 00000100:00100000:2.0:1746126625.207988:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721708672:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12362us (12598us total) trans 21474840451 rc 0/0 00000100:00100000:2.0:1746126625.208000:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1858 00002000:00100000:2.0:1746126625.208021:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3256319) req@ffff88008e3a9880 x1830945721708672/t21474840451(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/448 e 0 to 0 dl 1746126636 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.208030:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9880 with x1830945721708672 ext(3145728->3256319) 00010000:00010000:2.0:1746126625.208041:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.208054:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746126625.208061:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e3a9880 00000100:00100000:1.0:1746126625.215539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.215618:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709056 00000100:00100000:0.0:1746126625.215629:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709056 00010000:00010000:0.0:1746126625.215668:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746126625.215694:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7381 00000100:00100000:0.0:1746126625.215701:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721709056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126625.215715:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126625.215739:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746126625.215749:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746126625.215773:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f188800/0xb50e825867614e10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9ac expref: 26 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.216773:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721707520:12345-192.168.203.2@tcp:4:cat.0 Request processed in 26550us (27051us total) trans 17179873304 rc 0/0 00000100:00100000:3.0:1746126625.216784:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1857 00002000:00100000:3.0:1746126625.216795:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (2605056->3145727) req@ffff88008e3a8e00 x1830945721707520/t17179873304(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/448 e 0 to 0 dl 1746126636 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.216805:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8e00 with x1830945721707520 ext(2605056->3145727) 00010000:00010000:3.0:1746126625.216813:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.216843:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.216855:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3a8e00 00010000:00010000:0.0:1746126625.217264:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.217267:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.217272:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.217282:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.218265:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.218432:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721709056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2728us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.218440:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7381 00010000:00010000:3.0:1746126625.218679:0:4640:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218689:0:4640:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218719:0:4640:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218725:0:4640:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218732:0:4640:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218739:0:4640:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c893200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126625.218743:0:4640:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218750:0:4640:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218764:0:4640:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.218773:0:4640:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867614eb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.219312:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1963:x1830945721707008:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 38615us (39491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.219321:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14087 00000100:00100000:0.0:1746126625.223293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.223509:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709184 00000100:00100000:1.0:1746126625.223519:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709184 00010000:00010000:1.0:1746126625.223553:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.223596:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7382 00000100:00100000:1.0:1746126625.223604:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721709184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.223618:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.223641:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.223653:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.224280:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f188400/0xb50e825867614dfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e997 expref: 28 pid: 4640 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.224308:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.224310:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.224315:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.224323:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.224356:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.224404:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721709184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 800us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.224411:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7382 00010000:00010000:3.0:1746126625.224567:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224576:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224599:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224605:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224612:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224618:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb19e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126625.224621:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224629:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224639:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.224644:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb19e00/0xb50e825867614e9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.224689:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721707136:12345-192.168.203.2@tcp:1:mirror_io.0 Request processed in 45285us (46962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.224697:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14084 00000100:00100000:0.0:1746126625.229996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.230257:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709440 00000100:00100000:3.0:1746126625.230267:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709440 00000100:00100000:3.0:1746126625.230326:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9063 00000100:00100000:3.0:1746126625.230334:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+16:31584:x1830945721709440:12345-192.168.203.2@tcp:36:mirror_io.0 00010000:00010000:3.0:1746126625.230712:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.230739:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcc600/0xb50e825867614e87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f2 expref: 16 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.230755:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.230759:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126625.230786:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.230796:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 31 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.230802:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.230808:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.230813:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.230818:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.230874:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.231069:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.231082:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464064:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.231339:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.231348:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.231356:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464192:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.231383:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.231390:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.231398:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464320:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.231420:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 31 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.231427:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 31 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.231433:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464448:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.231448:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4177b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126625.233945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.234033:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709568 00000100:00100000:0.0:1746126625.234036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.234041:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709568 00010000:00010000:1.0:1746126625.234071:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 242 pid: 14549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.234092:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709824 00000100:00100000:1.0:1746126625.234094:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709824 00010000:00010000:1.0:1746126625.234102:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 32 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.234118:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7383 00000100:00100000:1.0:1746126625.234124:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+242:1963:x1830945721709568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.234137:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.234142:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 242 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.234152:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 242 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.234172:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.234176:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.234183:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.234216:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+242:1963:x1830945721709568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.234221:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7383 00000100:00100000:3.0:1746126625.234233:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464064:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.234234:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7384 00000100:00100000:1.0:1746126625.234238:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+32:1963:x1830945721709824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.234243:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.234244:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614a58 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e736 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.234246:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 32 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.234253:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 32 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.234256:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464192:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126625.234261:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:3.0:1746126625.234263:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464320:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126625.234264:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.234268:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126625.234270:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e8258676147cd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5d8 expref: 32 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.234277:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721464448:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.234277:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721709824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.234282:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7384 00010000:00010000:3.0:1746126625.234300:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.235147:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.235184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.235208:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709696 00000100:00100000:2.0:1746126625.235215:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709696 00000100:00100000:1.0:1746126625.235244:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721709952 00000100:00100000:1.0:1746126625.235247:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721709952 00010000:00010000:1.0:1746126625.235263:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.235289:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7385 00000100:00100000:1.0:1746126625.235294:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+241:1963:x1830945721709952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.235303:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.235307:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.235314:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.235345:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.235359:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7386 00000100:00100000:2.0:1746126625.235364:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+31:1963:x1830945721709696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.235370:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.235374:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.235758:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.235775:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c28800/0xb50e825867614a82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e744 expref: 31 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.235796:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.235800:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.235806:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.235859:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1963:x1830945721709696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 494us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.235864:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7386 00010000:00010000:1.0:1746126625.236017:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce14000/0xb50e8258676147db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e5e6 expref: 241 pid: 14549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.236407:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.236412:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.236419:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.236425:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.236452:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126625.236486:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.236497:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126625.236548:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+240:1963:x1830945721709952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1252us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.236554:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7385 00000040:00080000:3.0:1746126625.237141:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2709, 88 off230256 00000004:00080000:3.0:1746126625.237149:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151320565ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237191:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2832, 88 off241176 00000004:00080000:3.0:1746126625.237196:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151368040ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237217:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2833, 88 off241264 00000004:00080000:3.0:1746126625.237220:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151392692ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237362:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2710, 88 off230344 00000004:00080000:3.0:1746126625.237366:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151538675ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237376:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2711, 88 off230432 00000004:00080000:3.0:1746126625.237379:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151551643ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237386:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2834, 88 off241352 00000004:00080000:3.0:1746126625.237389:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151561067ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237396:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2835, 88 off241440 00000004:00080000:3.0:1746126625.237398:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151570665ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237404:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2712, 88 off230520 00000004:00080000:3.0:1746126625.237406:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151578555ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237411:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2836, 88 off241528 00000004:00080000:3.0:1746126625.237413:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151585472ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237419:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2713, 88 off230608 00000004:00080000:3.0:1746126625.237422:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151594820ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237428:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2837, 88 off241616 00000004:00080000:3.0:1746126625.237430:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151602890ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237436:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2714, 88 off230696 00000004:00080000:3.0:1746126625.237438:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151610993ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237444:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2838, 88 off241704 00000004:00080000:3.0:1746126625.237446:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151618640ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237451:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2715, 88 off230784 00000004:00080000:3.0:1746126625.237454:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151626365ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126625.237459:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2839, 88 off241792 00000004:00080000:3.0:1746126625.237461:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151633736ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237466:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2840, 88 off241880 00000004:00080000:3.0:1746126625.237469:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747151641251ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126625.237474:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2716, 88 off230872 00000004:00080000:3.0:1746126625.237476:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747151649016ns, next at 687927188999ns, rc = 0 00000001:00080000:1.0:1746126625.277765:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943255 is committed 00000004:00010000:0.0:1746126625.277928:0:20362:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008e3a9f80 reply state ffff88009e84a000 transno 8589943265 ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.277940:0:20362:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746126625.277977:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943262 is committed 00000001:00080000:1.0:1746126625.277983:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943258 is committed 00000001:00080000:1.0:1746126625.277993:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943246 is committed 00000001:00080000:1.0:1746126625.278000:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943261 is committed 00000001:00080000:1.0:1746126625.278043:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943265 is committed 00000004:00080000:1.0:1746126625.278046:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2100 committed 00000004:00080000:1.0:1746126625.278053:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2221 committed 00010000:00080000:0.0:1746126625.278058:0:20362:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:1.0:1746126625.278059:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2220 committed 00000004:00080000:1.0:1746126625.278061:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2099 committed 00000004:00080000:1.0:1746126625.278062:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2219 committed 00000004:00080000:1.0:1746126625.278064:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2098 committed 00000004:00080000:1.0:1746126625.278066:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2218 committed 00000004:00080000:1.0:1746126625.278068:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2097 committed 00000004:00080000:1.0:1746126625.278069:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2217 committed 00000004:00080000:1.0:1746126625.278071:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2096 committed 00000004:00080000:1.0:1746126625.278072:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2216 committed 00000004:00080000:1.0:1746126625.278073:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2215 committed 00000004:00080000:1.0:1746126625.278074:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2095 committed 00000100:00100000:0.0:1746126625.278075:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31584:x1830945721709440:12345-192.168.203.2@tcp:36:mirror_io.0 Request processed in 47737us (48085us total) trans 8589943265 rc 0/0 00000004:00080000:1.0:1746126625.278076:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2094 committed 00000004:00080000:1.0:1746126625.278077:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2214 committed 00000004:00080000:1.0:1746126625.278078:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2213 committed 00000004:00080000:1.0:1746126625.278079:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2093 committed 00000100:00100000:0.0:1746126625.278084:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9063 00010000:00010000:2.0:1746126625.278253:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.278263:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.278270:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.278275:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fcdc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.278278:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.278283:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.278300:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.278303:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126625.278305:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.278310:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcdc00/0xb50e825867614eb8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00000100:00100000:2.0:1746126625.278332:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721464704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.278381:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.278427:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464704 00000100:00100000:2.0:1746126625.278432:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464704 00000100:00100000:2.0:1746126625.278455:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14088 00000100:00100000:2.0:1746126625.278459:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830945721464704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.278700:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721464960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.278720:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.278732:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721465472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.278741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.278751:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746126625.278754:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721464576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.278764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.278772:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721465088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.278781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.278794:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464960 00000100:00100000:1.0:1746126625.278797:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464960 00000100:00100000:1.0:1746126625.278809:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465472 00000100:00100000:1.0:1746126625.278810:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465472 00000100:00100000:1.0:1746126625.278818:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464576 00000100:00100000:1.0:1746126625.278819:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464576 00000100:00100000:1.0:1746126625.278844:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465088 00000100:00100000:1.0:1746126625.278845:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465088 00000100:00100000:1.0:1746126625.278855:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14089 00000100:00100000:1.0:1746126625.278859:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3294:x1830945721464960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.278981:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1830945721464960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (259us total) trans 17179873305 rc 0/0 00000100:00100000:1.0:1746126625.278986:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14089 00000100:00100000:1.0:1746126625.278996:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14090 00000100:00100000:1.0:1746126625.279000:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3294:x1830945721465472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.279029:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721465600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126625.279032:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14091 00000100:00100000:1.0:1746126625.279036:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3294:x1830945721464576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.279052:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14092 00000100:00100000:1.0:1746126625.279055:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3294:x1830945721465088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.279075:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.279090:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465600 00000100:00100000:1.0:1746126625.279092:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465600 00000100:00100000:3.0:1746126625.279103:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721466112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126625.279106:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14093 00000100:00100000:1.0:1746126625.279110:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3295:x1830945721465600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.279120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.279132:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746126625.279136:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721465984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.279150:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.279200:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3295:x1830945721465600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (125us total) trans 21474840452 rc 0/0 00000100:00100000:1.0:1746126625.279205:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14093 00000100:00100000:1.0:1746126625.279212:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466112 00000100:00100000:1.0:1746126625.279214:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466112 00000100:00100000:1.0:1746126625.279220:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465984 00000100:00100000:1.0:1746126625.279221:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465984 00000100:00100000:1.0:1746126625.279228:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14094 00000100:00100000:0.0:1746126625.279228:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721464832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.279231:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3295:x1830945721466112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126625.279251:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.279779:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721466496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126625.280112:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.281248:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830945721466112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2010us (2121us total) trans 21474840453 rc 0/0 00000100:00100000:1.0:1746126625.281257:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14094 00000100:00100000:1.0:1746126625.281276:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721464832 00000100:00100000:1.0:1746126625.281282:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721464832 00000100:00100000:1.0:1746126625.281297:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14095 00000100:00100000:1.0:1746126625.281301:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3295:x1830945721465984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.281534:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.281567:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830945721464704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3105us (3184us total) trans 17179873306 rc 0/0 00000100:00100000:2.0:1746126625.281573:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14088 00000100:00100000:2.0:1746126625.281586:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466496 00000100:00100000:2.0:1746126625.281589:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466496 00000004:00080000:3.0:1746126625.281590:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e723b80/2, rc 0, transno 21474840452 00000100:00100000:3.0:1746126625.281596:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721465600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.281598:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14096 00000100:00100000:2.0:1746126625.281601:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3297:x1830945721464832:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.281607:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8cad80/2, rc 0, transno 21474840453 00000100:00100000:3.0:1746126625.281610:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721466112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126625.281643:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fce00/2, rc 0, transno 17179873305 00000100:00100000:3.0:1746126625.281655:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721464960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.281704:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746126625.281708:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3297:x1830945721464832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (2456us total) trans 17179873307 rc 0/0 00000100:00100000:2.0:1746126625.281713:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14096 00000100:00100000:3.0:1746126625.281715:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721466624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.281722:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14097 00000100:00100000:2.0:1746126625.281726:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3295:x1830945721466496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.281739:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126625.282110:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126625.282126:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126625.282144:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126625.282158:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721466368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126625.282179:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.282192:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3295:x1830945721465984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 890us (3040us total) trans 21474840455 rc 0/0 00000100:00100000:1.0:1746126625.282198:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14095 00000004:00080000:0.0:1746126625.282200:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2ff800/2, rc 0, transno 17179873307 00000100:00100000:0.0:1746126625.282204:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721464832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.282206:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466624 00000100:00100000:1.0:1746126625.282208:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466624 00000100:00100000:0.0:1746126625.282208:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746126625.282213:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.282215:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465344 00000100:00100000:1.0:1746126625.282217:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465344 00000100:00100000:1.0:1746126625.282223:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465856 00000100:00100000:1.0:1746126625.282224:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465856 00000100:00100000:0.0:1746126625.282230:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126625.282231:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466368 00000100:00100000:1.0:1746126625.282232:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466368 00000100:00100000:0.0:1746126625.282238:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126625.282239:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465216 00000100:00100000:1.0:1746126625.282240:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465216 00000100:00100000:1.0:1746126625.282247:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14098 00000100:00100000:1.0:1746126625.282250:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3294:x1830945721466624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126625.282251:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126625.282259:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721466240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126625.282270:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126625.282290:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721465728 00000100:00100000:0.0:1746126625.282294:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721465728 00000100:00100000:0.0:1746126625.282315:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721466240 00000100:00100000:0.0:1746126625.282317:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721466240 00000100:00100000:0.0:1746126625.282326:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14099 00000100:00100000:0.0:1746126625.282333:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721465344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.282475:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14100 00000004:00080000:3.0:1746126625.282480:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c9500/2, rc 0, transno 21474840455 00000100:00100000:2.0:1746126625.282481:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721465856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.282484:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721465984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.282565:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721465856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (419us total) trans 21474840456 rc 0/0 00000100:00100000:2.0:1746126625.282569:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14100 00000100:00100000:2.0:1746126625.282578:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14101 00000100:00100000:2.0:1746126625.282581:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721466368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.282667:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721466368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (486us total) trans 21474840457 rc 0/0 00000100:00100000:2.0:1746126625.282672:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14101 00000100:00100000:2.0:1746126625.282679:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14102 00000100:00100000:2.0:1746126625.282683:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3297:x1830945721465216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.282707:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14103 00000100:00100000:2.0:1746126625.282712:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721465728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.282796:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721465728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (543us total) trans 21474840458 rc 0/0 00000100:00100000:2.0:1746126625.282800:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14103 00000100:00100000:2.0:1746126625.282808:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14104 00000100:00100000:2.0:1746126625.282812:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721466240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.282890:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3297:x1830945721466240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (618us total) trans 21474840459 rc 0/0 00000100:00100000:2.0:1746126625.282894:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14104 00000004:00080000:2.0:1746126625.282964:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fdc00/2, rc 0, transno 17179873306 00000100:00100000:2.0:1746126625.282969:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721464704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126625.284016:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3297:x1830945721465344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1669us (1892us total) trans 17179873309 rc 0/0 00000100:00100000:0.0:1746126625.284025:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14099 00000100:00100000:0.0:1746126625.284172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.284198:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721710080 00000100:00100000:0.0:1746126625.284202:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721710080 00000100:00100000:0.0:1746126625.284243:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9064 00000100:00100000:0.0:1746126625.284249:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31584:x1830945721710080:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126625.284265:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.284283:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4e9f9 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.284334:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.284347:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.284361:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126625.284363:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126625.284366:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dfd6000, rc 0) 00000100:00100000:0.0:1746126625.284397:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31584:x1830945721710080:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 148us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.284401:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9064 00000004:00080000:0.0:1746126625.284470:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e723800/2, rc 0, transno 21474840458 00000100:00100000:0.0:1746126625.284474:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126625.284481:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8f100/2, rc 0, transno 21474840459 00000100:00100000:0.0:1746126625.284484:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721466240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126625.284491:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fdf80/2, rc 0, transno 17179873309 00000100:00100000:0.0:1746126625.284494:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126625.284501:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c8380/2, rc 0, transno 21474840456 00000100:00100000:0.0:1746126625.284502:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126625.284509:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8ea00/2, rc 0, transno 21474840457 00000100:00100000:0.0:1746126625.284511:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721466368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.284884:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721466496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3153us (3348us total) trans 21474840454 rc 0/0 00000100:00100000:2.0:1746126625.284892:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14097 00000004:00080000:3.0:1746126625.286658:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8ed80/2, rc 0, transno 21474840454 00000100:00100000:3.0:1746126625.286666:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721466496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126625.286844:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721466624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4571us (5083us total) trans 17179873308 rc 0/0 00000100:00100000:1.0:1746126625.286852:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14098 00002000:00010000:1.0:1746126625.287060:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746126625.287063:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126625.287065:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126625.287067:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:1.0:1746126625.287069:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746126625.287076:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3294:x1830945721465472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8069us (8327us total) trans 17179873310 rc 0/0 00000100:00100000:0.0:1746126625.287085:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14090 00000100:00100000:1.0:1746126625.287102:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3294:x1830945721465088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8045us (8319us total) trans 17179873312 rc 0/0 00000100:00100000:1.0:1746126625.287110:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14092 00000004:00080000:3.0:1746126625.289457:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4c8ca80/2, rc 0, transno 17179873308 00000100:00100000:3.0:1746126625.289465:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721466624:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.289474:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fea00/2, rc 0, transno 17179873311 00000100:00100000:3.0:1746126625.289477:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721464576:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.289483:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fd180/2, rc 0, transno 17179873312 00000100:00100000:3.0:1746126625.289485:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721465088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.289492:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fd500/2, rc 0, transno 17179873310 00000100:00100000:3.0:1746126625.289495:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721465472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126625.290016:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3294:x1830945721464576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 10429us (10700us total) trans 17179873311 rc 0/0 00000100:00100000:1.0:1746126625.290025:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14091 00000100:00100000:2.0:1746126625.290122:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3297:x1830945721465216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7436us (7890us total) trans 17179873313 rc 0/0 00000100:00100000:2.0:1746126625.290128:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14102 00000004:00080000:3.0:1746126625.290386:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b2fed80/2, rc 0, transno 17179873313 00000100:00100000:3.0:1746126625.290390:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721465216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126625.293360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.293625:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721710208 00000100:00100000:1.0:1746126625.293631:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721710208 00000100:00100000:1.0:1746126625.293667:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 709 00000100:00100000:1.0:1746126625.293672:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31584:x1830945721710208:12345-192.168.203.2@tcp:103:mirror_io.0 00010000:00010000:1.0:1746126625.293684:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.293702:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092fcde00/0xb50e825867614e79 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9eb expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.293730:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.293734:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.293763:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31584:x1830945721710208:12345-192.168.203.2@tcp:103:mirror_io.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.293769:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 709 00000100:00100000:2.0:1746126625.299547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.300507:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721710464 00000100:00100000:1.0:1746126625.300514:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721710464 00000100:00100000:1.0:1746126625.300567:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3858 00000100:00100000:1.0:1746126625.300575:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31584:x1830945721710464:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:1.0:1746126625.300799:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31584:x1830945721710464:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 224us (1257us total) trans 8589943266 rc 0/0 00000100:00100000:1.0:1746126625.300805:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3858 00000100:00100000:0.0:1746126625.304116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.305491:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721710720 00000100:00100000:1.0:1746126625.305502:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721710720 00000100:00100000:1.0:1746126625.306468:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3859 00000100:00100000:1.0:1746126625.306480:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31584:x1830945721710720:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:1.0:1746126625.306708:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31584:x1830945721710720:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 229us (2600us total) trans 8589943267 rc 0/0 00000100:00100000:1.0:1746126625.306715:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3859 00000100:00100000:0.0:1746126625.330265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.331922:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721710976 00000100:00100000:2.0:1746126625.331935:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721710976 00000100:00100000:2.0:1746126625.331998:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9065 00000100:00100000:0.0:1746126625.331998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.332019:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31596:x1830945721710976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.332045:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.332065:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009915d800/0xb50e825867614ec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea00 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126625.332097:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721711232 00000100:00100000:1.0:1746126625.332102:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721711232 00000100:00100000:1.0:1746126625.332127:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9066 00000100:00100000:1.0:1746126625.332133:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+221:31597:x1830945721711232:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126625.332143:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.332151:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4581a00/0xb50e825867614ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea07 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.332179:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332192:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.332192:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.332202:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332215:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332220:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332225:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332332:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332340:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332346:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126625.332355:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126625.332766:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.332818:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.332819:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332843:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332849:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332854:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c386400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.332858:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332864:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332875:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126625.332877:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126625.332881:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332886:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c386400/0xb50e825867614ed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332908:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332913:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332917:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.332920:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.332921:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c893200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.332923:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.332927:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.332933:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.332933:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.332939:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ed3dd00) 00010000:00010000:2.0:1746126625.332941:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126625.332943:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332948:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c893200/0xb50e825867614ee2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.332978:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915d800/0xb50e825867614ec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.332988:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.332993:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.332993:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.332996:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126625.332998:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c892600, rc 0) 00010000:00010000:1.0:1746126625.333000:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.333016:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:1.0:1746126625.333022:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:2.0:1746126625.333062:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31596:x1830945721710976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1055us (2805us total) trans 8589943268 rc 0/0 00000100:00100000:2.0:1746126625.333067:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9065 00010000:00010000:1.0:1746126625.334166:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334173:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334178:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334183:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a1800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126625.334186:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334191:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334200:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126625.334202:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126625.334205:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334209:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334240:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334245:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334249:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334252:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8a1200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126625.334254:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334259:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334265:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ed3dd00) 00010000:00010000:1.0:1746126625.334267:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126625.334270:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334274:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614ef7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.334310:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4581a00/0xb50e825867614ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.334321:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 223 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.334328:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.334330:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126625.334333:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0a00, rc 0) 00000100:00100000:1.0:1746126625.334382:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:31597:x1830945721711232:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2248us (2387us total) trans 8589943269 rc 0/0 00000100:00100000:1.0:1746126625.334389:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9066 00000100:00100000:2.0:1746126625.337720:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.337821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.337917:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721711488 00000100:00100000:1.0:1746126625.337927:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721711488 00000100:00100000:1.0:1746126625.337977:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721711744 00000100:00100000:1.0:1746126625.337980:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721711744 00000100:00100000:1.0:1746126625.337999:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3860 00000100:00100000:1.0:1746126625.338017:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31596:x1830945721711488:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126625.338217:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31596:x1830945721711488:12345-192.168.203.2@tcp:35:cat.0 Request processed in 211us (505us total) trans 8589943270 rc 0/0 00000100:00100000:1.0:1746126625.338224:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3860 00000100:00100000:1.0:1746126625.338239:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3861 00000100:00100000:1.0:1746126625.338243:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:31597:x1830945721711744:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1746126625.338302:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:31597:x1830945721711744:12345-192.168.203.2@tcp:35:cat.0 Request processed in 58us (481us total) trans 8589943271 rc 0/0 00000100:00100000:1.0:1746126625.338307:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3861 00000100:00100000:1.0:1746126625.342650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.342690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.342712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.342724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.342739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.342765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.342788:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721711872 00000100:00100000:1.0:1746126625.342798:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721711872 00000100:00100000:1.0:1746126625.343788:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712128 00000100:00100000:1.0:1746126625.343793:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712128 00000100:00100000:2.0:1746126625.343853:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712000 00000100:00100000:2.0:1746126625.343857:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712000 00000100:00100000:2.0:1746126625.343876:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712256 00000100:00100000:2.0:1746126625.343877:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712256 00000100:00100000:2.0:1746126625.343888:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712384 00000100:00100000:2.0:1746126625.343890:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712384 00000100:00100000:2.0:1746126625.343898:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712512 00000100:00100000:2.0:1746126625.343900:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712512 00000100:00100000:2.0:1746126625.343914:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14105 00000100:00100000:2.0:1746126625.343921:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721711872:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.343941:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.343962:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea0e expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126625.343987:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c71f, atime: 0x6813c71d, ctime: 0x6813c71f, blocks: 0x79f 00010000:00010000:2.0:1746126625.344018:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344020:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344029:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344043:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344060:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef64200, rc 0) 00000100:00100000:2.0:1746126625.344107:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721711872:12345-192.168.203.2@tcp:101:cat.0 Request processed in 187us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.344114:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14105 00000100:00100000:2.0:1746126625.344130:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14106 00000100:00100000:2.0:1746126625.344135:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721712128:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.344142:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.344154:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea1c expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126625.344168:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c720, atime: 0x6813c720, ctime: 0x6813c720, blocks: 0x821 00010000:00010000:2.0:1746126625.344178:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344180:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344184:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344193:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344199:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef65c00, rc 0) 00000100:00100000:2.0:1746126625.344213:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721712128:12345-192.168.203.2@tcp:101:cat.0 Request processed in 79us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.344218:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14106 00000100:00100000:2.0:1746126625.344227:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14107 00000100:00100000:2.0:1746126625.344231:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721712000:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.344237:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.344243:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea15 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126625.344252:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c720, atime: 0x6813c720, ctime: 0x6813c720, blocks: 0x821 00010000:00010000:2.0:1746126625.344258:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344259:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344262:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344270:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344275:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c889000, rc 0) 00000100:00100000:2.0:1746126625.344286:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721712000:12345-192.168.203.2@tcp:101:cat.0 Request processed in 55us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.344290:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14107 00000100:00100000:2.0:1746126625.344299:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14108 00000100:00100000:2.0:1746126625.344302:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721712256:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.344306:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.344313:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea23 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126625.344321:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c71c, atime: 0x6813c71a, ctime: 0x6813c71c, blocks: 0x81f 00010000:00010000:2.0:1746126625.344326:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344328:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344331:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344338:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344343:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c892000, rc 0) 00000100:00100000:2.0:1746126625.344352:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721712256:12345-192.168.203.2@tcp:101:cat.0 Request processed in 50us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.344356:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14108 00000100:00100000:2.0:1746126625.344363:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14109 00000100:00100000:2.0:1746126625.344366:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1965:x1830945721712384:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.344369:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.344374:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea2a expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126625.344382:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c720, atime: 0x6813c720, ctime: 0x6813c720, blocks: 0x163f 00010000:00010000:2.0:1746126625.344387:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344388:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344391:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344398:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 20 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344403:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c893a00, rc 0) 00000100:00100000:2.0:1746126625.344412:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721712384:12345-192.168.203.2@tcp:101:cat.0 Request processed in 46us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.344417:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14109 00000100:00100000:2.0:1746126625.344422:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14110 00000100:00100000:2.0:1746126625.344426:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1965:x1830945721712512:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.344430:0:4640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.344435:0:4640:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea31 expref: -99 pid: 4640 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126625.344444:0:4640:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c720, atime: 0x6813c720, ctime: 0x6813c720, blocks: 0x102b 00010000:00010000:2.0:1746126625.344450:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344452:0:4640:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.344455:0:4640:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344462:0:4640:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.344469:0:4640:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c893200, rc 0) 00000100:00100000:2.0:1746126625.344482:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721712512:12345-192.168.203.2@tcp:101:cat.0 Request processed in 56us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.344486:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14110 00000100:00100000:3.0:1746126625.346313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.346465:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712640 00000100:00100000:3.0:1746126625.346473:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712640 00000100:00100000:3.0:1746126625.346502:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712768 00000100:00100000:3.0:1746126625.346504:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712768 00000100:00100000:3.0:1746126625.346514:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721712896 00000100:00100000:3.0:1746126625.346516:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721712896 00000100:00100000:3.0:1746126625.346523:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721713024 00000100:00100000:3.0:1746126625.346524:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721713024 00000100:00100000:3.0:1746126625.346530:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721713152 00000100:00100000:3.0:1746126625.346531:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721713152 00000100:00100000:3.0:1746126625.346537:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721713280 00000100:00100000:3.0:1746126625.346539:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721713280 00000100:00100000:3.0:1746126625.346548:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14111 00000100:00100000:3.0:1746126625.346555:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721712640:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.346571:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.346586:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea38 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.346606:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346607:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346614:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346627:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346637:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e85e00, rc 0) 00000100:00100000:3.0:1746126625.346670:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721712640:12345-192.168.203.2@tcp:101:cat.0 Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.346676:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14111 00000100:00100000:3.0:1746126625.346688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14112 00000100:00100000:3.0:1746126625.346694:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721712768:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.346700:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.346708:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea3f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.346718:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346719:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346723:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346732:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346738:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e84e00, rc 0) 00000100:00100000:3.0:1746126625.346751:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721712768:12345-192.168.203.2@tcp:101:cat.0 Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.346756:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14112 00000100:00100000:3.0:1746126625.346763:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14113 00000100:00100000:3.0:1746126625.346767:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721712896:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.346772:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.346777:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea46 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.346786:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346788:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346791:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346799:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346805:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcd000, rc 0) 00000100:00100000:3.0:1746126625.346818:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721712896:12345-192.168.203.2@tcp:101:cat.0 Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.346823:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14113 00000100:00100000:3.0:1746126625.346855:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14114 00000100:00100000:3.0:1746126625.346860:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1964:x1830945721713024:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.346866:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.346872:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea4d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.346882:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346883:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346887:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346895:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346901:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcda00, rc 0) 00000100:00100000:3.0:1746126625.346914:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721713024:12345-192.168.203.2@tcp:101:cat.0 Request processed in 54us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.346922:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14114 00000100:00100000:3.0:1746126625.346930:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14115 00000100:00100000:3.0:1746126625.346934:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+27:1963:x1830945721713152:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.346940:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.346945:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea54 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.346954:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346955:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.346959:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346966:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.346973:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fccc00, rc 0) 00000100:00100000:3.0:1746126625.346986:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721713152:12345-192.168.203.2@tcp:101:cat.0 Request processed in 51us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.346990:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14115 00000100:00100000:3.0:1746126625.346998:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14116 00000100:00100000:3.0:1746126625.347002:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721713280:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.347020:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.347026:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea5b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.347036:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.347037:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.347040:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.347047:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.347053:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fcde00, rc 0) 00000100:00100000:3.0:1746126625.347066:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721713280:12345-192.168.203.2@tcp:101:cat.0 Request processed in 64us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.347070:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14116 00000100:00100000:0.0:1746126625.348975:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721713536 00000100:00100000:0.0:1746126625.348986:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721713536 00000100:00100000:0.0:1746126625.349032:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721713792 00000100:00100000:0.0:1746126625.349034:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721713792 00000100:00100000:0.0:1746126625.349066:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9067 00000100:00100000:0.0:1746126625.349072:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31591:x1830945721713536:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126625.349093:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.349108:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6800/0xb50e825867614f60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea62 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.349200:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126625.349213:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.349220:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.349226:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746126625.349255:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.349270:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 224 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746126625.349282:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721466752:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126625.349362:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.349370:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 11 pid: 14547 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746126625.349377:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721466880:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126625.349395:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126625.349462:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9068 00000100:00100000:1.0:1746126625.349470:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31593:x1830945721713792:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126625.349479:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.349487:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614f6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea69 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.349521:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.349529:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.349535:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126625.353942:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721466752:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126625.354028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.354055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.354137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.354267:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721713920 00000100:00100000:3.0:1746126625.354274:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721713920 00010000:00010000:3.0:1746126625.354311:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 226 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.354335:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721714048 00000100:00100000:3.0:1746126625.354337:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721714048 00000100:00100000:1.0:1746126625.354345:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7387 00010000:00010000:3.0:1746126625.354347:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.354364:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7388 00000100:00100000:3.0:1746126625.354370:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721714048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.354382:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.354387:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.354391:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+226:1965:x1830945721713920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.354397:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.354400:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.354405:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 226 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.354425:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 226 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.354467:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c892600/0xb50e825867614ee9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea00 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.354486:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830945721466880:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.354543:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.354548:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126625.354555:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746126625.354560:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126625.354562:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746126625.354606:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721714048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 236us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.354613:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7388 00000100:00100000:3.0:1746126625.354636:0:15560:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721714176 00000100:00100000:3.0:1746126625.354639:0:15560:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721714176 00000100:00100000:3.0:1746126625.354658:0:15560:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9069 00000100:00100000:3.0:1746126625.354662:0:15560:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+227:31597:x1830945721714176:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.354677:0:15560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.354689:0:15560:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614f7c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea70 expref: -99 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.354796:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a0a00/0xb50e825867614efe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea07 expref: 228 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.354824:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.354843:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.354851:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.354856:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746126625.354862:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.354866:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.354870:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.354887:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.354905:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:1965:x1830945721713920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 552us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.354911:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7387 00010000:00010000:1.0:1746126625.354932:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.354937:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126625.354956:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126625.355036:0:15560:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614f7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea70 expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.355048:0:15560:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614f7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea70 expref: 227 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.355062:0:15560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.355065:0:15560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126625.355067:0:15560:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29800, rc 0) 00000100:00100000:3.0:1746126625.355090:0:15560:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27c713d7-92e0-4974-b612-500c641c1d6c+228:31597:x1830945721714176:12345-192.168.203.2@tcp:101:cat.0 Request processed in 428us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.355096:0:15560:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9069 00010000:00010000:1.0:1746126625.355097:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1200/0xb50e825867614f6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 228 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.355111:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.355116:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.355118:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126625.355120:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1800, rc 0) 00000100:00100000:1.0:1746126625.355136:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31593:x1830945721713792:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5668us (8762us total) trans 8589943272 rc 0/0 00000100:00100000:1.0:1746126625.355141:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9068 00010000:00010000:2.0:1746126625.355292:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746126625.355298:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746126625.355309:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126625.355368:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6800/0xb50e825867614f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.355378:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.355383:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.355385:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126625.355386:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dfd7000, rc 0) 00000100:00100000:2.0:1746126625.355416:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31591:x1830945721713536:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6343us (9110us total) trans 8589943273 rc 0/0 00000100:00100000:2.0:1746126625.355420:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9067 00000100:00100000:0.0:1746126625.367233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.367279:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.367308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.367324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.367370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.367580:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721714432 00000100:00100000:2.0:1746126625.367590:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721714432 00002000:00100000:2.0:1746126625.367637:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800924c5180 x1830945721714432/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.367647:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c5180 with x1830945721714432 ext(0->1048575) 00002000:00010000:2.0:1746126625.367652:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c5180 00000100:00100000:2.0:1746126625.367668:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721714688 00000100:00100000:2.0:1746126625.367671:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721714688 00002000:00100000:2.0:1746126625.367685:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800924c5880 x1830945721714688/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.367691:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c5880 with x1830945721714688 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.367694:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c5880 00000100:00100000:2.0:1746126625.367703:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721714944 00000100:00100000:2.0:1746126625.367705:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721714944 00002000:00100000:2.0:1746126625.367714:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800924c4a80 x1830945721714944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.367720:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4a80 with x1830945721714944 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.367723:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4a80 00000100:00100000:2.0:1746126625.367730:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721715200 00000100:00100000:2.0:1746126625.367732:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721715200 00002000:00100000:2.0:1746126625.367740:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800924c7100 x1830945721715200/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.367746:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c7100 with x1830945721715200 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.367748:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c7100 00000100:00100000:2.0:1746126625.367760:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8060 00000100:00100000:2.0:1746126625.367767:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721714432:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126625.368565:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8061 00000100:00100000:1.0:1746126625.368575:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721714688:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.370882:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8062 00000100:00100000:0.0:1746126625.370894:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8063 00000100:00100000:3.0:1746126625.370898:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721714944:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.370904:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721715200:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126625.373565:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721715456 00000100:00100000:1.0:1746126625.373580:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721715456 00000100:00100000:1.0:1746126625.373637:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9070 00000100:00100000:1.0:1746126625.373644:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+226:31593:x1830945721715456:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126625.373667:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.373670:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746126625.373698:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c29800/0xb50e825867614f7c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea70 expref: 226 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.373721:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.373726:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126625.373739:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800933e6000/0xb50e825867614f91 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea77 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.373793:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.373805:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.373811:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.373861:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.373873:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 8 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.373884:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721467008:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.373961:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.381672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.381708:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721715968 00000100:00100000:2.0:1746126625.381718:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721715968 00002000:00100000:2.0:1746126625.381761:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a4f54000 x1830945721715968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.381771:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f54000 with x1830945721715968 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.381776:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f54000 00000100:00100000:2.0:1746126625.381806:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8064 00000100:00100000:2.0:1746126625.381813:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721715968:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126625.382545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.382576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.382593:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721715840 00000100:00100000:1.0:1746126625.382597:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721715840 00002000:00100000:1.0:1746126625.382615:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e8c9f80 x1830945721715840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.382623:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c9f80 with x1830945721715840 ext(1048576->2097151) 00002000:00010000:1.0:1746126625.382627:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c9f80 00000100:00100000:1.0:1746126625.382637:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721716224 00000100:00100000:1.0:1746126625.382639:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721716224 00002000:00100000:1.0:1746126625.382651:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e8caa00 x1830945721716224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746126625.382655:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8065 00002000:00100000:1.0:1746126625.382658:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8caa00 with x1830945721716224 ext(0->1048575) 00002000:00010000:1.0:1746126625.382661:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8caa00 00000100:00100000:0.0:1746126625.382662:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721715840:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126625.382672:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8066 00000100:00100000:1.0:1746126625.382676:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721716224:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126625.384062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.384084:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721716352 00000100:00100000:1.0:1746126625.384089:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721716352 00002000:00100000:1.0:1746126625.384116:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e8c8a80 x1830945721716352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.384125:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8a80 with x1830945721716352 ext(1048576->2097151) 00002000:00010000:1.0:1746126625.384128:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c8a80 00000100:00100000:1.0:1746126625.384142:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8067 00000100:00100000:1.0:1746126625.384147:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721716352:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126625.384675:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721467008:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.384699:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126625.385411:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721714688:12345-192.168.203.2@tcp:3:cat.0 Request processed in 16835us (18128us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126625.385420:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8061 00002000:00100000:1.0:1746126625.385426:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800924c5880 x1830945721714688/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.385434:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c5880 with x1830945721714688 ext(1048576->2097151) 00002000:00010000:1.0:1746126625.385438:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c5880 00000100:00100000:0.0:1746126625.387653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.388405:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721716608 00000100:00100000:1.0:1746126625.388415:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721716608 00010000:00010000:1.0:1746126625.388452:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.388482:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7389 00000100:00100000:1.0:1746126625.388490:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721716608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.388503:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.388510:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.388523:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.388545:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd6000/0xb50e825867614ebf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4e9f9 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.388560:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.388564:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.388573:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.388579:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.388614:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.388653:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721716608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 163us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.388659:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7389 00010000:00010000:2.0:1746126625.388863:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.388872:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:3.0:1746126625.389214:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721714944:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18319us (21903us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.389222:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8062 00002000:00100000:3.0:1746126625.389231:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800924c4a80 x1830945721714944/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.389240:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4a80 with x1830945721714944 ext(1048576->2097151) 00002000:00010000:3.0:1746126625.389245:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4a80 00000040:00080000:2.0:1746126625.389608:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2717, 88 off230960 00000004:00080000:2.0:1746126625.389614:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303785766ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389669:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2841, 88 off241968 00000004:00080000:2.0:1746126625.389672:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303844988ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389690:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2842, 88 off242056 00000004:00080000:2.0:1746126625.389694:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303866154ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389720:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2718, 88 off231048 00000004:00080000:2.0:1746126625.389723:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303895873ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389732:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2719, 88 off231136 00000004:00080000:2.0:1746126625.389735:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303907194ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389741:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2843, 88 off242144 00000004:00080000:2.0:1746126625.389743:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303915551ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389749:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2844, 88 off242232 00000004:00080000:2.0:1746126625.389751:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303923811ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389756:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2720, 88 off231224 00000004:00080000:2.0:1746126625.389759:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303931458ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389765:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2845, 88 off242320 00000004:00080000:2.0:1746126625.389767:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303939668ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389773:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2721, 88 off231312 00000004:00080000:2.0:1746126625.389775:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303947528ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389781:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2846, 88 off242408 00000004:00080000:2.0:1746126625.389783:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303956071ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389789:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2722, 88 off231400 00000004:00080000:2.0:1746126625.389791:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303963694ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389796:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2847, 88 off242496 00000004:00080000:2.0:1746126625.389798:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303971094ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389804:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2723, 88 off231488 00000004:00080000:2.0:1746126625.389806:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747303978766ns, next at 687927188999ns, rc = 0 00000040:00080000:2.0:1746126625.389812:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2848, 88 off242584 00000004:00080000:2.0:1746126625.389814:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303986919ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389821:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2849, 88 off242672 00000004:00080000:2.0:1746126625.389823:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747303995916ns, next at 687959345514ns, rc = 0 00000040:00080000:2.0:1746126625.389852:0:20362:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2724, 88 off231576 00000004:00080000:2.0:1746126625.389854:0:20362:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747304027086ns, next at 687927188999ns, rc = 0 00000100:00100000:2.0:1746126625.393514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.393542:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721716736 00000100:00100000:2.0:1746126625.393551:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721716736 00000100:00100000:2.0:1746126625.393596:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9071 00000100:00100000:2.0:1746126625.393603:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31591:x1830945721716736:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126625.393628:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.393647:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea7e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.394401:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721714432:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26630us (27175us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.394411:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8060 00002000:00100000:3.0:1746126625.394422:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff8800924c5180 x1830945721714432/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.394430:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c5180 with x1830945721714432 ext(0->1048575) 00002000:00010000:3.0:1746126625.394434:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c5180 00010000:00010000:2.0:1746126625.394599:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.394609:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.394630:0:14548:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.394641:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.394653:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.394655:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126625.394658:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.394664:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b0200, rc 0) 00000100:00100000:2.0:1746126625.394968:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31591:x1830945721716736:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 1365us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.394974:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9071 00000100:00100000:0.0:1746126625.395779:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721715200:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24874us (28450us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126625.395788:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8063 00002000:00100000:0.0:1746126625.395795:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800924c7100 x1830945721715200/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.395803:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c7100 with x1830945721715200 ext(1048576->2097151) 00002000:00010000:0.0:1746126625.395807:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c7100 00000100:00100000:2.0:1746126625.405696:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721715968:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 23874us (24246us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.405708:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8064 00002000:00100000:2.0:1746126625.405721:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a4f54000 x1830945721715968/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.405730:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f54000 with x1830945721715968 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.405735:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f54000 00000100:00100000:0.0:1746126625.408336:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721716224:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 25651us (25750us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126625.408347:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8066 00002000:00100000:0.0:1746126625.408358:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88009e8caa00 x1830945721716224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.408367:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8caa00 with x1830945721716224 ext(0->1048575) 00002000:00010000:0.0:1746126625.408372:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8caa00 00000100:00100000:1.0:1746126625.410639:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+28:1966:x1830945721716352:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 26484us (26576us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126625.410650:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8067 00002000:00100000:1.0:1746126625.410660:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009e8c8a80 x1830945721716352/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.410668:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8a80 with x1830945721716352 ext(1048576->2097151) 00002000:00010000:1.0:1746126625.410675:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c8a80 00000100:00100000:0.0:1746126625.410931:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1966:x1830945721715840:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 28268us (28386us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126625.410938:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8065 00002000:00100000:0.0:1746126625.410943:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e8c9f80 x1830945721715840/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.410950:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c9f80 with x1830945721715840 ext(1048576->2097151) 00002000:00010000:0.0:1746126625.410954:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c9f80 00000100:00100000:0.0:1746126625.415716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.415748:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721716864 00000100:00100000:0.0:1746126625.415757:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721716864 00000100:00100000:0.0:1746126625.415796:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9072 00000100:00100000:0.0:1746126625.415804:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+228:31597:x1830945721716864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126625.415823:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.415862:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea85 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.416521:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 229 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.416534:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 229 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.416546:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126625.416549:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126625.416552:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.416559:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093778400, rc 0) 00000100:00100000:0.0:1746126625.417727:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27c713d7-92e0-4974-b612-500c641c1d6c+229:31597:x1830945721716864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1918us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.417737:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9072 00000001:00080000:1.0:1746126625.424081:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943272 is committed 00000001:00080000:1.0:1746126625.424100:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943270 is committed 00000001:00080000:1.0:1746126625.424106:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943267 is committed 00000001:00080000:1.0:1746126625.424113:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943274 is committed 00000004:00080000:1.0:1746126625.424117:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2108 committed 00000004:00080000:1.0:1746126625.424124:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2230 committed 00000004:00080000:1.0:1746126625.424128:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2229 committed 00000004:00080000:1.0:1746126625.424130:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2107 committed 00000004:00080000:1.0:1746126625.424132:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2228 committed 00000004:00080000:1.0:1746126625.424133:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2106 committed 00000004:00080000:1.0:1746126625.424135:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2227 committed 00000004:00080000:1.0:1746126625.424136:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2105 committed 00000004:00080000:1.0:1746126625.424137:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2226 committed 00000004:00080000:1.0:1746126625.424139:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2104 committed 00000004:00080000:1.0:1746126625.424140:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2225 committed 00000004:00080000:1.0:1746126625.424141:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2224 committed 00000004:00080000:1.0:1746126625.424142:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2103 committed 00000004:00080000:1.0:1746126625.424143:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2102 committed 00000004:00080000:1.0:1746126625.424145:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2223 committed 00000004:00080000:1.0:1746126625.424146:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2222 committed 00000004:00080000:1.0:1746126625.424147:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2101 committed 00000001:00080000:1.0:1746126625.424151:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943273 is committed 00010000:00010000:3.0:1746126625.424354:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea77 expref: 225 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424368:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126625.424371:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746126625.424376:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424387:0:20362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424394:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424401:0:20362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424406:0:20362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424411:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.424433:0:20362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 225 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.424444:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721467264:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126625.424531:0:20362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.424541:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721467392:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126625.424554:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.425278:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721467136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.425315:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425332:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721467904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.425346:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425355:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.425367:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425375:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.425388:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425404:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746126625.425408:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721467520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.425421:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425430:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.425442:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425450:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.425462:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425470:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721469056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.425481:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.425502:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467136 00000100:00100000:2.0:1746126625.425509:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467136 00000100:00100000:2.0:1746126625.425541:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467904 00000100:00100000:2.0:1746126625.425543:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467904 00000100:00100000:2.0:1746126625.425552:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468416 00000100:00100000:2.0:1746126625.425554:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468416 00000100:00100000:2.0:1746126625.425562:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468928 00000100:00100000:2.0:1746126625.425563:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468928 00000100:00100000:2.0:1746126625.425571:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467520 00000100:00100000:2.0:1746126625.425573:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467520 00000100:00100000:2.0:1746126625.425578:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468032 00000100:00100000:2.0:1746126625.425580:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468032 00000100:00100000:2.0:1746126625.425586:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468544 00000100:00100000:2.0:1746126625.425587:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468544 00000100:00100000:2.0:1746126625.425592:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469056 00000100:00100000:2.0:1746126625.425594:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469056 00000100:00100000:2.0:1746126625.425603:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14117 00000100:00100000:2.0:1746126625.425609:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3296:x1830945721467136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126625.425779:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126625.425782:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126624 -> 1746126624 00002000:00010000:2.0:1746126625.425784:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126624 -> 1746126624 00002000:00010000:2.0:1746126625.425785:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126624 -> 1746126624 00002000:00010000:2.0:1746126625.425787:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746126625.425811:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721467136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (496us total) trans 17179873314 rc 0/0 00000100:00100000:2.0:1746126625.425816:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14117 00000100:00100000:2.0:1746126625.425846:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14118 00000100:00100000:2.0:1746126625.425850:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3296:x1830945721467904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.425927:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721467648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.425932:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721467904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (584us total) trans 17179873315 rc 0/0 00000100:00100000:2.0:1746126625.425937:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14118 00000100:00100000:2.0:1746126625.425945:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14119 00000100:00100000:2.0:1746126625.425949:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3296:x1830945721468416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.425950:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.425961:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.425972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.425977:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.425987:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.425992:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721469184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.426012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126625.426021:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746126625.426025:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721467776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.426030:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3296:x1830945721468416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (662us total) trans 17179873316 rc 0/0 00000100:00100000:2.0:1746126625.426035:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14119 00000100:00100000:3.0:1746126625.426037:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.426042:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467648 00000100:00100000:3.0:1746126625.426043:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.426045:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467648 00000100:00100000:3.0:1746126625.426052:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.426052:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468160 00000100:00100000:2.0:1746126625.426053:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468160 00000100:00100000:3.0:1746126625.426057:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426058:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468672 00000100:00100000:2.0:1746126625.426060:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468672 00000100:00100000:2.0:1746126625.426065:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469184 00000100:00100000:2.0:1746126625.426066:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469184 00000100:00100000:3.0:1746126625.426069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.426072:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721467776 00000100:00100000:2.0:1746126625.426073:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721467776 00000100:00100000:3.0:1746126625.426074:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721469312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426078:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468288 00000100:00100000:2.0:1746126625.426080:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468288 00000100:00100000:3.0:1746126625.426084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.426086:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721468800 00000100:00100000:2.0:1746126625.426087:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721468800 00000100:00100000:2.0:1746126625.426092:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469312 00000100:00100000:2.0:1746126625.426094:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469312 00000100:00100000:2.0:1746126625.426100:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14120 00000100:00100000:3.0:1746126625.426104:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14121 00000100:00100000:2.0:1746126625.426104:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721468928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.426119:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721467520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426202:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1830945721468928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (812us total) trans 21474840460 rc 0/0 00002000:00010000:3.0:1746126625.426207:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746126625.426207:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14120 00002000:00010000:3.0:1746126625.426210:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126623 -> 1746126623 00002000:00010000:3.0:1746126625.426212:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126621 -> 1746126621 00002000:00010000:3.0:1746126625.426213:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126623 -> 1746126623 00002000:00010000:3.0:1746126625.426215:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:2.0:1746126625.426215:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14122 00000100:00100000:2.0:1746126625.426219:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3296:x1830945721468032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.426232:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721467520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (810us total) trans 21474840461 rc 0/0 00000100:00100000:3.0:1746126625.426237:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14121 00000100:00100000:3.0:1746126625.426246:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14123 00000100:00100000:3.0:1746126625.426249:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830945721468544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126625.426282:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746126625.426284:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb mtime from disk: 1746126581 -> 1746126581 00002000:00010000:2.0:1746126625.426286:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746126625.426288:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb ctime from disk: 1746126581 -> 1746126581 00002000:00010000:2.0:1746126625.426289:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x324:0x0] updating lvb blocks from disk: 2055 -> 2055 00002000:00010000:3.0:1746126625.426307:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746126625.426307:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3296:x1830945721468032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (863us total) trans 17179873317 rc 0/0 00002000:00010000:3.0:1746126625.426309:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126625.426311:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126618 -> 1746126618 00000100:00100000:2.0:1746126625.426311:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14122 00002000:00010000:3.0:1746126625.426312:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126620 -> 1746126620 00002000:00010000:3.0:1746126625.426314:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746126625.426319:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14124 00000100:00100000:2.0:1746126625.426323:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721469056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.426331:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721468544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (868us total) trans 21474840462 rc 0/0 00000100:00100000:3.0:1746126625.426336:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14123 00000100:00100000:3.0:1746126625.426345:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14125 00000100:00100000:3.0:1746126625.426350:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721467648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.426394:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721469056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (911us total) trans 21474840463 rc 0/0 00000100:00100000:2.0:1746126625.426398:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14124 00000100:00100000:2.0:1746126625.426406:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14126 00000100:00100000:2.0:1746126625.426410:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721468160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746126625.426414:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126625.426416:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126624 -> 1746126624 00002000:00010000:3.0:1746126625.426418:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126624 -> 1746126624 00002000:00010000:3.0:1746126625.426420:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126624 -> 1746126624 00002000:00010000:3.0:1746126625.426421:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746126625.426442:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721467648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (491us total) trans 17179873318 rc 0/0 00000100:00100000:3.0:1746126625.426448:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14125 00000100:00100000:3.0:1746126625.426456:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14127 00000100:00100000:3.0:1746126625.426460:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721468672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426479:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721468160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (506us total) trans 17179873319 rc 0/0 00000100:00100000:2.0:1746126625.426484:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14126 00000100:00100000:2.0:1746126625.426492:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14128 00000100:00100000:2.0:1746126625.426496:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721469184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426569:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721469184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (565us total) trans 21474840465 rc 0/0 00000100:00100000:2.0:1746126625.426573:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14128 00000100:00100000:2.0:1746126625.426582:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14129 00000100:00100000:2.0:1746126625.426586:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721467776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126625.426647:0:4641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746126625.426649:0:4641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126624 -> 1746126624 00002000:00010000:2.0:1746126625.426651:0:4641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126624 -> 1746126624 00002000:00010000:2.0:1746126625.426652:0:4641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126624 -> 1746126624 00002000:00010000:2.0:1746126625.426654:0:4641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746126625.426669:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721467776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (631us total) trans 17179873320 rc 0/0 00000100:00100000:2.0:1746126625.426673:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14129 00000100:00100000:2.0:1746126625.426681:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14130 00000100:00100000:2.0:1746126625.426685:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3294:x1830945721468288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.426753:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3294:x1830945721468288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (698us total) trans 17179873321 rc 0/0 00000100:00100000:2.0:1746126625.426757:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14130 00000100:00100000:2.0:1746126625.426766:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14131 00000100:00100000:2.0:1746126625.426770:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721468800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426865:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721468800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (794us total) trans 21474840466 rc 0/0 00000100:00100000:2.0:1746126625.426870:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14131 00000100:00100000:2.0:1746126625.426878:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14132 00000100:00100000:2.0:1746126625.426882:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830945721469312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126625.426948:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721469312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (862us total) trans 21474840467 rc 0/0 00000100:00100000:2.0:1746126625.426953:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14132 00002000:00010000:3.0:1746126625.426994:0:17475:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00000004:00080000:2.0:1746126625.426995:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f54700/2, rc 0, transno 21474840461 00002000:00010000:3.0:1746126625.426996:0:17475:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126624 -> 1746126624 00002000:00010000:3.0:1746126625.426998:0:17475:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126624 -> 1746126624 00002000:00010000:3.0:1746126625.427000:0:17475:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126624 -> 1746126624 00000100:00100000:2.0:1746126625.427000:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721467520:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746126625.427010:0:17475:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000004:00080000:2.0:1746126625.427021:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bced80/2, rc 0, transno 17179873317 00000100:00100000:3.0:1746126625.427028:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721468672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 567us (1039us total) trans 21474840464 rc 0/0 00000100:00100000:3.0:1746126625.427033:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14127 00000004:00080000:3.0:1746126625.427143:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcd880/2, rc 0, transno 17179873320 00000100:00100000:0.0:1746126625.427902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.428439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.428567:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721716992 00000100:00100000:0.0:1746126625.428573:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721716992 00000100:00100000:0.0:1746126625.428611:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721717120 00000100:00100000:0.0:1746126625.428614:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721717120 00000100:00100000:0.0:1746126625.428632:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3862 00000100:00100000:0.0:1746126625.428638:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d08c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31597:x1830945721716992:12345-192.168.203.2@tcp:49:cat.0 00000100:00100000:0.0:1746126625.428727:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d08c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31597:x1830945721716992:12345-192.168.203.2@tcp:49:cat.0 Request processed in 89us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.428732:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3862 00000100:00100000:0.0:1746126625.428764:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3863 00000100:00100000:0.0:1746126625.428768:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31591:x1830945721717120:12345-192.168.203.2@tcp:49:multiop.0 00000100:00100000:0.0:1746126625.428794:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31591:x1830945721717120:12345-192.168.203.2@tcp:49:multiop.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.428798:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3863 00000100:00100000:0.0:1746126625.428870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.428922:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721717248 00000100:00100000:0.0:1746126625.428925:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721717248 00000100:00100000:0.0:1746126625.428943:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9073 00000100:00100000:0.0:1746126625.428947:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31596:x1830945721717248:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126625.428956:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.428972:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5102400/0xb50e825867614fad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea8c expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.429020:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5102400/0xb50e825867614fad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea8c expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.429034:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5102400/0xb50e825867614fad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea8c expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.429049:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126625.429052:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126625.429056:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5102400, rc 0) 00000100:00100000:0.0:1746126625.429075:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31596:x1830945721717248:12345-192.168.203.2@tcp:101:cat.0 Request processed in 127us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.429080:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9073 00000100:00100000:3.0:1746126625.429484:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721467776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.429511:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02c000/2, rc 0, transno 17179873321 00000100:00100000:3.0:1746126625.429515:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.429526:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5956d80/2, rc 0, transno 21474840466 00000100:00100000:3.0:1746126625.429529:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126625.429537:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5956300/2, rc 0, transno 21474840467 00000100:00100000:3.0:1746126625.429540:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721469312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126625.429547:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcf800/2, rc 0, transno 17179873318 00000100:00100000:3.0:1746126625.429550:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721467648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.429557:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02ea00/2, rc 0, transno 17179873319 00000100:00100000:3.0:1746126625.429560:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126625.429568:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5955500/2, rc 0, transno 21474840464 00000100:00100000:3.0:1746126625.429571:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721468672:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126625.429577:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5954700/2, rc 0, transno 21474840465 00000100:00100000:3.0:1746126625.429580:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721469184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126625.429608:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721467264:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126625.429617:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721467392:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126625.429643:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800933e6000/0xb50e825867614f91 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea77 expref: 225 pid: 20362 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746126625.429655:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea77 expref: 224 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.429669:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d4e800, rc 0) 00000100:00100000:3.0:1746126625.431165:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:31593:x1830945721715456:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 57515us (63788us total) trans 8589943274 rc 0/0 00000100:00100000:3.0:1746126625.431172:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9070 00000100:00100000:3.0:1746126625.431194:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746126625.431205:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721469440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126625.431245:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126625.431489:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468032:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126625.431516:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4f55f80/2, rc 0, transno 21474840462 00000100:00100000:2.0:1746126625.431520:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468544:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126625.431527:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5955180/2, rc 0, transno 21474840463 00000100:00100000:2.0:1746126625.431530:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721469056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126625.431538:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcce00/2, rc 0, transno 17179873314 00000100:00100000:2.0:1746126625.431540:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721467136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126625.431549:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135bcea00/2, rc 0, transno 17179873315 00000100:00100000:2.0:1746126625.431551:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721467904:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126625.431557:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02f100/2, rc 0, transno 17179873316 00000100:00100000:2.0:1746126625.431559:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468416:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126625.431565:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5956680/2, rc 0, transno 21474840460 00000100:00100000:2.0:1746126625.431567:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721468928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126625.431730:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721469440 00000100:00100000:0.0:1746126625.431736:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721469440 00000100:00100000:2.0:1746126625.431935:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14133 00000100:00100000:2.0:1746126625.431943:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3297:x1830945721469440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126625.432568:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3297:x1830945721469440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 625us (1321us total) trans 17179873322 rc 0/0 00000100:00100000:2.0:1746126625.432574:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14133 00000004:00080000:3.0:1746126625.432636:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f02d880/2, rc 0, transno 17179873322 00000100:00100000:3.0:1746126625.432640:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721469440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126625.449108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.449154:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.449188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.449231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.449419:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721717760 00000100:00100000:3.0:1746126625.449430:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721717760 00000100:00100000:3.0:1746126625.449477:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721717888 00000100:00100000:3.0:1746126625.449479:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721717888 00000100:00100000:3.0:1746126625.449497:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14134 00000100:00100000:3.0:1746126625.449503:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31591:x1830945721717760:12345-192.168.203.2@tcp:101:multiop.0 00000100:00100000:1.0:1746126625.449505:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721717376 00000100:00100000:1.0:1746126625.449509:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721717376 00010000:00010000:3.0:1746126625.449523:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.449540:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea93 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126625.449541:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 710 00000100:00100000:1.0:1746126625.449546:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721717376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.449559:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.449571:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 23 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.449579:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126625.449580:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5102400/0xb50e825867614fad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea8c expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.449585:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.449587:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.449590:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3690496->4177919] (req 3690496->4177919) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 23 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.449598:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.449602:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126625.449618:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.449628:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 30 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.449639:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721469568:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.449642:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721717376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 95us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.449649:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 710 00000100:00100000:1.0:1746126625.449675:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14135 00000100:00100000:1.0:1746126625.449680:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+30:31593:x1830945721717888:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126625.449687:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.449693:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ea9a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.449695:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 23 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.449707:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 23 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.449718:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.449719:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.449722:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.449731:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.449744:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e2e00, rc 0) 00000100:00100000:1.0:1746126625.449762:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+31:31593:x1830945721717888:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 82us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.449767:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14135 00000100:00100000:2.0:1746126625.449793:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721717632 00000100:00100000:2.0:1746126625.449797:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721717632 00002000:00100000:2.0:1746126625.449853:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009f02f480 x1830945721717632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.449862:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02f480 with x1830945721717632 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.449867:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f02f480 00000100:00100000:2.0:1746126625.449998:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8068 00000100:00100000:2.0:1746126625.450013:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721717632:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126625.450040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.450327:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721718144 00000100:00100000:0.0:1746126625.450330:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721718144 00002000:00100000:0.0:1746126625.450347:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e8cbb80 x1830945721718144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.450354:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cbb80 with x1830945721718144 ext(1048576->2097151) 00002000:00010000:0.0:1746126625.450357:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cbb80 00000100:00100000:0.0:1746126625.450367:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8069 00000100:00100000:0.0:1746126625.450371:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721718144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.450596:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721469696:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.450672:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.455307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.455400:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721469568:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.455411:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721469696:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.455437:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3690496->4177919] (req 3690496->4177919) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 25 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.455456:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570f800, rc 0) 00000100:00100000:3.0:1746126625.455484:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31591:x1830945721717760:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 5981us (6294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.455492:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14134 00000100:00100000:0.0:1746126625.455673:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721718272 00000100:00100000:0.0:1746126625.455679:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721718272 00010000:00010000:0.0:1746126625.455703:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 33 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126625.455725:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7390 00000100:00100000:0.0:1746126625.455730:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721718272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126625.455741:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126625.455760:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 33 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.455771:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 33 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.455794:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092fcde00/0xb50e825867614f59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea5b expref: 33 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.455809:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126625.455844:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721718272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.455850:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7390 00000100:00100000:0.0:1746126625.456405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.456422:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721718400 00000100:00100000:0.0:1746126625.456425:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721718400 00010000:00010000:0.0:1746126625.456437:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 25 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126625.456464:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7391 00000100:00100000:0.0:1746126625.456469:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721718400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126625.456476:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126625.456483:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 25 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.456491:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 25 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.456506:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c893200/0xb50e825867614f2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea31 expref: 25 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126625.456515:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.456517:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.456523:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.456530:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.456538:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.456539:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.456542:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.456549:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.456573:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126625.456583:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721469824:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126625.456650:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126625.456662:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721469952:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126625.456682:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.465512:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721717632:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 15497us (16345us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.465525:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8068 00002000:00100000:2.0:1746126625.465538:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009f02f480 x1830945721717632/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.465548:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f02f480 with x1830945721717632 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.465554:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f02f480 00000100:00100000:2.0:1746126625.468790:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721718144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18406us (18739us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.468801:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8069 00002000:00100000:2.0:1746126625.468812:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009e8cbb80 x1830945721718144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.468821:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cbb80 with x1830945721718144 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.469037:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cbb80 00000100:00100000:0.0:1746126625.473878:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.473943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.473963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.473991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.474055:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721718656 00000100:00100000:3.0:1746126625.474064:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721718656 00000100:00100000:3.0:1746126625.474081:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721718912 00000100:00100000:3.0:1746126625.474083:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721718912 00000100:00100000:2.0:1746126625.474111:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721469824:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126625.474122:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721469952:192.168.203.2@tcp:105: 00002000:00100000:3.0:1746126625.474126:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3690496->3694591) req@ffff88009e8c8700 x1830945721718912/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.474135:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8700 with x1830945721718912 ext(3690496->3694591) 00002000:00010000:3.0:1746126625.474139:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c8700 00010000:00010000:2.0:1746126625.474146:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.474169:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721719168 00000100:00100000:3.0:1746126625.474172:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721719168 00002000:00100000:3.0:1746126625.474184:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e8cb100 x1830945721719168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.474190:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb100 with x1830945721719168 ext(1048576->2097151) 00002000:00010000:3.0:1746126625.474193:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cb100 00000100:00100000:1.0:1746126625.474194:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721719424 00000100:00100000:1.0:1746126625.474197:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721719424 00000100:00100000:3.0:1746126625.474205:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8070 00000100:00100000:3.0:1746126625.474212:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721718912:12345-192.168.203.2@tcp:3:cat.0 00002000:00100000:1.0:1746126625.474216:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009bb2c380 x1830945721719424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.474224:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c380 with x1830945721719424 ext(1048576->2097151) 00002000:00010000:1.0:1746126625.474227:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c380 00000100:00100000:1.0:1746126625.474240:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8071 00000100:00100000:1.0:1746126625.474245:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721719168:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126625.474358:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721718400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 17887us (17953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.474366:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7391 00000100:00100000:2.0:1746126625.474395:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8072 00000100:00100000:2.0:1746126625.474401:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721719424:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126625.474696:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721718912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 484us (754us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126625.474702:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8070 00002000:00100000:3.0:1746126625.474706:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3690496->3694591) req@ffff88009e8c8700 x1830945721718912/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.474713:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c8700 with x1830945721718912 ext(3690496->3694591) 00002000:00010000:3.0:1746126625.474715:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c8700 00002000:00100000:3.0:1746126625.474739:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3334144->3338239) req@ffff8800924c4700 x1830945721718656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.474746:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4700 with x1830945721718656 ext(3334144->3338239) 00002000:00010000:3.0:1746126625.474749:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4700 00000100:00100000:3.0:1746126625.474762:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8073 00000100:00100000:3.0:1746126625.474767:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721718656:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126625.474842:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721718656:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 58us (956us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126625.474848:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8073 00002000:00100000:3.0:1746126625.474852:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3334144->3338239) req@ffff8800924c4700 x1830945721718656/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.474859:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c4700 with x1830945721718656 ext(3334144->3338239) 00002000:00010000:3.0:1746126625.474862:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c4700 00000100:00100000:1.0:1746126625.484107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.484161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.484243:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721719680 00000100:00100000:2.0:1746126625.484254:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721719680 00002000:00100000:2.0:1746126625.484299:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009bb2e680 x1830945721719680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.484309:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830945721719680 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.484315:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2e680 00000100:00100000:2.0:1746126625.484343:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721719936 00000100:00100000:2.0:1746126625.484346:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721719936 00002000:00100000:2.0:1746126625.484358:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3485696->3489791) req@ffff88009bb2f800 x1830945721719936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.484365:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f800 with x1830945721719936 ext(3485696->3489791) 00002000:00010000:2.0:1746126625.484368:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2f800 00000100:00100000:2.0:1746126625.484380:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8074 00000100:00100000:2.0:1746126625.484387:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721719680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.484388:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8075 00000100:00100000:3.0:1746126625.484397:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721719936:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126625.484548:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721719936:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 151us (385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126625.484555:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8075 00002000:00100000:3.0:1746126625.484560:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3485696->3489791) req@ffff88009bb2f800 x1830945721719936/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.484567:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f800 with x1830945721719936 ext(3485696->3489791) 00002000:00010000:3.0:1746126625.484571:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2f800 00000100:00100000:0.0:1746126625.503413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.503505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.503617:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721720192 00000100:00100000:2.0:1746126625.503628:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721720192 00002000:00100000:2.0:1746126625.503674:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (4173824->4177919) req@ffff8800924c7800 x1830945721720192/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.503683:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c7800 with x1830945721720192 ext(4173824->4177919) 00002000:00010000:2.0:1746126625.503688:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c7800 00000100:00100000:2.0:1746126625.503706:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721720448 00000100:00100000:2.0:1746126625.503708:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721720448 00002000:00100000:2.0:1746126625.503719:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800924c6300 x1830945721720448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.503725:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6300 with x1830945721720448 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.503729:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c6300 00000100:00100000:2.0:1746126625.503741:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8076 00000100:00100000:2.0:1746126625.503747:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721720192:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.503884:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8077 00000100:00100000:3.0:1746126625.503893:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721720448:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126625.503914:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721720192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 167us (511us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126625.503923:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8076 00002000:00100000:2.0:1746126625.503927:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (4173824->4177919) req@ffff8800924c7800 x1830945721720192/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.503933:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c7800 with x1830945721720192 ext(4173824->4177919) 00002000:00010000:2.0:1746126625.503935:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924c7800 00000100:00100000:2.0:1746126625.504212:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721719168:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 29965us (30247us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.504217:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8071 00002000:00100000:2.0:1746126625.504222:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e8cb100 x1830945721719168/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.504228:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8cb100 with x1830945721719168 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.504231:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8cb100 00000100:00100000:2.0:1746126625.509946:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+28:1965:x1830945721719424:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 35531us (35940us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.509960:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8072 00002000:00100000:2.0:1746126625.509974:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88009bb2c380 x1830945721719424/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.509983:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c380 with x1830945721719424 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.509989:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c380 00000100:00100000:2.0:1746126625.514503:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1966:x1830945721719680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 30103us (30392us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.514516:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8074 00002000:00100000:2.0:1746126625.514527:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009bb2e680 x1830945721719680/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.514537:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830945721719680 ext(1048576->2097151) 00002000:00010000:2.0:1746126625.514542:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2e680 00000100:00100000:3.0:1746126625.517716:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721720448:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13814us (14199us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.517729:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8077 00002000:00100000:3.0:1746126625.517740:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800924c6300 x1830945721720448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.517750:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c6300 with x1830945721720448 ext(1048576->2097151) 00002000:00010000:3.0:1746126625.517756:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c6300 00000100:00100000:0.0:1746126625.530924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.531047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.531157:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721720832 00000100:00100000:2.0:1746126625.531167:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721720832 00002000:00100000:2.0:1746126625.531218:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a4f56300 x1830945721720832/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.531227:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56300 with x1830945721720832 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.531232:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f56300 00000100:00100000:2.0:1746126625.531267:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8078 00000100:00100000:2.0:1746126625.531274:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721720832:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.531562:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721720576 00000100:00100000:3.0:1746126625.531567:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721720576 00000100:00100000:3.0:1746126625.531598:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14136 00000100:00100000:3.0:1746126625.531603:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721720576:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.531614:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.531630:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614fc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eaa1 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.531674:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721470080:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126625.532455:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00002000:00010000:3.0:1746126625.539703:0:10890:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126624 -> 1746126625 00002000:00010000:3.0:1746126625.539713:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126624 -> 1746126625 00002000:00010000:3.0:1746126625.539715:0:10890:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126624 -> 1746126625 00000100:00100000:3.0:1746126625.539741:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721470080:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126625.539774:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614fc2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa1 expref: 31 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.539789:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570e400/0xb50e825867614fc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa1 expref: 31 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.540977:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570e400, rc 0) 00000100:00100000:3.0:1746126625.541051:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721720576:12345-192.168.203.2@tcp:101:cat.0 Request processed in 9444us (10169us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126625.541060:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14136 00000100:00100000:2.0:1746126625.543740:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721720832:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12457us (12683us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.543753:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8078 00002000:00100000:2.0:1746126625.543764:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a4f56300 x1830945721720832/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.543773:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f56300 with x1830945721720832 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.543779:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f56300 00000100:00100000:0.0:1746126625.546205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.546519:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721721088 00000100:00100000:2.0:1746126625.546528:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721721088 00002000:00100000:2.0:1746126625.546575:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a4f55500 x1830945721721088/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.546585:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55500 with x1830945721721088 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.546590:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f55500 00000100:00100000:2.0:1746126625.546629:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8079 00000100:00100000:2.0:1746126625.546637:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721721088:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.556518:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1963:x1830945721721088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 9870us (10309us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.556532:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8079 00002000:00100000:3.0:1746126625.556544:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a4f55500 x1830945721721088/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.556555:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f55500 with x1830945721721088 ext(2097152->3145727) 00002000:00010000:3.0:1746126625.556560:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f55500 00000100:00100000:0.0:1746126625.557304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.557506:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721721216 00000100:00100000:3.0:1746126625.557514:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721721216 00000100:00100000:3.0:1746126625.557551:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14137 00000100:00100000:3.0:1746126625.557558:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31596:x1830945721721216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.557574:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.557590:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eaa8 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.557614:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.557616:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.557623:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.557636:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.557647:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570ea00, rc 0) 00000100:00100000:3.0:1746126625.557793:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31596:x1830945721721216:12345-192.168.203.2@tcp:101:cat.0 Request processed in 234us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.557799:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14137 00000100:00100000:0.0:1746126625.563737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.565054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.565090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.565124:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721721600 00000100:00100000:2.0:1746126625.565135:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721721600 00002000:00100000:2.0:1746126625.565187:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880093af5880 x1830945721721600/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.565197:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5880 with x1830945721721600 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.565203:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af5880 00000100:00100000:2.0:1746126625.565227:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721721856 00000100:00100000:2.0:1746126625.565230:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721721856 00002000:00100000:2.0:1746126625.565245:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093af6300 x1830945721721856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.565252:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6300 with x1830945721721856 ext(3145728->4194303) 00002000:00010000:2.0:1746126625.565256:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af6300 00000100:00100000:2.0:1746126625.565275:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8080 00000100:00100000:2.0:1746126625.565282:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721721600:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.565442:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721721344 00000100:00100000:3.0:1746126625.565446:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721721344 00000100:00100000:3.0:1746126625.565469:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14138 00000100:00100000:3.0:1746126625.565474:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:31597:x1830945721721344:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.565484:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.565501:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eaaf expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.565521:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.565523:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.565535:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 31 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.565550:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 31 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.565560:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570f600, rc 0) 00000100:00100000:3.0:1746126625.565606:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:31597:x1830945721721344:12345-192.168.203.2@tcp:101:cat.0 Request processed in 131us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.565612:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14138 00000100:00100000:1.0:1746126625.565620:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8081 00000100:00100000:1.0:1746126625.565628:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721721856:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.574295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.574340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.574409:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721722112 00000100:00100000:2.0:1746126625.574420:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721722112 00002000:00100000:2.0:1746126625.574466:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880093af5500 x1830945721722112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.574477:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5500 with x1830945721722112 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.574482:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af5500 00000100:00100000:2.0:1746126625.574499:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721722368 00000100:00100000:2.0:1746126625.574502:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721722368 00002000:00100000:2.0:1746126625.574513:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093af7100 x1830945721722368/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.574520:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7100 with x1830945721722368 ext(3145728->4194303) 00002000:00010000:2.0:1746126625.574523:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af7100 00000100:00100000:2.0:1746126625.574541:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8082 00000100:00100000:2.0:1746126625.574546:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721722112:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.574705:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8083 00000100:00100000:3.0:1746126625.574713:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721722368:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.577664:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721721600:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12374us (12602us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.577674:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8080 00002000:00100000:3.0:1746126625.577684:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880093af5880 x1830945721721600/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.577693:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5880 with x1830945721721600 ext(2097152->3145727) 00002000:00010000:3.0:1746126625.577698:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af5880 00000100:00100000:0.0:1746126625.577954:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1966:x1830945721721856:12345-192.168.203.2@tcp:3:cat.0 Request processed in 12327us (12862us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126625.577961:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8081 00002000:00100000:0.0:1746126625.577966:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093af6300 x1830945721721856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.577972:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6300 with x1830945721721856 ext(3145728->4194303) 00002000:00010000:0.0:1746126625.577975:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af6300 00000100:00100000:3.0:1746126625.588602:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+28:1964:x1830945721722368:12345-192.168.203.2@tcp:3:cat.0 Request processed in 13879us (14251us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126625.588616:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8083 00002000:00100000:3.0:1746126625.588629:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880093af7100 x1830945721722368/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.588638:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af7100 with x1830945721722368 ext(3145728->4194303) 00002000:00010000:3.0:1746126625.588645:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af7100 00000100:00100000:0.0:1746126625.590517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.590919:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721722496 00000100:00100000:3.0:1746126625.590930:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721722496 00000100:00100000:3.0:1746126625.590981:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14139 00000100:00100000:3.0:1746126625.590989:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31596:x1830945721722496:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.591017:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.591035:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eab6 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.591763:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721722112:12345-192.168.203.2@tcp:3:cat.0 Request processed in 17213us (17475us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.591772:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8082 00002000:00100000:2.0:1746126625.591781:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880093af5500 x1830945721722112/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.591789:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5500 with x1830945721722112 ext(2097152->3145727) 00002000:00010000:2.0:1746126625.591793:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af5500 00010000:00010000:3.0:1746126625.592165:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 30 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.592175:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.592181:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126625.592183:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126625.592186:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 24 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.592218:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.592229:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.592241:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721470208:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.592321:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 30 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.592330:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 30 pid: 8438 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.592337:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721470336:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.592355:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126625.598160:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721470208:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.598177:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721470336:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.598209:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 24 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.598227:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fa00, rc 0) 00000100:00100000:3.0:1746126625.598285:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31596:x1830945721722496:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7296us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.598294:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14139 00000100:00100000:1.0:1746126625.599959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.600293:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721722624 00000100:00100000:2.0:1746126625.600301:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721722624 00002000:00100000:2.0:1746126625.600347:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3690496->4177919) req@ffff88009bb2ce00 x1830945721722624/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.600356:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ce00 with x1830945721722624 ext(3690496->4177919) 00010000:00010000:2.0:1746126625.600364:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.600376:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 24 pid: 9686 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746126625.600382:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2ce00 00000100:00100000:2.0:1746126625.600415:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1859 00000100:00100000:2.0:1746126625.600423:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721722624:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126625.601526:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.601587:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721722752 00000100:00100000:3.0:1746126625.601592:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721722752 00002000:00100000:3.0:1746126625.601619:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3334144->3489791) req@ffff8800920bd500 x1830945721722752/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.601627:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bd500 with x1830945721722752 ext(3334144->3489791) 00010000:00010000:3.0:1746126625.601634:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.601644:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 31 pid: 8438 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.601650:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800920bd500 00000100:00100000:3.0:1746126625.601669:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1860 00000100:00100000:3.0:1746126625.601675:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721722752:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126625.602137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.603263:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721722880 00000100:00100000:3.0:1746126625.603271:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721722880 00000100:00100000:3.0:1746126625.603315:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14140 00000100:00100000:3.0:1746126625.603320:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:31597:x1830945721722880:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.603335:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.603351:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eabd expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.603378:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126625.603384:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 34 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.603396:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 34 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.603410:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348b0600, rc 0) 00000100:00100000:3.0:1746126625.603455:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+34:31597:x1830945721722880:12345-192.168.203.2@tcp:101:cat.0 Request processed in 134us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.603461:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14140 00000100:00100000:3.0:1746126625.605402:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721722752:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3720us (3873us total) trans 17179873323 rc 0/0 00000100:00100000:3.0:1746126625.605412:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1860 00002000:00100000:3.0:1746126625.605421:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3334144->3489791) req@ffff8800920bd500 x1830945721722752/t17179873323(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/448 e 0 to 0 dl 1746126636 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.605430:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bd500 with x1830945721722752 ext(3334144->3489791) 00010000:00010000:3.0:1746126625.605438:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 34 pid: 8438 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.605449:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 34 pid: 8438 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.605455:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800920bd500 00000100:00100000:0.0:1746126625.610696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.610788:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721723008 00000100:00100000:2.0:1746126625.610798:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721723008 00010000:00010000:2.0:1746126625.610926:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 34 pid: 8438 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.610959:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7392 00000100:00100000:2.0:1746126625.610967:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721723008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.610981:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.611012:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 34 pid: 8438 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.611023:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 34 pid: 8438 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.611046:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6e2e00/0xb50e825867614fbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [3334144->3489791] (req 3334144->3489791) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea9a expref: 34 pid: 8438 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.611065:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.611106:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+33:1965:x1830945721723008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 140us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.611113:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7392 00000100:00100000:2.0:1746126625.617570:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721722624:12345-192.168.203.2@tcp:4:cat.0 Request processed in 17135us (17604us total) trans 17179873324 rc 0/0 00000100:00100000:2.0:1746126625.617583:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1859 00002000:00100000:2.0:1746126625.617595:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3690496->4177919) req@ffff88009bb2ce00 x1830945721722624/t17179873324(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/448 e 0 to 0 dl 1746126636 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.617604:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ce00 with x1830945721722624 ext(3690496->4177919) 00010000:00010000:2.0:1746126625.617614:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 26 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.617631:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 26 pid: 9686 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746126625.617638:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2ce00 00000100:00100000:0.0:1746126625.634479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.634587:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721723136 00000100:00100000:2.0:1746126625.634598:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721723136 00010000:00010000:2.0:1746126625.634637:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 26 pid: 9686 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.634678:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7393 00000100:00100000:2.0:1746126625.634686:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721723136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.634702:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.634725:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 26 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.634737:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 26 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.634761:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f800/0xb50e825867614fb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [3489792->18446744073709551615] (req 3690496->4177919) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea93 expref: 26 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.634797:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.634799:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.634807:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.635612:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.635622:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.635623:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126625.635627:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.635634:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.635669:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.635683:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721470464:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126625.636355:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126625.636364:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721470592:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126625.636387:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126625.649329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.650459:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721723264 00000100:00100000:3.0:1746126625.650469:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721723264 00000100:00100000:3.0:1746126625.650526:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9074 00000100:00100000:3.0:1746126625.650534:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:31601:x1830945721723264:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126625.650560:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.650580:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1400/0xb50e825867614fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eac4 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.650646:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.650657:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.650667:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.650680:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.650686:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.650691:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.651595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:3.0:1746126625.651726:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.651738:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.651745:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.651751:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126625.651783:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.651799:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 223 pid: 14548 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.651811:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721470720:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126625.654536:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.654556:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 8 pid: 14547 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.654568:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721470848:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.655118:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721723520 00000100:00100000:1.0:1746126625.655129:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721723520 00000100:00100000:1.0:1746126625.655182:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9075 00000100:00100000:1.0:1746126625.655191:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31603:x1830945721723520:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126625.655207:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.655221:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54600/0xb50e825867615001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eacb expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.655325:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655337:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655346:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655354:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655360:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655365:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746126625.655442:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746126625.655462:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54200/0xb50e825867615016 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655469:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54200/0xb50e825867615016 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655475:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54200/0xb50e825867615016 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126625.655484:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126625.655610:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655617:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655623:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655628:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b55a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126625.655631:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655637:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655646:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126625.655648:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126625.655651:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655655:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55a00/0xb50e825867615008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655686:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655690:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655694:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655698:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b55c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126625.655700:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655707:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655714:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136a9fd00) 00010000:00010000:1.0:1746126625.655715:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126625.655717:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655722:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b55c00/0xb50e82586761500f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.655752:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54600/0xb50e825867615001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eacb expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.655762:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54200/0xb50e825867615016 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eacb expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.655767:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.655768:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126625.655771:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.655776:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.655781:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b54200, rc 0) 00000100:00100000:1.0:1746126625.655845:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31603:x1830945721723520:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 634us (4230us total) trans 8589943275 rc 0/0 00000100:00100000:1.0:1746126625.655852:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9075 00000100:00100000:2.0:1746126625.658552:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721470464:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126625.658564:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9817:1830945721470592:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126625.658588:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.658639:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721723136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 23951us (24168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.658650:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7393 00000100:00100000:0.0:1746126625.660046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.661669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.661719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.661757:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721724800 00000100:00100000:1.0:1746126625.661767:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721724800 00000100:00100000:1.0:1746126625.661818:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9076 00000100:00100000:1.0:1746126625.661921:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+224:31604:x1830945721724800:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126625.661946:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.661964:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e825867615024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ead2 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.662080:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662093:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662103:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662111:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662117:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662121:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662214:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54c00/0xb50e825867615039 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662221:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54c00/0xb50e825867615039 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662226:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54c00/0xb50e825867615039 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126625.662238:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126625.662312:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662317:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662322:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662326:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098eb8000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126625.662330:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662335:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662342:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126625.662345:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126625.662347:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662351:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8000/0xb50e82586761502b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662359:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662362:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662366:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662373:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098eb8200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126625.662376:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662380:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662384:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136a9fd00) 00010000:00010000:1.0:1746126625.662385:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126625.662387:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662390:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e825867615032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126625.662415:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e825867615024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead2 expref: 227 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.662423:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54c00/0xb50e825867615039 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead2 expref: 226 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.662428:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.662429:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126625.662432:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.662438:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00000100:00100000:2.0:1746126625.662682:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721723776 00000100:00100000:2.0:1746126625.662687:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721723776 00002000:00100000:2.0:1746126625.662716:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800920bca80 x1830945721723776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.662726:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bca80 with x1830945721723776 ext(3145728->4194303) 00002000:00010000:2.0:1746126625.662730:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bca80 00000100:00100000:2.0:1746126625.663244:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721724032 00000100:00100000:2.0:1746126625.663248:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721724032 00002000:00100000:2.0:1746126625.663264:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800920bf480 x1830945721724032/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.663271:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bf480 with x1830945721724032 ext(3145728->4194303) 00002000:00010000:2.0:1746126625.663274:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bf480 00000100:00100000:2.0:1746126625.663290:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8084 00000100:00100000:2.0:1746126625.663294:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721723776:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.663490:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8085 00000100:00100000:0.0:1746126625.663498:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721724032:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.663597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.663625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.663698:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721470720:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126625.663707:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721470848:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126625.663818:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b54c00, rc 0) 00000100:00100000:1.0:1746126625.663910:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+226:31604:x1830945721724800:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 2081us (2243us total) trans 8589943276 rc 0/0 00000100:00100000:1.0:1746126625.663919:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9076 00000100:00100000:1.0:1746126625.663958:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721724288 00000100:00100000:1.0:1746126625.663964:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721724288 00010000:00010000:3.0:1746126625.663974:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126625.663988:0:16623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721724544 00000100:00100000:1.0:1746126625.663991:0:16623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721724544 00000100:00100000:1.0:1746126625.664018:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3864 00000100:00100000:1.0:1746126625.664024:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+226:7696:x1830945721724288:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126625.664222:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27c713d7-92e0-4974-b612-500c641c1d6c+227:7696:x1830945721724288:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 198us (625us total) trans 8589943277 rc 0/0 00000100:00100000:1.0:1746126625.664228:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3864 00000100:00100000:1.0:1746126625.664238:0:16623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3865 00000100:00100000:1.0:1746126625.664243:0:16623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+11:26822:x1830945721724544:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126625.664299:0:16623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+12:26822:x1830945721724544:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 55us (673us total) trans 8589943278 rc 0/0 00000100:00100000:1.0:1746126625.664304:0:16623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3865 00000100:00100000:2.0:1746126625.673518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.673595:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721724928 00000100:00100000:0.0:1746126625.673605:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721724928 00010000:00010000:0.0:1746126625.673642:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 227 pid: 14548 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746126625.673675:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7394 00000100:00100000:0.0:1746126625.673682:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:1964:x1830945721724928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126625.673697:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126625.673702:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 227 pid: 14548 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746126625.673712:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 227 pid: 14548 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746126625.673734:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8a1800/0xb50e825867614f75 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea69 expref: 227 pid: 14548 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746126625.673768:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126625.673774:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126625.673783:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126625.673787:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:0.0:1746126625.673792:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126625.673862:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801367e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+226:1964:x1830945721724928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 180us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.673869:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7394 00000100:00100000:0.0:1746126625.677744:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.679084:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725056 00000100:00100000:2.0:1746126625.679095:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725056 00010000:00010000:2.0:1746126625.679136:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.679170:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7395 00000100:00100000:2.0:1746126625.679177:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1964:x1830945721725056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.679189:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.679195:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.679206:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.679227:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dfd7000/0xb50e825867614f67 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea62 expref: 12 pid: 14547 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.681695:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.681702:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.681713:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.681720:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.683970:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126625.685235:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721724032:12345-192.168.203.2@tcp:3:cat.0 Request processed in 21726us (23504us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126625.685247:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8085 00002000:00100000:0.0:1746126625.685262:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800920bf480 x1830945721724032/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.685271:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bf480 with x1830945721724032 ext(3145728->4194303) 00002000:00010000:0.0:1746126625.685277:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bf480 00000100:00100000:2.0:1746126625.685776:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721725056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6596us (8040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.685785:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7395 00010000:00010000:2.0:1746126625.685859:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685870:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126625.685912:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126625.685916:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126625.685936:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685948:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685958:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685963:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685969:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685974:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a02600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.685978:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685984:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.685997:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126625.686000:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126625.686012:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.686017:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a02600/0xb50e825867614fec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.686028:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.686033:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.686038:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.686041:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092ba1c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.686044:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.686048:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.687356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126625.687505:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136a9fd00) 00010000:00010000:2.0:1746126625.687509:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126625.687513:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.687520:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092ba1c00/0xb50e825867614ff3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.687567:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b1400/0xb50e825867614fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.687581:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 7 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.687587:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.687590:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126625.687592:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb29600, rc 0) 00000100:00100000:1.0:1746126625.688433:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725184 00000100:00100000:1.0:1746126625.688442:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725184 00000100:00100000:2.0:1746126625.688453:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31601:x1830945721723264:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 37915us (39130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.688461:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9074 00000100:00100000:1.0:1746126625.688488:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14141 00000100:00100000:1.0:1746126625.688495:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+28:31604:x1830945721725184:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126625.688510:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.688525:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ead9 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.688549:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126625.688563:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126625.688568:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.688570:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.688574:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.688603:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126625.688614:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.688625:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b192680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721470976:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.688905:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721723776:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25609us (28864us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126625.688913:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8084 00002000:00100000:2.0:1746126625.688922:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800920bca80 x1830945721723776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.688931:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bca80 with x1830945721723776 ext(3145728->4194303) 00002000:00010000:2.0:1746126625.688935:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bca80 00010000:00010000:1.0:1746126625.690930:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 19 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126625.690946:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 19 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.690961:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721471104:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.691028:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126625.698693:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b192680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721470976:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.698709:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721471104:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126625.698741:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 29 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.698759:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b210600, rc 0) 00000100:00100000:1.0:1746126625.698856:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+29:31604:x1830945721725184:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 10329us (11472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.698866:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14141 00000100:00100000:0.0:1746126625.699137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.699153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.699176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.699193:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725312 00000100:00100000:0.0:1746126625.699198:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725312 00000100:00100000:3.0:1746126625.699216:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725568 00000100:00100000:3.0:1746126625.699222:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725568 00000100:00100000:0.0:1746126625.699229:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725824 00000100:00100000:0.0:1746126625.699232:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725824 00000100:00100000:0.0:1746126625.699247:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14142 00000100:00100000:0.0:1746126625.699253:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721725312:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:3.0:1746126625.699266:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14143 00010000:00010000:0.0:1746126625.699267:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126625.699273:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721725824:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126625.699281:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eae0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.699285:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.699296:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e825867615055 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eafc expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.699298:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699300:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699306:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.699317:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699318:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.699326:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e825867615055 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eafc expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699326:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135527800, rc 0) 00010000:00010000:3.0:1746126625.699336:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e825867615055 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eafc expref: 8 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.699351:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a000, rc 0) 00000100:00100000:0.0:1746126625.699360:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721725312:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.699367:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14142 00000100:00100000:3.0:1746126625.699373:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721725824:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 100us (196us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126625.699379:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14143 00000100:00100000:0.0:1746126625.699492:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14144 00000100:00100000:0.0:1746126625.699499:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721725568:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126625.699507:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.699515:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eaee expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.699527:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699528:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699532:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699545:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699552:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135526400, rc 0) 00000100:00100000:0.0:1746126625.699570:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721725568:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 72us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.699575:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14144 00000100:00100000:0.0:1746126625.699603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.699615:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725440 00000100:00100000:0.0:1746126625.699617:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725440 00000100:00100000:0.0:1746126625.699631:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14145 00000100:00100000:0.0:1746126625.699635:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721725440:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126625.699641:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.699647:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eae7 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.699656:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699658:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699662:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699682:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699688:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fde00, rc 0) 00000100:00100000:0.0:1746126625.699708:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721725440:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 72us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.699714:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14145 00000100:00100000:0.0:1746126625.699749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.699766:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725696 00000100:00100000:1.0:1746126625.699770:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725696 00000100:00100000:0.0:1746126625.699775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.699788:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721725952 00000100:00100000:1.0:1746126625.699791:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721725952 00000100:00100000:1.0:1746126625.699813:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14146 00000100:00100000:1.0:1746126625.699818:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721725696:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126625.699825:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126625.699852:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eaf5 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126625.699857:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14147 00010000:00010000:1.0:1746126625.699862:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746126625.699863:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721725952:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126625.699864:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.699870:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 7 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699870:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.699876:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb03 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.699882:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 7 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699885:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126625.699887:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.699889:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b210e00, rc 0) 00010000:00010000:0.0:1746126625.699891:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 9 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699900:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 9 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.699907:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fda00, rc 0) 00000100:00100000:1.0:1746126625.699914:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721725696:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 95us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.699921:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14146 00000100:00100000:0.0:1746126625.699922:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721725952:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126625.699928:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14147 00000100:00100000:0.0:1746126625.703297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.703348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.703427:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721726336 00000100:00100000:3.0:1746126625.703436:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721726336 00002000:00100000:3.0:1746126625.703477:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204ea00 x1830945721726336/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.703486:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ea00 with x1830945721726336 ext(4194304->4976639) 00010000:00010000:3.0:1746126625.703494:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746126625.703504:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00002000:00010000:3.0:1746126625.703510:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204ea00 00000100:00100000:3.0:1746126625.703525:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1861 00000100:00100000:3.0:1746126625.703531:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721726336:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126625.704523:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721726080 00000100:00100000:2.0:1746126625.704529:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721726080 00010000:00010000:2.0:1746126625.704549:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 20 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.704566:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7396 00000100:00100000:2.0:1746126625.704571:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721726080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.704579:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.704591:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 20 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.704600:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 20 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.704624:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c893a00/0xb50e825867614f28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea2a expref: 20 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126625.704641:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.704663:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1963:x1830945721726080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 92us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.704669:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7396 00000100:00100000:0.0:1746126625.709677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.709719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.709729:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721726720 00000100:00100000:2.0:1746126625.709738:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721726720 00000100:00100000:2.0:1746126625.709780:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9077 00000100:00100000:2.0:1746126625.709787:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:31601:x1830945721726720:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126625.709811:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.709846:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e825867615078 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb11 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.709939:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721726464 00000100:00100000:3.0:1746126625.709942:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721726464 00000100:00100000:3.0:1746126625.709967:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14148 00000100:00100000:3.0:1746126625.709971:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721726464:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.709978:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.709988:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e82586761507f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb0a expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.710018:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.710029:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e82586761507f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb0a expref: 20 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.710037:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e82586761507f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb0a expref: 20 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.710051:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a800, rc 0) 00000100:00100000:3.0:1746126625.710092:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+19:1964:x1830945721726464:12345-192.168.203.2@tcp:101:cat.0 Request processed in 120us (372us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126625.710097:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14148 00000100:00100000:3.0:1746126625.710352:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721726336:12345-192.168.203.2@tcp:3:cat.0 Request processed in 6820us (7002us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746126625.710360:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1861 00002000:00100000:3.0:1746126625.710369:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204ea00 x1830945721726336/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.710378:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ea00 with x1830945721726336 ext(4194304->4976639) 00010000:00010000:3.0:1746126625.710384:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746126625.710395:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00002000:00010000:3.0:1746126625.710401:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204ea00 00010000:00010000:2.0:1746126625.710545:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.710558:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.710564:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.710911:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.710921:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 8 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.710933:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721471232:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.710991:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.717270:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721471232:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.717300:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126625.717567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.717627:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721727104 00000100:00100000:3.0:1746126625.717635:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721727104 00000100:00100000:0.0:1746126625.717655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.717717:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721726976 00000100:00100000:1.0:1746126625.717722:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721726976 00010000:00010000:1.0:1746126625.717745:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746126625.717890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.718069:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721726848 00000100:00100000:3.0:1746126625.718072:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721726848 00000100:00100000:3.0:1746126625.718092:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14149 00000100:00100000:3.0:1746126625.718099:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+19:31596:x1830945721727104:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:0.0:1746126625.718101:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14150 00000100:00100000:0.0:1746126625.718108:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721726848:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.718114:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.718116:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.718128:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb1f expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.718128:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918fd600/0xb50e825867615094 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb18 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.718147:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126625.718208:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7397 00000100:00100000:1.0:1746126625.718215:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1965:x1830945721726976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.718225:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.718231:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.718240:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.718258:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb29600/0xb50e825867614ffa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eac4 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.719335:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.719340:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.719349:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.719382:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918fd600/0xb50e825867615094 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb18 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.719393:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918fd600/0xb50e825867615094 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb18 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.719412:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fd600, rc 0) 00010000:00010000:3.0:1746126625.719432:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.719443:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b600, rc 0) 00000100:00100000:0.0:1746126625.719454:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721726848:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1347us (1564us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126625.719461:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14150 00000100:00100000:3.0:1746126625.719464:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31596:x1830945721727104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1366us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.719470:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14149 00010000:00010000:1.0:1746126625.719540:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126625.719546:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.719555:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.719561:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:1.0:1746126625.719595:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.719614:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1965:x1830945721726976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1400us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.719621:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7397 00010000:00010000:2.0:1746126625.719779:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.719785:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126625.719805:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126625.720320:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e825867615078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.720869:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.720880:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.720882:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126625.720884:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75a200, rc 0) 00000100:00100000:2.0:1746126625.720912:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31601:x1830945721726720:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 11125us (11246us total) trans 8589943279 rc 0/0 00000100:00100000:2.0:1746126625.720918:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9077 00000100:00100000:0.0:1746126625.724128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.724219:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721727232 00000100:00100000:1.0:1746126625.724227:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721727232 00010000:00010000:1.0:1746126625.724259:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126625.724294:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7398 00000100:00100000:1.0:1746126625.724301:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721727232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.724313:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.724333:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.724344:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.724363:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fccc00/0xb50e825867614f52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea54 expref: 29 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126625.724377:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.724379:0:9817:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.724385:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.724393:0:9817:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.724431:0:9817:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126625.724702:0:9817:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b193100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721471360:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126625.724793:0:9817:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126625.731259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.731296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.731634:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721727360 00000100:00100000:2.0:1746126625.731644:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721727360 00000100:00100000:3.0:1746126625.732385:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721727488 00000100:00100000:3.0:1746126625.732390:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721727488 00000100:00100000:3.0:1746126625.732424:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14151 00000100:00100000:3.0:1746126625.732430:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:31597:x1830945721727488:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.732449:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.732464:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb2d expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.732489:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.732490:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.732497:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.732511:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.732519:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b400, rc 0) 00000100:00100000:3.0:1746126625.732559:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:31597:x1830945721727488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 129us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.732565:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14151 00000100:00100000:0.0:1746126625.732907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.732937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.732953:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721727744 00000100:00100000:0.0:1746126625.732956:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721727744 00002000:00100000:0.0:1746126625.732986:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a5b68700 x1830945721727744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.732999:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68700 with x1830945721727744 ext(4194304->4976639) 00002000:00010000:0.0:1746126625.733014:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b68700 00000100:00100000:0.0:1746126625.733026:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721728000 00000100:00100000:0.0:1746126625.733028:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721728000 00002000:00100000:0.0:1746126625.733038:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2764800->2768895) req@ffff8800a5b68a80 x1830945721728000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126625.733044:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68a80 with x1830945721728000 ext(2764800->2768895) 00002000:00010000:0.0:1746126625.733047:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b68a80 00000100:00100000:0.0:1746126625.733056:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8086 00000100:00100000:0.0:1746126625.733061:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721727744:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126625.734021:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9078 00000100:00100000:2.0:1746126625.734031:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31601:x1830945721727360:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126625.734047:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.734059:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676150a9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb26 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.734130:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.734143:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.734148:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.734176:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.734186:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 9 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.734197:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721471488:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.734263:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126625.734512:0:9817:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b193100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9817:1830945721471360:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126625.734528:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.734550:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721727232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10250us (10430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.734558:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7398 00000100:00100000:3.0:1746126625.734785:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8087 00000100:00100000:3.0:1746126625.734793:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721728000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.734916:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721728000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 124us (1978us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126625.734921:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8087 00002000:00100000:3.0:1746126625.734927:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2764800->2768895) req@ffff8800a5b68a80 x1830945721728000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.734939:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68a80 with x1830945721728000 ext(2764800->2768895) 00002000:00010000:3.0:1746126625.734943:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b68a80 00000100:00100000:0.0:1746126625.738044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.738078:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721728128 00000100:00100000:0.0:1746126625.738086:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721728128 00000100:00100000:0.0:1746126625.738131:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14152 00000100:00100000:0.0:1746126625.738139:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721728128:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126625.738156:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.738173:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918fcc00/0xb50e8258676150b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb34 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.738207:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918fcc00/0xb50e8258676150b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb34 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.738217:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918fcc00/0xb50e8258676150b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb34 expref: 30 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.738243:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fcc00, rc 0) 00000100:00100000:0.0:1746126625.740676:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+29:1963:x1830945721728128:12345-192.168.203.2@tcp:101:cat.0 Request processed in 564us (667us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126625.740688:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14152 00000100:00100000:2.0:1746126625.745142:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721471488:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.745181:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126625.745734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.745797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.746160:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721728512 00000100:00100000:3.0:1746126625.746169:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721728512 00002000:00100000:3.0:1746126625.746219:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3014656->3018751) req@ffff88012b192680 x1830945721728512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.746228:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192680 with x1830945721728512 ext(3014656->3018751) 00002000:00010000:3.0:1746126625.746232:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b192680 00000100:00100000:3.0:1746126625.746256:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8088 00000100:00100000:3.0:1746126625.746266:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721728512:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126625.746469:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+29:1966:x1830945721728512:12345-192.168.203.2@tcp:3:cat.0 Request processed in 203us (670us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126625.746477:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8088 00002000:00100000:3.0:1746126625.746484:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (3014656->3018751) req@ffff88012b192680 x1830945721728512/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.746491:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192680 with x1830945721728512 ext(3014656->3018751) 00002000:00010000:3.0:1746126625.746494:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b192680 00000100:00100000:2.0:1746126625.746598:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721728256 00000100:00100000:2.0:1746126625.746603:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721728256 00010000:00010000:2.0:1746126625.746630:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 10 pid: 20362 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.746657:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7399 00000100:00100000:2.0:1746126625.746665:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721728256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126625.746677:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126625.746684:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 10 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.746695:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 10 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.746720:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a200/0xb50e825867615086 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb11 expref: 10 pid: 20362 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126625.746739:0:9817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.746745:0:9817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.746755:0:9817:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.746762:0:9817:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.746785:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126625.746816:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721728256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 150us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.746822:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7399 00010000:00010000:2.0:1746126625.746878:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.746886:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126625.746930:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:2.0:1746126625.746935:0:20362:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746126625.746953:0:20362:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.746987:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008df21c00/0xb50e8258676150a9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.747012:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.747020:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.747022:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126625.747025:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75a400, rc 0) 00000100:00100000:2.0:1746126625.747053:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31601:x1830945721727360:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13023us (15805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.747059:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9078 00000100:00100000:0.0:1746126625.748437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.750242:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721728768 00000100:00100000:1.0:1746126625.750253:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721728768 00002000:00100000:1.0:1746126625.750297:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff88008f254e00 x1830945721728768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126625.750306:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254e00 with x1830945721728768 ext(4972544->4976639) 00002000:00010000:1.0:1746126625.750311:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254e00 00000100:00100000:2.0:1746126625.751317:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721727744:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18249us (18404us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126625.751325:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8086 00002000:00100000:2.0:1746126625.751334:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff8800a5b68700 x1830945721727744/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/440 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.751341:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b68700 with x1830945721727744 ext(4194304->4976639) 00002000:00010000:2.0:1746126625.751346:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b68700 00000100:00100000:2.0:1746126625.751375:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8089 00000100:00100000:2.0:1746126625.751385:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721728768:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126625.751677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.751859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.751885:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721729152 00000100:00100000:0.0:1746126625.751890:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721729152 00000100:00100000:2.0:1746126625.753090:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721728768:12345-192.168.203.2@tcp:3:cat.0 Request processed in 1702us (4653us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126625.753099:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8089 00002000:00100000:2.0:1746126625.753108:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4972544->4976639) req@ffff88008f254e00 x1830945721728768/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.753115:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f254e00 with x1830945721728768 ext(4972544->4976639) 00002000:00010000:2.0:1746126625.753119:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f254e00 00000100:00100000:2.0:1746126625.753152:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721729024 00000100:00100000:2.0:1746126625.753159:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721729024 00000100:00100000:2.0:1746126625.753195:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3866 00000100:00100000:2.0:1746126625.753203:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+226:31604:x1830945721729024:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126625.753419:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+227:31604:x1830945721729024:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 214us (1742us total) trans 8589943280 rc 0/0 00000100:00100000:2.0:1746126625.753425:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3866 00000100:00100000:0.0:1746126625.753668:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14153 00000100:00100000:0.0:1746126625.753678:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721729152:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126625.753691:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126625.753711:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0a00/0xb50e8258676150be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb3b expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126625.753742:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0a00/0xb50e8258676150be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb3b expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.753752:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8a0a00/0xb50e8258676150be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb3b expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126625.753766:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a0a00, rc 0) 00000100:00100000:0.0:1746126625.753796:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721729152:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 119us (1938us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126625.753801:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14153 00000100:00100000:0.0:1746126625.758688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126625.758739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.759091:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721729536 00000100:00100000:2.0:1746126625.759102:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721729536 00000100:00100000:2.0:1746126625.759163:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9079 00000100:00100000:2.0:1746126625.759171:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31601:x1830945721729536:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126625.759192:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.759210:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19600/0xb50e8258676150c5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb49 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.759300:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759313:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759322:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759331:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759335:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759339:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759342:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb18e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.759345:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759349:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759356:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.759358:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126625.759360:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759365:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb18e00/0xb50e8258676150cc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.759408:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19600/0xb50e8258676150c5 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb49 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.759419:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb19600/0xb50e8258676150c5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb49 expref: 9 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.759429:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb19600, rc 0) 00000100:00100000:2.0:1746126625.759475:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31601:x1830945721729536:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 304us (734us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126625.759481:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9079 00000100:00100000:3.0:1746126625.759755:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721729280 00000100:00100000:3.0:1746126625.759760:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721729280 00000100:00100000:3.0:1746126625.759858:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14154 00000100:00100000:3.0:1746126625.759864:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721729280:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126625.759873:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126625.759884:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a200/0xb50e8258676150d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb42 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.759905:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a200/0xb50e8258676150d3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb42 expref: 21 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.759912:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a200/0xb50e8258676150d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb42 expref: 21 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126625.762045:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a200, rc 0) 00000100:00100000:3.0:1746126625.762138:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721729280:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2266us (3453us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126625.762147:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14154 00000100:00100000:0.0:1746126625.768671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.768797:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721729792 00000100:00100000:2.0:1746126625.768807:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721729792 00000100:00100000:2.0:1746126625.768906:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3867 00000100:00100000:2.0:1746126625.768916:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31601:x1830945721729792:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1746126625.769222:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31601:x1830945721729792:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 305us (561us total) trans 8589943281 rc 0/0 00000100:00100000:2.0:1746126625.769229:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3867 00000100:00100000:0.0:1746126625.774949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.775750:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721729920 00000100:00100000:2.0:1746126625.775761:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721729920 00000100:00100000:2.0:1746126625.775876:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14155 00000100:00100000:2.0:1746126625.775886:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721729920:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126625.775908:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.775928:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb18e00/0xb50e8258676150da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb50 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.775962:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb18e00/0xb50e8258676150da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb50 expref: 21 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.775978:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb18e00/0xb50e8258676150da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb50 expref: 21 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.776013:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb18e00, rc 0) 00000100:00100000:2.0:1746126625.776198:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1964:x1830945721729920:12345-192.168.203.2@tcp:101:cat.0 Request processed in 313us (1257us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126625.776204:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14155 00000100:00100000:0.0:1746126625.820150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.820520:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730048 00000100:00100000:2.0:1746126625.820529:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730048 00000100:00100000:2.0:1746126625.820769:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14156 00000100:00100000:2.0:1746126625.820777:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31603:x1830945721730048:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126625.820797:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.820813:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb57 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.820883:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.820891:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.820898:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126625.820899:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126625.820910:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2342912->3145727] (req 2342912->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.820939:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.820948:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.820956:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721471616:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.821814:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 28 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.821853:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 28 pid: 9686 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.821863:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721471744:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.821901:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126625.825249:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721471616:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126625.825460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.825537:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721471744:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.825569:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2342912->3145727] (req 2342912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.825585:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb19e00, rc 0) 00000100:00100000:2.0:1746126625.825633:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31603:x1830945721730048:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 4856us (5494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.825646:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14156 00000100:00100000:3.0:1746126625.825737:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730176 00000100:00100000:3.0:1746126625.825744:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730176 00002000:00100000:3.0:1746126625.825792:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2764800->3018751) req@ffff88012b193b80 x1830945721730176/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.825801:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b193b80 with x1830945721730176 ext(2764800->3018751) 00010000:00010000:3.0:1746126625.825807:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 29 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.825816:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 29 pid: 9686 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.825822:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b193b80 00000100:00100000:3.0:1746126625.825858:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1862 00000100:00100000:3.0:1746126625.825864:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+29:1964:x1830945721730176:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126625.825872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.825895:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730304 00000100:00100000:3.0:1746126625.825898:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730304 00010000:00010000:3.0:1746126625.825913:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.825930:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7400 00000100:00100000:3.0:1746126625.825934:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721730304:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.825945:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.826039:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.826048:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.826069:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b600/0xb50e82586761508d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3018752->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb1f expref: 21 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.826133:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.826228:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721730304:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 291us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.826234:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7400 00000100:00100000:3.0:1746126625.829379:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721730176:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3505us (3911us total) trans 21474840468 rc 0/0 00000100:00100000:3.0:1746126625.829390:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1862 00002000:00100000:3.0:1746126625.829400:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2764800->3018751) req@ffff88012b193b80 x1830945721730176/t21474840468(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:386/0 lens 488/448 e 0 to 0 dl 1746126636 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126625.829410:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b193b80 with x1830945721730176 ext(2764800->3018751) 00010000:00010000:3.0:1746126625.829419:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 31 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.829431:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 31 pid: 9686 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746126625.829438:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b193b80 00000100:00100000:0.0:1746126625.831878:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.832107:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730432 00000100:00100000:3.0:1746126625.832117:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730432 00010000:00010000:3.0:1746126625.832148:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 31 pid: 9686 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.832185:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7401 00000100:00100000:3.0:1746126625.832191:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721730432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.832205:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746126625.832225:0:11130:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126624 -> 1746126625 00002000:00010000:3.0:1746126625.832227:0:11130:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126624 -> 1746126625 00002000:00010000:3.0:1746126625.832229:0:11130:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126624 -> 1746126625 00010000:00010000:3.0:1746126625.832235:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 31 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.832246:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 31 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.832268:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b210600/0xb50e825867615047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2764800->3018751] (req 2764800->3018751) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead9 expref: 31 pid: 9686 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.832299:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.832301:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126625.832308:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.832316:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126625.832348:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126625.832359:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721471872:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126625.832444:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126625.834014:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721471872:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126625.834033:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126625.834045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.834065:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+30:1965:x1830945721730432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1874us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.834074:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7401 00000100:00100000:2.0:1746126625.834136:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730688 00000100:00100000:2.0:1746126625.834142:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730688 00002000:00100000:2.0:1746126625.834175:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2342912->2347007) req@ffff88009e807100 x1830945721730688/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.834184:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e807100 with x1830945721730688 ext(2342912->2347007) 00002000:00010000:2.0:1746126625.834189:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e807100 00000100:00100000:2.0:1746126625.834214:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8090 00000100:00100000:2.0:1746126625.834221:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721730688:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126625.834386:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721730688:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 165us (340us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126625.834391:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8090 00002000:00100000:2.0:1746126625.834397:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2342912->2347007) req@ffff88009e807100 x1830945721730688/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.834404:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e807100 with x1830945721730688 ext(2342912->2347007) 00002000:00010000:2.0:1746126625.834406:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e807100 00000100:00100000:0.0:1746126625.842796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.842940:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730816 00000100:00100000:2.0:1746126625.842949:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730816 00000100:00100000:2.0:1746126625.843032:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14157 00000100:00100000:2.0:1746126625.843040:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31603:x1830945721730816:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126625.843468:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.843489:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb5e expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843523:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843531:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.843538:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843546:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843552:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843558:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126625.843560:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126625.843563:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 8/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 26 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843592:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.843605:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 32 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.843622:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472000:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.845329:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.845343:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.845356:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472128:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.845405:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.845413:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.845421:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472256:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.845442:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 8 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126625.845450:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 8 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.845458:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472384:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.845480:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.845488:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.845496:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472512:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126625.845509:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126625.857676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.859629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126625.859782:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721731072 00000100:00100000:3.0:1746126625.859791:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721731072 00010000:00010000:3.0:1746126625.859839:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 27 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746126625.859872:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7402 00000100:00100000:3.0:1746126625.859879:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721731072:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.859895:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.859915:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 27 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.859924:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 27 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746126625.859948:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.859999:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1963:x1830945721731072:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.860012:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7402 00000100:00100000:3.0:1746126625.860639:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721731328 00000100:00100000:3.0:1746126625.860643:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721731328 00010000:00010000:3.0:1746126625.860656:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126625.860671:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7403 00000100:00100000:3.0:1746126625.860674:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721731328:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126625.860681:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126625.860689:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746126625.860696:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 9 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746126625.860709:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.860725:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721731328:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 50us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.860730:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7403 00000100:00100000:2.0:1746126625.861078:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472000:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.861091:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570ea00/0xb50e825867614fc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaa8 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.861263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.861280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.861306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126625.861320:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721730944 00000100:00100000:1.0:1746126625.861324:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721730944 00010000:00010000:1.0:1746126625.861338:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 33 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.861350:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721731200 00000100:00100000:1.0:1746126625.861352:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721731200 00010000:00010000:1.0:1746126625.861357:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 34 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.861366:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721731456 00000100:00100000:1.0:1746126625.861367:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721731456 00010000:00010000:1.0:1746126625.861373:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746126625.861391:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7404 00000100:00100000:1.0:1746126625.861396:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721730944:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.861403:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.861414:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 34 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861421:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 34 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861434:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570f600/0xb50e825867614fd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaaf expref: 34 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861446:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.861465:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721730944:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.861471:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7404 00000100:00100000:1.0:1746126625.861513:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7405 00000100:00100000:1.0:1746126625.861518:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721731200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.861524:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.861530:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861539:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 32 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861548:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126625.861562:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721731200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126625.861566:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7405 00000100:00100000:1.0:1746126625.861576:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7406 00000100:00100000:1.0:1746126625.861580:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721731456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126625.861585:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126625.861591:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861599:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126625.861609:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.861611:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126625.861618:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 26 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.861626:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 26 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126625.861653:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 26 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126625.861664:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b193100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721472640:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126625.861702:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2000 going to sleep for 11 seconds 00010000:00010000:0.0:1746126625.862322:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746126625.862383:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801367e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472128:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.862421:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348b0600/0xb50e825867614fde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eabd expref: 31 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.862430:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472256:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.862441:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918fda00/0xb50e825867615071 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb03 expref: 8 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126625.862450:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472384:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.862459:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867614fd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eab6 expref: 26 pid: 10890 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126625.862466:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721472512:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126625.862499:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.862507:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f75a000, rc 0) 00000100:00100000:2.0:1746126625.862534:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31603:x1830945721730816:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 19495us (19747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126625.862541:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14157 00000100:00100000:3.0:1746126625.862818:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b193100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721472640:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126625.862848:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126625.862868:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721731456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1288us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126625.862874:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7406 00000100:00100000:0.0:1746126625.870410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.871613:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721731712 00000100:00100000:2.0:1746126625.871624:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721731712 00002000:00100000:2.0:1746126625.871676:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2183168->2187263) req@ffff880091da0000 x1830945721731712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/0 e 0 to 0 dl 1746126636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.871685:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da0000 with x1830945721731712 ext(2183168->2187263) 00002000:00010000:2.0:1746126625.871691:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da0000 00000100:00100000:2.0:1746126625.871713:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8091 00000100:00100000:2.0:1746126625.871720:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721731712:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126625.871929:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1963:x1830945721731712:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 208us (1527us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126625.871936:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8091 00002000:00100000:2.0:1746126625.871942:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2183168->2187263) req@ffff880091da0000 x1830945721731712/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:386/0 lens 488/4536 e 0 to 0 dl 1746126636 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126625.871949:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091da0000 with x1830945721731712 ext(2183168->2187263) 00002000:00010000:2.0:1746126625.871952:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091da0000 00000100:00100000:0.0:1746126625.876180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.876670:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721731968 00000100:00100000:2.0:1746126625.876679:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721731968 00000100:00100000:2.0:1746126625.876863:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3868 00000100:00100000:2.0:1746126625.876871:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f02c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31603:x1830945721731968:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:2.0:1746126625.877381:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f02c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31603:x1830945721731968:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 509us (1210us total) trans 8589943282 rc 0/0 00000100:00100000:2.0:1746126625.877388:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3868 00000100:00100000:0.0:1746126625.996672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126625.996810:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721732224 00000100:00100000:2.0:1746126625.996820:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721732224 00000100:00100000:2.0:1746126625.996916:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9080 00000100:00100000:2.0:1746126625.996924:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+227:31611:x1830945721732224:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126625.996950:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126625.996968:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6e00/0xb50e8258676150ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb65 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.997088:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997100:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997110:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997122:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997127:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997132:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997236:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997244:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997250:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126625.997259:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126625.997343:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997349:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997354:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997360:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ada7400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.997364:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997370:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997380:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:2.0:1746126625.997382:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126625.997386:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997390:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada7400/0xb50e8258676150f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997417:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997422:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997425:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997429:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ada6200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126625.997431:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997435:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997441:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0f8c00) 00010000:00010000:2.0:1746126625.997443:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126625.997445:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997449:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6200/0xb50e8258676150fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126625.997484:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6e00/0xb50e8258676150ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 230 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.997496:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 229 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126625.997502:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126625.997504:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746126625.997506:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ada6400, rc 0) 00000100:00100000:2.0:1746126625.997554:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+229:31611:x1830945721732224:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 630us (891us total) trans 8589943283 rc 0/0 00000100:00100000:2.0:1746126625.997560:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9080 00000100:00100000:0.0:1746126626.004812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.004871:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721732480 00000100:00100000:1.0:1746126626.004882:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721732480 00000100:00100000:1.0:1746126626.004960:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9081 00000100:00100000:1.0:1746126626.004969:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+12:31616:x1830945721732480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.004993:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.005020:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210800/0xb50e825867615112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb6c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.005134:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005145:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005156:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005169:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005179:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005184:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005289:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005299:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005305:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126626.005313:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126626.005391:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005398:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005403:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005408:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b210400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126626.005411:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005417:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005425:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126626.005428:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126626.005432:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005436:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210400/0xb50e825867615119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005461:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005465:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005472:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005477:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b211a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126626.005479:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005483:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005489:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4300) 00010000:00010000:1.0:1746126626.005490:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126626.005492:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005496:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211a00/0xb50e825867615120 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.005529:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b210800/0xb50e825867615112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746126626.005608:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746126626.005679:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.005685:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126626.005687:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126626.005689:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b211400, rc 0) 00000100:00100000:1.0:1746126626.006445:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31616:x1830945721732480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1475us (1640us total) trans 8589943284 rc 0/0 00000100:00100000:1.0:1746126626.006452:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9081 00000100:00100000:0.0:1746126626.008469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.008501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.008521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.008578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.008729:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721732608 00000100:00100000:3.0:1746126626.008738:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721732608 00000100:00100000:3.0:1746126626.008783:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721732736 00000100:00100000:3.0:1746126626.008785:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721732736 00000100:00100000:3.0:1746126626.008810:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721732864 00000100:00100000:3.0:1746126626.008812:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721732864 00000100:00100000:3.0:1746126626.008849:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14158 00000100:00100000:3.0:1746126626.008856:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721732608:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.008874:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746126626.008924:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14159 00000100:00100000:2.0:1746126626.008931:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721732736:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.008938:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.008950:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ada6c00/0xb50e82586761513c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb7a expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.009020:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721472768:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126626.009094:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.009112:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721733120 00000100:00100000:2.0:1746126626.009115:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721733120 00000100:00100000:2.0:1746126626.009137:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3869 00000100:00100000:2.0:1746126626.009142:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+14:31616:x1830945721733120:12345-192.168.203.2@tcp:35:cat.0 00010000:00010000:3.0:1746126626.009304:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867615135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb73 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.009325:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867615135 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb73 expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.009335:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e825867615135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb73 expref: 31 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.009347:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a800, rc 0) 00000100:00100000:3.0:1746126626.009372:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721732608:12345-192.168.203.2@tcp:101:cat.0 Request processed in 517us (911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126626.009378:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14158 00000100:00100000:3.0:1746126626.009393:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14160 00000100:00100000:3.0:1746126626.009396:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+33:31611:x1830945721732864:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126626.009402:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.009409:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb81 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.009423:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 23 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.009429:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.009434:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.009439:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.009440:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.009443:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [2015232->2097151] (req 2015232->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 34 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.009462:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.009472:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 34 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126626.009485:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721472896:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.010651:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31616:x1830945721733120:12345-192.168.203.2@tcp:35:cat.0 Request processed in 1504us (2067us total) trans 8589943285 rc 0/0 00000100:00100000:2.0:1746126626.010659:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3869 00010000:00010000:3.0:1746126626.011226:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 7 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.011243:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 7 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126626.011254:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473024:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.011321:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 23 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.011329:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 23 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746126626.011338:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473152:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.011355:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00080000:0.0:1746126626.011426:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126626.011431:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126626.017040:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721472768:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126626.017077:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ada6c00/0xb50e82586761513c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb7a expref: 34 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.017089:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ada6c00/0xb50e82586761513c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb7a expref: 34 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.017120:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ada6c00, rc 0) 00000100:00100000:0.0:1746126626.017168:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721732736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8236us (8664us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126626.017177:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14159 00000100:00100000:3.0:1746126626.017659:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721472896:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.017668:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473024:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.017674:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473152:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.017695:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [2015232->2097151] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.017711:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b200, rc 0) 00000100:00100000:3.0:1746126626.018658:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:31611:x1830945721732864:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9254us (10129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.018667:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14160 00000100:00100000:0.0:1746126626.018784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.018910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.018974:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721733248 00000100:00100000:2.0:1746126626.018982:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721733248 00010000:00010000:2.0:1746126626.019020:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 8 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126626.019042:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721733376 00000100:00100000:2.0:1746126626.019045:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721733376 00010000:00010000:2.0:1746126626.019062:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 24 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126626.019075:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7407 00000100:00100000:2.0:1746126626.019080:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1966:x1830945721733248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.019092:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.019111:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 8 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.019120:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 8 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.019141:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918fde00/0xb50e825867615063 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae7 expref: 8 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.019154:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.019183:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1966:x1830945721733248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 102us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.019188:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7407 00000100:00100000:2.0:1746126626.019199:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7408 00000100:00100000:2.0:1746126626.019204:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721733376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.019211:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.019218:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 24 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.019230:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 24 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.019241:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c889000/0xb50e825867614f1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea15 expref: 24 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.019249:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.019261:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721733376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 57us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.019265:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7408 00000100:00080000:0.0:1746126626.019522:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126626.022009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.022064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.022371:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721733504 00000100:00100000:3.0:1746126626.022380:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721733504 00000100:00100000:3.0:1746126626.022415:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721733632 00000100:00100000:3.0:1746126626.022416:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721733632 00000100:00080000:0.0:1746126626.022513:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746126626.022640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.022660:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721733760 00000100:00100000:2.0:1746126626.022662:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721733760 00010000:00010000:2.0:1746126626.022681:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126626.022702:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7409 00000100:00100000:2.0:1746126626.022709:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721733760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.022722:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.022742:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.022754:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.022780:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e84e00/0xb50e825867614f3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea3f expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.022796:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.022798:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.022804:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.022843:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.022875:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.022885:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721473280:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.022940:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.023759:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14161 00000100:00100000:3.0:1746126626.023768:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721733504:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.023781:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.023793:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39a200/0xb50e82586761514a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb88 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126626.023844:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473408:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126626.023954:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14162 00000100:00100000:1.0:1746126626.023985:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721733632:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.024011:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.024026:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b211200/0xb50e825867615151 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb8f expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.024055:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b211200/0xb50e825867615151 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb8f expref: 21 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.024066:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b211200/0xb50e825867615151 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb8f expref: 21 pid: 10890 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126626.024083:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00010000:00010000:1.0:1746126626.024096:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b211200, rc 0) 00000100:00100000:1.0:1746126626.024140:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721733632:12345-192.168.203.2@tcp:101:cat.0 Request processed in 169us (2075us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.024145:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14162 00000100:00100000:2.0:1746126626.026656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.027430:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721473280:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126626.027450:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126626.027499:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721733760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4790us (4858us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.027508:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7409 00000100:00100000:1.0:1746126626.028311:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721734016 00000100:00100000:1.0:1746126626.028320:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721734016 00002000:00100000:1.0:1746126626.028367:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (2015232->2019327) req@ffff88008dabb100 x1830945721734016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.028375:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb100 with x1830945721734016 ext(2015232->2019327) 00002000:00010000:1.0:1746126626.028380:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dabb100 00000100:00100000:1.0:1746126626.028407:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8092 00000100:00100000:1.0:1746126626.028413:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721734016:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126626.028571:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1965:x1830945721734016:12345-192.168.203.2@tcp:3:cat.0 Request processed in 157us (1921us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126626.028577:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8092 00002000:00100000:1.0:1746126626.028582:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (2015232->2019327) req@ffff88008dabb100 x1830945721734016/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.028589:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb100 with x1830945721734016 ext(2015232->2019327) 00002000:00010000:1.0:1746126626.028592:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008dabb100 00000100:00100000:2.0:1746126626.029322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.029337:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721734272 00000100:00100000:2.0:1746126626.029341:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721734272 00002000:00100000:2.0:1746126626.029362:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008dab9c00 x1830945721734272/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.029369:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9c00 with x1830945721734272 ext(0->1048575) 00002000:00010000:2.0:1746126626.029372:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9c00 00000100:00100000:2.0:1746126626.029383:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8093 00000100:00100000:2.0:1746126626.029387:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721734272:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.030851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.031394:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721734528 00000100:00100000:1.0:1746126626.031402:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721734528 00002000:00100000:1.0:1746126626.031438:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009f135500 x1830945721734528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 504/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.031446:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135500 with x1830945721734528 ext(1048576->2097151) 00002000:00010000:1.0:1746126626.031451:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f135500 00000100:00100000:1.0:1746126626.031470:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8094 00000100:00100000:1.0:1746126626.031477:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721734528:12345-192.168.203.2@tcp:3:cat.0 00002000:00010000:0.0:1746126626.034177:0:17475:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126624 -> 1746126625 00002000:00010000:0.0:1746126626.034183:0:17475:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126624 -> 1746126625 00002000:00010000:0.0:1746126626.034185:0:17475:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126624 -> 1746126625 00000100:00100000:0.0:1746126626.034204:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473408:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126626.034238:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39a200/0xb50e82586761514a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb88 expref: 24 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.034250:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39a200/0xb50e82586761514a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb88 expref: 24 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.034268:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a200, rc 0) 00000100:00100000:0.0:1746126626.034308:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721733504:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10541us (12316us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126626.034317:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14161 00000100:00100000:1.0:1746126626.052007:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721734528:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20511us (21142us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746126626.052076:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8094 00002000:00100000:1.0:1746126626.052091:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009f135500 x1830945721734528/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 504/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.052101:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f135500 with x1830945721734528 ext(1048576->2097151) 00002000:00010000:1.0:1746126626.052107:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f135500 00000100:00100000:0.0:1746126626.055769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.056884:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721734784 00000100:00100000:1.0:1746126626.056901:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721734784 00002000:00100000:1.0:1746126626.056952:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880134c3dc00 x1830945721734784/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.056962:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3dc00 with x1830945721734784 ext(0->1048575) 00002000:00010000:1.0:1746126626.056967:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3dc00 00000100:00100000:1.0:1746126626.056991:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8095 00000100:00100000:1.0:1746126626.057006:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721734784:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.058135:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+30:1963:x1830945721734272:12345-192.168.203.2@tcp:3:cat.0 Request processed in 28741us (28809us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126626.058145:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8093 00002000:00100000:2.0:1746126626.058153:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008dab9c00 x1830945721734272/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.058161:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab9c00 with x1830945721734272 ext(0->1048575) 00002000:00010000:2.0:1746126626.058166:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab9c00 00000100:00100000:0.0:1746126626.062378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.062406:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721734912 00000100:00100000:0.0:1746126626.062415:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721734912 00000100:00100000:0.0:1746126626.062455:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14163 00000100:00100000:0.0:1746126626.062462:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:31611:x1830945721734912:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126626.062481:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126626.062499:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb96 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.062527:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.062535:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 6 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.062542:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.062548:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.062550:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.062553:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.062582:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.062597:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126626.062608:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473536:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.062704:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 6 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.062712:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 6 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126626.062719:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473664:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.062741:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 22 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.062748:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 22 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126626.062755:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473792:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.062768:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.069511:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473536:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.069523:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473664:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.069530:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134c3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721473792:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.069559:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.069578:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8a1200, rc 0) 00000100:00100000:2.0:1746126626.069619:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:31611:x1830945721734912:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7157us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.069627:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14163 00000100:00100000:1.0:1746126626.072935:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1963:x1830945721734784:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15926us (17160us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126626.072946:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8095 00002000:00100000:1.0:1746126626.072956:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff880134c3dc00 x1830945721734784/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.072966:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134c3dc00 with x1830945721734784 ext(0->1048575) 00002000:00010000:1.0:1746126626.072972:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134c3dc00 00000100:00100000:0.0:1746126626.074279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.074323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.074365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.074472:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721735168 00000100:00100000:2.0:1746126626.074482:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721735168 00010000:00010000:2.0:1746126626.074519:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126626.074549:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721735296 00000100:00100000:2.0:1746126626.074552:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721735296 00010000:00010000:2.0:1746126626.074562:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 23 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746126626.074573:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721735040 00000100:00100000:2.0:1746126626.074575:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721735040 00010000:00010000:2.0:1746126626.074583:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 7 pid: 23766 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746126626.074584:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7410 00000100:00100000:0.0:1746126626.074593:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721735168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746126626.074605:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7411 00010000:00010000:0.0:1746126626.074606:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126626.074610:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721735296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.074617:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.074628:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 23 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126626.074629:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.074638:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 23 pid: 4640 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746126626.074673:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7412 00000100:00100000:1.0:1746126626.074681:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1965:x1830945721735040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.074687:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126626.074714:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126626.074736:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092fcd000/0xb50e825867614f44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea46 expref: 32 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746126626.074756:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126626.074787:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721735168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 197us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.074792:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7410 00010000:00010000:2.0:1746126626.075045:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef65c00/0xb50e825867614f13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea1c expref: 23 pid: 4640 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746126626.075106:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.075126:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721735296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 515us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.075132:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7411 00010000:00010000:1.0:1746126626.075594:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 7 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126626.075603:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 7 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126626.075615:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135526400/0xb50e82586761505c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaee expref: 7 pid: 23766 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746126626.075629:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.075631:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.075637:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.075644:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.075673:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.075682:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b193800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721473920:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126626.075728:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.082217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.082290:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721735424 00000100:00100000:2.0:1746126626.082299:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721735424 00000100:00100000:2.0:1746126626.082356:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14164 00000100:00100000:2.0:1746126626.082365:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:31618:x1830945721735424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.082384:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.082402:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eb9d expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.082430:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.083788:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126626.083794:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126626.083802:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.083856:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.083870:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746126626.083883:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721474048:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.084298:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.084349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.084658:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721735680 00000100:00100000:2.0:1746126626.084664:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721735680 00002000:00100000:2.0:1746126626.084701:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1130496->1134591) req@ffff88012b192300 x1830945721735680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.084710:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192300 with x1830945721735680 ext(1130496->1134591) 00010000:00010000:2.0:1746126626.084716:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 33 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126626.084731:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 33 pid: 17475 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746126626.084736:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b192300 00000100:00100000:2.0:1746126626.084754:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1863 00000100:00100000:2.0:1746126626.084760:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721735680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.084925:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721735680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 163us (575us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126626.084931:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1863 00002000:00100000:2.0:1746126626.084937:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x323:0x0] (1130496->1134591) req@ffff88012b192300 x1830945721735680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.084943:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b192300 with x1830945721735680 ext(1130496->1134591) 00010000:00010000:2.0:1746126626.084947:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 33 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746126626.084954:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 33 pid: 17475 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746126626.084960:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b192300 00000100:00100000:0.0:1746126626.085354:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b193800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721473920:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126626.085373:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126626.085398:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1965:x1830945721735040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10719us (11032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.085405:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7412 00000100:00100000:2.0:1746126626.086901:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721474048:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.086922:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.086940:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ada7000, rc 0) 00000100:00100000:2.0:1746126626.086969:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:31618:x1830945721735424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 4606us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.086976:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14164 00000100:00100000:0.0:1746126626.092552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.093309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.093466:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721736064 00000100:00100000:2.0:1746126626.093476:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721736064 00000100:00100000:3.0:1746126626.093576:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721736192 00000100:00100000:3.0:1746126626.093583:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721736192 00000100:00100000:2.0:1746126626.093682:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3870 00000100:00100000:2.0:1746126626.093690:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+229:31611:x1830945721736064:12345-192.168.203.2@tcp:35:multiop.0 00000100:00080000:1.0:1746126626.093752:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746126626.093793:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14165 00000100:00100000:3.0:1746126626.093802:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31616:x1830945721736192:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.093812:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.093844:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eba4 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.093873:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.093881:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.093882:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.093886:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.093914:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.093924:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.093936:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721474176:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.094565:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:31611:x1830945721736064:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 874us (2021us total) trans 8589943286 rc 0/0 00000100:00100000:2.0:1746126626.094573:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3870 00000100:00100000:0.0:1746126626.094698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.094822:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721736320 00000100:00100000:1.0:1746126626.094842:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721736320 00002000:00100000:1.0:1746126626.094868:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1134591) req@ffff8800937b8000 x1830945721736320/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.094883:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8000 with x1830945721736320 ext(1048576->1134591) 00010000:00010000:1.0:1746126626.094890:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746126626.094902:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746126626.094908:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937b8000 00000100:00100000:1.0:1746126626.094922:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1864 00000100:00100000:1.0:1746126626.094927:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721736320:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126626.095043:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.100358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.100613:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721474176:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.100644:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.100661:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e442e00, rc 0) 00000100:00100000:3.0:1746126626.100702:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31616:x1830945721736192:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6901us (7394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.100710:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14165 00000100:00100000:2.0:1746126626.101273:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721736320:12345-192.168.203.2@tcp:4:cat.0 Request processed in 6343us (6573us total) trans 17179873325 rc 0/0 00000100:00100000:2.0:1746126626.101281:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1864 00002000:00100000:2.0:1746126626.101289:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->1134591) req@ffff8800937b8000 x1830945721736320/t17179873325(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.101297:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937b8000 with x1830945721736320 ext(1048576->1134591) 00010000:00010000:2.0:1746126626.101305:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 34 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.101315:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 34 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.101322:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937b8000 00000100:00100000:2.0:1746126626.101337:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721736448 00000100:00100000:2.0:1746126626.101342:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721736448 00002000:00100000:2.0:1746126626.101366:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (2015232->2097151) req@ffff8800937ba300 x1830945721736448/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.101372:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ba300 with x1830945721736448 ext(2015232->2097151) 00010000:00010000:2.0:1746126626.101376:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 34 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.101384:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 34 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.101389:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937ba300 00000100:00100000:2.0:1746126626.101405:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1865 00000100:00100000:2.0:1746126626.101410:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1965:x1830945721736448:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126626.110820:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721736448:12345-192.168.203.2@tcp:4:cat.0 Request processed in 9396us (10458us total) trans 17179873326 rc 0/0 00000100:00100000:2.0:1746126626.110845:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1865 00002000:00100000:2.0:1746126626.110860:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (2015232->2097151) req@ffff8800937ba300 x1830945721736448/t17179873326(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.110870:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937ba300 with x1830945721736448 ext(2015232->2097151) 00010000:00010000:2.0:1746126626.110882:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.110894:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.110906:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937ba300 00000100:00100000:1.0:1746126626.111101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.111400:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721736576 00000100:00100000:0.0:1746126626.111408:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721736576 00010000:00010000:0.0:1746126626.111436:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.112218:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7413 00000100:00100000:0.0:1746126626.112228:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721736576:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126626.112243:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126626.112265:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126624 -> 1746126625 00002000:00010000:0.0:1746126626.112267:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126624 -> 1746126625 00010000:00010000:0.0:1746126626.112274:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.112286:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.112311:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8a1200/0xb50e825867615158 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb96 expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.112734:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.112737:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.112745:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.112754:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.112790:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126626.112807:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721474304:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126626.113300:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eae840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.119096:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721474304:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.119126:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.119175:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721736576:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6949us (8073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.119187:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7413 00000100:00100000:1.0:1746126626.122621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.122660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.124148:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737088 00000100:00100000:0.0:1746126626.124160:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737088 00000100:00100000:0.0:1746126626.124226:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9082 00000100:00100000:0.0:1746126626.124234:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:31620:x1830945721737088:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:0.0:1746126626.124266:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126626.124284:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e82586761516d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebab expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.124345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.124423:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737216 00000100:00100000:2.0:1746126626.124428:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737216 00010000:00010000:2.0:1746126626.124447:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.124506:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.124522:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.124528:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 229 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.124535:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.124540:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.124571:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.124585:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 16 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.124595:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721474432:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.124688:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 229 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.124696:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 229 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.124704:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721474560:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.124731:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 8 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.124738:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 8 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.124744:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721474688:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.124759:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.124894:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721736832 00000100:00100000:3.0:1746126626.124899:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721736832 00002000:00100000:3.0:1746126626.124926:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88012b191c00 x1830945721736832/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.124935:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191c00 with x1830945721736832 ext(1048576->2097151) 00002000:00010000:3.0:1746126626.124939:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b191c00 00000100:00100000:3.0:1746126626.124952:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8096 00000100:00100000:3.0:1746126626.124956:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721736832:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.127049:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721474432:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.127086:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721474560:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.127110:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721474688:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.127137:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126626.127165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.128184:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737472 00000100:00100000:2.0:1746126626.128192:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737472 00010000:00010000:2.0:1746126626.128222:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 230 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.128245:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7414 00000100:00100000:2.0:1746126626.128253:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945721737216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.128265:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.128287:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 37 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.128297:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 37 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.128317:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b200/0xb50e825867615143 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb81 expref: 37 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.128337:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.128339:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.128345:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.128353:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.128379:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.128389:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721474816:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.128443:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.128460:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7415 00000100:00100000:2.0:1746126626.128465:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+230:1963:x1830945721737472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.128471:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.128476:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 230 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.128483:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 230 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.128495:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ada6400/0xb50e825867615104 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb65 expref: 230 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.128504:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.128509:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.128517:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.128521:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.128535:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+229:1963:x1830945721737472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 70us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.128540:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7415 00000100:00100000:0.0:1746126626.130816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.130918:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737344 00000100:00100000:2.0:1746126626.130926:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737344 00010000:00010000:2.0:1746126626.130957:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.130972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.130981:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737600 00000100:00100000:2.0:1746126626.130982:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737600 00010000:00010000:2.0:1746126626.130991:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 9 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.131022:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7416 00000100:00100000:2.0:1746126626.131029:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721737344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.131042:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.131047:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.131057:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.131078:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b211400/0xb50e825867615127 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb6c expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.131096:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.131101:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.131109:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.131114:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.131159:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1963:x1830945721737344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 131us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.131166:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7416 00000100:00100000:2.0:1746126626.131181:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7417 00000100:00100000:2.0:1746126626.131186:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721737600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.131193:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.131196:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 9 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.131204:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 9 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.131215:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f75a400/0xb50e8258676150b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb26 expref: 9 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.131223:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.131226:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.131232:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.131239:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.131259:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.131274:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721737600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.131279:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7417 00010000:00010000:0.0:1746126626.131362:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.131369:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126626.131389:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:0.0:1746126626.131891:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30000/0xb50e82586761516d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.131911:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.131917:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126626.131919:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126626.133318:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed30c00, rc 0) 00000100:00100000:0.0:1746126626.133375:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31620:x1830945721737088:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 9139us (10762us total) trans 8589943287 rc 0/0 00000100:00100000:0.0:1746126626.133383:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9082 00000100:00100000:3.0:1746126626.136572:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721736832:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11603us (13898us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.136585:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8096 00002000:00100000:3.0:1746126626.136597:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88012b191c00 x1830945721736832/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.136606:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b191c00 with x1830945721736832 ext(1048576->2097151) 00002000:00010000:3.0:1746126626.136611:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b191c00 00000100:00100000:0.0:1746126626.137874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.137957:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721474816:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.137976:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.138019:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721737216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9767us (13675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.138028:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7414 00000100:00100000:3.0:1746126626.141702:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737856 00000100:00100000:3.0:1746126626.141717:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737856 00002000:00100000:3.0:1746126626.141772:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092ad2300 x1830945721737856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.141784:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad2300 with x1830945721737856 ext(1048576->2097151) 00002000:00010000:3.0:1746126626.141789:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad2300 00000100:00100000:3.0:1746126626.141866:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8097 00000100:00100000:3.0:1746126626.141875:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721737856:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.146664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.146765:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721737984 00000100:00100000:3.0:1746126626.146774:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721737984 00000100:00100000:3.0:1746126626.146865:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14166 00000100:00100000:3.0:1746126626.146873:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:31618:x1830945721737984:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.146894:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.146912:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebb2 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.146940:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.146948:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.146950:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.146953:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.146981:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 19 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.146992:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 19 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.147012:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721474944:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.147088:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.153799:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1966:x1830945721737856:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11913us (15917us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.153815:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8097 00002000:00100000:3.0:1746126626.153859:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff880092ad2300 x1830945721737856/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.153876:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad2300 with x1830945721737856 ext(1048576->2097151) 00002000:00010000:3.0:1746126626.153882:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad2300 00000100:00100000:0.0:1746126626.155781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.157884:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721474944:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.157917:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.157935:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e443200, rc 0) 00000100:00100000:3.0:1746126626.158011:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:31618:x1830945721737984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11126us (11344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.158020:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14166 00000100:00100000:2.0:1746126626.161087:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721738112 00000100:00100000:2.0:1746126626.161100:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721738112 00002000:00100000:2.0:1746126626.161153:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2342912->3145727) req@ffff880092ad1f80 x1830945721738112/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.161163:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1f80 with x1830945721738112 ext(2342912->3145727) 00010000:00010000:2.0:1746126626.161172:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 20 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.161185:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 20 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.161192:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1f80 00000100:00100000:2.0:1746126626.161221:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1866 00000100:00100000:2.0:1746126626.161229:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+20:1965:x1830945721738112:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126626.164773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.165011:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721738240 00000100:00100000:3.0:1746126626.165021:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721738240 00000100:00100000:3.0:1746126626.165079:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14167 00000100:00100000:3.0:1746126626.165087:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31616:x1830945721738240:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.165106:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.165125:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebb9 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.165152:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.165154:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.165161:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 24 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.165174:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 24 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.165189:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e443400, rc 0) 00000100:00100000:3.0:1746126626.165256:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31616:x1830945721738240:12345-192.168.203.2@tcp:101:cat.0 Request processed in 169us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.165262:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14167 00000100:00100000:1.0:1746126626.178609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.179430:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721738496 00000100:00100000:0.0:1746126626.179440:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721738496 00002000:00100000:0.0:1746126626.179489:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e805f80 x1830945721738496/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126626.179499:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805f80 with x1830945721738496 ext(1048576->2097151) 00002000:00010000:0.0:1746126626.179504:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e805f80 00000100:00100000:0.0:1746126626.179542:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8098 00000100:00100000:0.0:1746126626.179550:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721738496:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.195307:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1965:x1830945721738112:12345-192.168.203.2@tcp:4:cat.0 Request processed in 34062us (39517us total) trans 21474840469 rc 0/0 00000100:00100000:2.0:1746126626.195321:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1866 00002000:00100000:2.0:1746126626.195335:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2342912->3145727) req@ffff880092ad1f80 x1830945721738112/t21474840469(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.195345:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad1f80 with x1830945721738112 ext(2342912->3145727) 00010000:00010000:2.0:1746126626.195355:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 22 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.195371:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 22 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.195378:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad1f80 00000100:00100000:1.0:1746126626.200511:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721738496:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20948us (21902us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126626.200525:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8098 00002000:00100000:1.0:1746126626.200537:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009e805f80 x1830945721738496/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.200546:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805f80 with x1830945721738496 ext(1048576->2097151) 00002000:00010000:1.0:1746126626.200552:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e805f80 00000100:00100000:0.0:1746126626.201889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.203440:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721738624 00000100:00100000:2.0:1746126626.203452:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721738624 00010000:00010000:2.0:1746126626.203499:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 22 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.203539:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7418 00000100:00100000:2.0:1746126626.203547:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721738624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.203559:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.203581:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 22 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.203593:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 22 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.203616:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb19e00/0xb50e8258676150e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [2342912->4964351] (req 2342912->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb57 expref: 22 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.203642:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.203644:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.203651:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.203658:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.203688:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 30 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.203697:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721475072:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.203780:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.204917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.206068:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721738880 00000100:00100000:1.0:1746126626.206078:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721738880 00002000:00100000:1.0:1746126626.206125:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3837952->3842047) req@ffff8800937bad80 x1830945721738880/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.206134:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bad80 with x1830945721738880 ext(3837952->3842047) 00002000:00010000:1.0:1746126626.206139:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937bad80 00000100:00100000:1.0:1746126626.206169:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8099 00000100:00100000:1.0:1746126626.206176:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721738880:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126626.206333:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721738880:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 158us (1422us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126626.206339:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8099 00002000:00100000:1.0:1746126626.206344:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3837952->3842047) req@ffff8800937bad80 x1830945721738880/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.206350:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937bad80 with x1830945721738880 ext(3837952->3842047) 00002000:00010000:1.0:1746126626.206353:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937bad80 00000100:00100000:0.0:1746126626.210927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.211053:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721475072:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.211077:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.211117:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+21:1963:x1830945721738624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7571us (9234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.211128:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7418 00000100:00100000:3.0:1746126626.211137:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721739136 00000100:00100000:3.0:1746126626.211144:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721739136 00002000:00100000:3.0:1746126626.211182:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5964e00 x1830945721739136/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.211191:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964e00 with x1830945721739136 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.211195:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5964e00 00000100:00100000:3.0:1746126626.211210:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8100 00000100:00100000:3.0:1746126626.211216:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721739136:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.215224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.217665:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721739264 00000100:00100000:3.0:1746126626.217680:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721739264 00000100:00100000:3.0:1746126626.217743:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14168 00000100:00100000:3.0:1746126626.217750:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31616:x1830945721739264:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.217768:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.217785:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebc0 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.217808:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.217810:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.217817:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.217865:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.217875:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e443800, rc 0) 00000100:00100000:3.0:1746126626.219268:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31616:x1830945721739264:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1514us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.219276:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14168 00000100:00100000:0.0:1746126626.224563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.229183:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721739392 00000100:00100000:3.0:1746126626.229198:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721739392 00000100:00100000:3.0:1746126626.229269:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14169 00000100:00100000:3.0:1746126626.229277:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31620:x1830945721739392:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126626.229296:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.229313:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebc7 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.229346:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.229355:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.229365:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.229367:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.229370:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4337663] (req 4194304->4337663) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.229405:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.229417:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.229428:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721475200:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.229553:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.229565:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.229573:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721475328:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.229598:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.233240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.233272:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721739776 00000100:00100000:1.0:1746126626.233337:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721739776 00002000:00100000:1.0:1746126626.233388:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5967b80 x1830945721739776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.233397:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967b80 with x1830945721739776 ext(2097152->3145727) 00010000:00010000:1.0:1746126626.233406:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 24 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.233417:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 24 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746126626.233427:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5967b80 00000100:00100000:1.0:1746126626.233457:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1867 00000100:00100000:1.0:1746126626.233464:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721739776:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.233686:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+31:1966:x1830945721739136:12345-192.168.203.2@tcp:3:cat.0 Request processed in 22468us (22769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.233694:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8100 00002000:00100000:3.0:1746126626.233700:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5964e00 x1830945721739136/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.233706:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5964e00 with x1830945721739136 ext(2097152->3145727) 00010000:00010000:3.0:1746126626.233711:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.233723:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.233728:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5964e00 00000100:00100000:0.0:1746126626.233796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.233890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.233915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.233964:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721739904 00000100:00100000:3.0:1746126626.233968:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721739904 00002000:00100000:3.0:1746126626.233984:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d919500 x1830945721739904/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.233991:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919500 with x1830945721739904 ext(3145728->4194303) 00010000:00010000:3.0:1746126626.233995:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.234014:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.234019:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d919500 00000100:00100000:3.0:1746126626.234029:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721740288 00000100:00100000:3.0:1746126626.234031:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721740288 00002000:00100000:3.0:1746126626.234044:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3235840->3837951) req@ffff88012d91a300 x1830945721740288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.234050:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a300 with x1830945721740288 ext(3235840->3837951) 00002000:00010000:3.0:1746126626.234053:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d91a300 00000100:00100000:3.0:1746126626.234061:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721740160 00000100:00100000:3.0:1746126626.234063:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721740160 00002000:00100000:3.0:1746126626.234071:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2187264->3235839) req@ffff88012d918380 x1830945721740160/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.234083:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918380 with x1830945721740160 ext(2187264->3235839) 00002000:00010000:3.0:1746126626.234086:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d918380 00000100:00100000:3.0:1746126626.234104:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1868 00000100:00100000:3.0:1746126626.234110:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721739904:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.234157:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8101 00000100:00100000:2.0:1746126626.234165:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721740288:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.235383:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8102 00000100:00100000:3.0:1746126626.235393:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721740160:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.241948:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721475200:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.241964:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721475328:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.241994:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4337663] (req 4194304->4337663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.242025:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e443a00, rc 0) 00000100:00100000:3.0:1746126626.242065:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31620:x1830945721739392:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12788us (17511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.242075:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14169 00000100:00100000:0.0:1746126626.242472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.242530:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721740544 00000100:00100000:3.0:1746126626.242536:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721740544 00000100:00100000:3.0:1746126626.242567:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14170 00000100:00100000:3.0:1746126626.242573:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:31618:x1830945721740544:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.242588:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.242605:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebce expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.242633:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.242641:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.242643:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.242646:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.242671:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.242681:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.242693:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721475456:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.243313:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.247956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.248568:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721740672 00000100:00100000:2.0:1746126626.248578:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721740672 00010000:00010000:2.0:1746126626.248614:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.249011:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7419 00000100:00100000:2.0:1746126626.249020:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721740672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.249033:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.249052:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.249063:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.249085:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e443200/0xb50e825867615182 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb2 expref: 31 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.250082:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721739904:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15966us (16280us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.250093:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1868 00002000:00100000:3.0:1746126626.250104:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88012d919500 x1830945721739904/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.250113:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d919500 with x1830945721739904 ext(3145728->4194303) 00010000:00010000:3.0:1746126626.250120:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.250129:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.250136:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d919500 00010000:00010000:2.0:1746126626.250214:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.250238:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+30:1964:x1830945721740672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1220us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.250244:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7419 00000100:00100000:0.0:1746126626.253088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.253397:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721740800 00000100:00100000:3.0:1746126626.253406:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721740800 00002000:00100000:3.0:1746126626.253448:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->4194303) req@ffff88009ee3a680 x1830945721740800/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 504/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.253458:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3a680 with x1830945721740800 ext(2097152->4194303) 00010000:00010000:3.0:1746126626.253467:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 28 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.253480:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 28 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.253487:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee3a680 00000100:00100000:3.0:1746126626.253512:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1869 00000100:00100000:3.0:1746126626.253519:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721740800:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126626.253564:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721740288:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19398us (19671us total) trans 0 rc 602112/602112 00000100:00100000:2.0:1746126626.253572:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8101 00002000:00100000:2.0:1746126626.253579:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3235840->3837951) req@ffff88012d91a300 x1830945721740288/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 602112/602112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.253591:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d91a300 with x1830945721740288 ext(3235840->3837951) 00010000:00010000:2.0:1746126626.253596:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.253603:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.253609:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d91a300 00000100:00100000:2.0:1746126626.253650:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721475456:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.253677:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.253689:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c336e00, rc 0) 00000100:00100000:2.0:1746126626.253725:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:31618:x1830945721740544:12345-192.168.203.2@tcp:101:cat.0 Request processed in 11151us (11254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.253732:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14170 00000100:00100000:2.0:1746126626.254187:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721740160:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18795us (20270us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126626.254193:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8102 00002000:00100000:2.0:1746126626.254198:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (2187264->3235839) req@ffff88012d918380 x1830945721740160/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.254205:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d918380 with x1830945721740160 ext(2187264->3235839) 00010000:00010000:2.0:1746126626.254210:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.254223:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.254228:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d918380 00000100:00100000:1.0:1746126626.258427:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721739776:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24952us (25188us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126626.258438:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1867 00002000:00100000:1.0:1746126626.258448:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5967b80 x1830945721739776/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.258456:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967b80 with x1830945721739776 ext(2097152->3145727) 00010000:00010000:1.0:1746126626.258466:0:21461:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.258477:0:21461:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746126626.258484:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5967b80 00000100:00100000:3.0:1746126626.266392:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721740800:12345-192.168.203.2@tcp:4:cat.0 Request processed in 12862us (13302us total) trans 17179873327 rc 0/0 00000100:00100000:0.0:1746126626.266397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.266405:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1869 00002000:00100000:3.0:1746126626.266417:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->4194303) req@ffff88009ee3a680 x1830945721740800/t17179873327(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 504/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.266425:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee3a680 with x1830945721740800 ext(2097152->4194303) 00010000:00010000:3.0:1746126626.266436:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 26 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.266453:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 26 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.266460:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee3a680 00000100:00100000:2.0:1746126626.266551:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721740928 00000100:00100000:2.0:1746126626.266559:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721740928 00000100:00100000:2.0:1746126626.266600:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14171 00000100:00100000:2.0:1746126626.266607:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31616:x1830945721740928:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.266620:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.266636:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebd5 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.266659:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126626.266665:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.266675:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.266685:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c29400, rc 0) 00000100:00100000:2.0:1746126626.266719:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31616:x1830945721740928:12345-192.168.203.2@tcp:101:cat.0 Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.266724:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14171 00000100:00100000:0.0:1746126626.268310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.268398:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721741056 00000100:00100000:2.0:1746126626.268405:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721741056 00010000:00010000:2.0:1746126626.268431:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.268489:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7420 00000100:00100000:2.0:1746126626.268496:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721741056:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.268509:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.268529:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.268540:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.268561:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e443800/0xb50e825867615190 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc0 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.268586:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.268588:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.268593:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.268600:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.268628:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.268638:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721475584:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.268705:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.274149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.274428:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721741184 00000100:00100000:1.0:1746126626.274436:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721741184 00010000:00010000:1.0:1746126626.274471:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.274505:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7421 00000100:00100000:1.0:1746126626.274511:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721741184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.274527:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.274548:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.274559:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.274583:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f75a000/0xb50e8258676150e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb5e expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.274616:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.274619:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.274625:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 34 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.274634:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 34 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.274642:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.274643:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.274646:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.274651:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.274680:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 26 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.274695:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e805180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721475712:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126626.274779:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 34 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.274788:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721475840:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126626.274807:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.274925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.275018:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721741440 00000100:00100000:2.0:1746126626.275166:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721475584:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.275181:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.275199:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721741056:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6703us (6894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.275205:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7420 00000100:00100000:3.0:1746126626.275256:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721741440 00002000:00100000:3.0:1746126626.275287:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4333568->4337663) req@ffff880099371880 x1830945721741440/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.275296:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371880 with x1830945721741440 ext(4333568->4337663) 00002000:00010000:3.0:1746126626.275300:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099371880 00000100:00100000:3.0:1746126626.275313:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8103 00000100:00100000:3.0:1746126626.275319:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721741440:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.276482:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721741440:12345-192.168.203.2@tcp:3:cat.0 Request processed in 1157us (1551us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126626.276489:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8103 00002000:00100000:3.0:1746126626.276496:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4333568->4337663) req@ffff880099371880 x1830945721741440/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.276503:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099371880 with x1830945721741440 ext(4333568->4337663) 00002000:00010000:3.0:1746126626.276507:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099371880 00000100:00100000:0.0:1746126626.286741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.287021:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e805180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721475712:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126626.287034:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721475840:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126626.287057:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.287113:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721741184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 12600us (12972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.287123:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7421 00000100:00100000:3.0:1746126626.287225:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721741696 00000100:00100000:3.0:1746126626.287233:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721741696 00002000:00100000:3.0:1746126626.287275:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099373100 x1830945721741696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.287290:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373100 with x1830945721741696 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.287295:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099373100 00000100:00100000:3.0:1746126626.287311:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8104 00000100:00100000:3.0:1746126626.287318:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721741696:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.292117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.292171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.292191:0:21461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721741952 00000100:00100000:2.0:1746126626.292201:0:21461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721741952 00002000:00100000:2.0:1746126626.292248:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880131d57480 x1830945721741952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.292258:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57480 with x1830945721741952 ext(2097152->3145727) 00002000:00010000:2.0:1746126626.292263:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d57480 00000100:00100000:1.0:1746126626.292269:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721742080 00000100:00100000:1.0:1746126626.292273:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721742080 00000100:00100000:1.0:1746126626.292313:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9083 00000100:00100000:1.0:1746126626.292319:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31622:x1830945721742080:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126626.292344:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.292362:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8a00/0xb50e8258676151ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebdc expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.292417:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292428:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292439:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292449:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292454:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292458:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292564:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292573:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.292579:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.292606:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.292617:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.292628:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721475968:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.292899:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8105 00000100:00100000:2.0:1746126626.292906:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721741952:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126626.295012:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.306983:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721741696:12345-192.168.203.2@tcp:3:cat.0 Request processed in 19652us (20240us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.307008:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8104 00002000:00100000:3.0:1746126626.307021:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880099373100 x1830945721741696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.307030:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099373100 with x1830945721741696 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.307036:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099373100 00000100:00100000:3.0:1746126626.311883:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721741952:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18967us (19765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.311896:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8105 00002000:00100000:3.0:1746126626.311909:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff880131d57480 x1830945721741952/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.311918:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57480 with x1830945721741952 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.311924:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131d57480 00000100:00100000:1.0:1746126626.312351:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721475968:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.312375:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746126626.317432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.317494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.317786:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721742336 00000100:00100000:2.0:1746126626.317795:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721742336 00000100:00100000:2.0:1746126626.317882:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3871 00000100:00100000:2.0:1746126626.317890:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+16:7696:x1830945721742336:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126626.318127:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721742464 00000100:00100000:3.0:1746126626.318132:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721742464 00000100:00100000:3.0:1746126626.318159:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14172 00000100:00100000:3.0:1746126626.318163:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+30:31618:x1830945721742464:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.318175:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.318192:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebe3 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.319004:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.319008:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.319016:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.319031:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 31 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.319041:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c337800, rc 0) 00000100:00100000:3.0:1746126626.319090:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+31:31618:x1830945721742464:12345-192.168.203.2@tcp:101:cat.0 Request processed in 925us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.319096:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14172 00000100:00100000:2.0:1746126626.319228:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:7696:x1830945721742336:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 1339us (1806us total) trans 8589943288 rc 0/0 00000100:00100000:2.0:1746126626.319235:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3871 00000100:00100000:0.0:1746126626.327352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.327460:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721742592 00000100:00100000:1.0:1746126626.327470:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721742592 00010000:00010000:1.0:1746126626.327508:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.327551:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7422 00000100:00100000:1.0:1746126626.327558:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1964:x1830945721742592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.327573:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.327579:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.327589:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.327612:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed30c00/0xb50e825867615174 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebab expref: 17 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.327640:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126626.327646:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.327656:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.327662:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.327693:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.327730:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+16:1964:x1830945721742592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 173us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.327737:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7422 00010000:00010000:0.0:1746126626.327819:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327846:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746126626.327888:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:0.0:1746126626.327892:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746126626.327909:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327918:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327926:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327932:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327938:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327944:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801367f8800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126626.327947:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327953:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327962:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:0.0:1746126626.327965:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126626.327968:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327975:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8800/0xb50e8258676151b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327987:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.327992:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.328007:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.328011:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801367f8600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746126626.328014:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.328018:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.328120:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8e4300) 00010000:00010000:0.0:1746126626.328123:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126626.328127:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.328131:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8600/0xb50e8258676151ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.328163:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8a00/0xb50e8258676151ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.328175:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.328185:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126626.328187:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126626.328189:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801367f8400, rc 0) 00000100:00100000:0.0:1746126626.328215:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31622:x1830945721742080:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 35895us (36043us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.328221:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9083 00000100:00100000:0.0:1746126626.329359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.331520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.331946:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721742848 00000100:00100000:2.0:1746126626.331955:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721742848 00000100:00100000:2.0:1746126626.332006:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9084 00000100:00100000:2.0:1746126626.332014:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+229:31625:x1830945721742848:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126626.332038:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.332056:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e8258676151cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebea expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.332147:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.332168:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.332177:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.332205:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.332216:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 8 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.332227:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721476096:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.332308:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.332588:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721742976 00000100:00100000:3.0:1746126626.332593:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721742976 00000100:00100000:3.0:1746126626.332619:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14173 00000100:00100000:3.0:1746126626.332625:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31616:x1830945721742976:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.332634:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.332644:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebf1 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.332661:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.332662:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.332669:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.332684:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 23 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.332693:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c337c00, rc 0) 00000100:00100000:3.0:1746126626.332722:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+23:31616:x1830945721742976:12345-192.168.203.2@tcp:101:cat.0 Request processed in 98us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.332727:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14173 00000100:00100000:0.0:1746126626.333210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.333229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.333241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.333267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.333285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.333307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.333356:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721743360 00000100:00100000:1.0:1746126626.333360:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721743360 00000100:00100000:1.0:1746126626.333389:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721743616 00000100:00100000:1.0:1746126626.333392:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721743616 00000100:00100000:1.0:1746126626.333405:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721743488 00000100:00100000:1.0:1746126626.333406:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721743488 00000100:00100000:1.0:1746126626.333416:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721743744 00000100:00100000:1.0:1746126626.333418:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721743744 00000100:00100000:1.0:1746126626.333430:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14174 00000100:00100000:1.0:1746126626.333435:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721743360:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126626.333443:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.333455:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebf8 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.333470:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.333471:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.333476:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333486:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333493:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b54600, rc 0) 00000100:00100000:1.0:1746126626.333516:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721743360:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.333521:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14174 00000100:00100000:1.0:1746126626.333533:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14175 00000100:00100000:1.0:1746126626.333537:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721743616:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126626.333543:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.333550:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b55a00/0xb50e8258676151eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec06 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.333566:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b55a00/0xb50e8258676151eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec06 expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333575:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b55a00/0xb50e8258676151eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec06 expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333583:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b55a00, rc 0) 00000100:00100000:1.0:1746126626.333597:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721743616:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 59us (355us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.333602:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14175 00000100:00100000:1.0:1746126626.333611:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14176 00000100:00100000:1.0:1746126626.333615:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721743488:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126626.333621:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.333627:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ebff expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.333636:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.333637:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.333642:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333650:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333656:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb29e00, rc 0) 00000100:00100000:1.0:1746126626.333671:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721743488:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 55us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.333675:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14176 00000100:00100000:1.0:1746126626.333685:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14177 00000100:00100000:1.0:1746126626.333689:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721743744:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126626.333693:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.333698:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec0d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.333706:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.333708:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.333711:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333718:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.333725:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb29600, rc 0) 00000100:00100000:1.0:1746126626.333736:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721743744:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 47us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.333743:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14177 00000100:00100000:3.0:1746126626.333821:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721743232 00000100:00100000:3.0:1746126626.333824:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721743232 00002000:00100000:3.0:1746126626.333866:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880131d57100 x1830945721743232/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.333875:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57100 with x1830945721743232 ext(3145728->4194303) 00002000:00010000:3.0:1746126626.333879:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d57100 00000100:00100000:3.0:1746126626.333888:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721744000 00000100:00100000:3.0:1746126626.333890:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721744000 00002000:00100000:3.0:1746126626.333899:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880090254700 x1830945721744000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.333905:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090254700 with x1830945721744000 ext(3145728->4194303) 00002000:00010000:3.0:1746126626.333908:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090254700 00000100:00100000:3.0:1746126626.333924:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8106 00000100:00100000:3.0:1746126626.333929:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721743232:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.335075:0:21461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8107 00000100:00100000:2.0:1746126626.335084:0:21461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721744000:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.338402:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721476096:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.338428:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126626.345073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.345102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.345145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.345578:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721744128 00000100:00100000:2.0:1746126626.345592:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721744128 00010000:00010000:2.0:1746126626.345634:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 9 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.345673:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7423 00000100:00100000:2.0:1746126626.345681:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721744128:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.345699:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.345706:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 9 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.345721:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 9 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.346157:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8400/0xb50e8258676151c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebdc expref: 9 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.346200:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.346206:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.346215:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.346222:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.346548:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.347691:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721744128:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2002us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.347702:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7423 00010000:00010000:2.0:1746126626.347745:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.347757:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126626.347775:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126626.347939:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d1200/0xb50e8258676151cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 232 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.347953:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 231 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.347961:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.347963:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126626.347966:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58d0600, rc 0) 00000100:00100000:2.0:1746126626.347995:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:31625:x1830945721742848:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15982us (18639us total) trans 8589943289 rc 0/0 00000100:00100000:2.0:1746126626.348010:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9084 00000100:00100000:2.0:1746126626.348036:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721744384 00000100:00100000:2.0:1746126626.348043:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721744384 00002000:00100000:2.0:1746126626.348072:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e805180 x1830945721744384/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.348082:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805180 with x1830945721744384 ext(3145728->4194303) 00002000:00010000:2.0:1746126626.348086:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e805180 00000100:00100000:2.0:1746126626.348108:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721744640 00000100:00100000:2.0:1746126626.348111:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721744640 00002000:00100000:2.0:1746126626.348124:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800920bc000 x1830945721744640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.348130:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bc000 with x1830945721744640 ext(3145728->4194303) 00002000:00010000:2.0:1746126626.348133:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bc000 00000100:00100000:2.0:1746126626.348153:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8108 00000100:00100000:2.0:1746126626.348158:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721744384:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.348757:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8109 00000100:00100000:3.0:1746126626.348766:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721744640:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.349548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.349565:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721744768 00000100:00100000:0.0:1746126626.349569:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721744768 00000100:00100000:0.0:1746126626.349596:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9085 00000100:00100000:0.0:1746126626.349602:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:31622:x1830945721744768:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126626.349615:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126626.349630:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8e00/0xb50e825867615207 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec14 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.349678:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8e00/0xb50e825867615207 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec14 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.349693:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8e00/0xb50e825867615207 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec14 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.349707:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:0.0:1746126626.349710:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126626.349712:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801367f8e00, rc 0) 00000100:00100000:0.0:1746126626.349740:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31622:x1830945721744768:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 138us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.349745:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9085 00000100:00100000:3.0:1746126626.350328:0:21461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721744000:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15243us (17017us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.350335:0:21461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8107 00002000:00100000:3.0:1746126626.350343:0:21461:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff880090254700 x1830945721744000/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.350350:0:21461:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090254700 with x1830945721744000 ext(3145728->4194303) 00002000:00010000:3.0:1746126626.350355:0:21461:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090254700 00000100:00100000:3.0:1746126626.358971:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1963:x1830945721743232:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25029us (25750us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.358984:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8106 00002000:00100000:3.0:1746126626.359006:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff880131d57100 x1830945721743232/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.359015:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131d57100 with x1830945721743232 ext(3145728->4194303) 00002000:00010000:3.0:1746126626.359020:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131d57100 00000100:00100000:0.0:1746126626.359969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.360369:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745024 00000100:00100000:3.0:1746126626.360377:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745024 00000100:00100000:3.0:1746126626.360439:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9086 00000100:00100000:3.0:1746126626.360445:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:31622:x1830945721745024:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126626.360462:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.360477:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337400/0xb50e82586761520e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec1b expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.360580:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360594:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360603:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360616:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360621:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360626:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360720:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337000/0xb50e825867615223 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360728:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337000/0xb50e825867615223 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.360733:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337000/0xb50e825867615223 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:3.0:1746126626.360741:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:3.0:1746126626.361914:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.361926:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.361932:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.361941:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c337600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126626.361945:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.361952:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.361965:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126626.361967:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126626.361971:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.361975:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337600/0xb50e825867615215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362010:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362015:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362020:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362023:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c336c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126626.362025:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362030:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362036:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136a9ff00) 00010000:00010000:3.0:1746126626.362038:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126626.362040:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362044:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336c00/0xb50e82586761521c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.362091:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337400/0xb50e82586761520e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec1b expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.362105:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337000/0xb50e825867615223 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec1b expref: 11 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.362112:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126626.362113:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126626.362116:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c337000, rc 0) 00000100:00100000:3.0:1746126626.362167:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31622:x1830945721745024:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 1721us (2199us total) trans 8589943290 rc 0/0 00000100:00100000:3.0:1746126626.362173:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9086 00000100:00100000:0.0:1746126626.368917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.370916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.371361:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745280 00000100:00100000:3.0:1746126626.371374:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745280 00000100:00100000:0.0:1746126626.372258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.372335:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9087 00000100:00100000:3.0:1746126626.372344:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31622:x1830945721745280:12345-192.168.203.2@tcp:101:mirror_io.0 00010000:00010000:3.0:1746126626.372369:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.372387:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337200/0xb50e825867615231 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec22 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.372482:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.372497:0:20362:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 230 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.372504:0:20362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126626.372534:0:20362:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 230 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.372545:0:20362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 230 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.372557:0:20362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721476224:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.372629:0:20362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.372752:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721744384:12345-192.168.203.2@tcp:3:cat.0 Request processed in 24592us (27646us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126626.372761:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8108 00002000:00100000:2.0:1746126626.372770:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e805180 x1830945721744384/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.372779:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e805180 with x1830945721744384 ext(3145728->4194303) 00002000:00010000:2.0:1746126626.372784:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e805180 00000100:00100000:1.0:1746126626.373083:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745408 00000100:00100000:1.0:1746126626.373090:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745408 00000100:00100000:1.0:1746126626.373116:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745536 00000100:00100000:1.0:1746126626.373118:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745536 00000100:00100000:1.0:1746126626.373132:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14178 00000100:00100000:1.0:1746126626.373137:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:31625:x1830945721745408:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126626.373146:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.373156:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec29 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373173:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373180:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373185:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746126626.373187:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746126626.373189:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3334144->3551231] (req 3334144->3551231) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373203:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373214:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 22 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.373221:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721476352:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.373249:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373255:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.373262:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721476480:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.373272:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.373288:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14179 00000100:00100000:1.0:1746126626.373292:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721745536:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.373296:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.373305:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec30 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373321:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.373322:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.373328:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 36 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.373341:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 36 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.373354:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4bc00, rc 0) 00000100:00100000:1.0:1746126626.373369:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721745536:12345-192.168.203.2@tcp:101:cat.0 Request processed in 77us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.373376:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14179 00000100:00100000:0.0:1746126626.373449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.373485:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745664 00000100:00100000:1.0:1746126626.373488:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745664 00000100:00100000:1.0:1746126626.373503:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14180 00000100:00100000:1.0:1746126626.373506:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721745664:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.373514:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.373519:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc4be00/0xb50e82586761524d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec37 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.373538:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4be00/0xb50e82586761524d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec37 expref: 34 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.373548:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4be00/0xb50e82586761524d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec37 expref: 34 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.373567:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4be00, rc 0) 00000100:00100000:1.0:1746126626.373611:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+33:1966:x1830945721745664:12345-192.168.203.2@tcp:101:cat.0 Request processed in 100us (159us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.373616:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14180 00000100:00100000:3.0:1746126626.374810:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721744640:12345-192.168.203.2@tcp:3:cat.0 Request processed in 26040us (29658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.374819:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8109 00002000:00100000:3.0:1746126626.375137:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff8800920bc000 x1830945721744640/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.375146:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bc000 with x1830945721744640 ext(3145728->4194303) 00002000:00010000:3.0:1746126626.375150:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920bc000 00000100:00100000:3.0:1746126626.380584:0:20362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20362:1830945721476224:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.380612:0:20362:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:0.0:1746126626.386074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.386478:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745792 00000100:00100000:2.0:1746126626.386487:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745792 00010000:00010000:2.0:1746126626.386521:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 231 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.386558:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7424 00000100:00100000:2.0:1746126626.386565:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+231:1964:x1830945721745792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.386578:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.386584:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 231 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.386595:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 231 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.386615:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58d0600/0xb50e8258676151d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebea expref: 231 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.386752:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721476352:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.386762:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721476480:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.386787:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3334144->3551231] (req 3334144->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.386801:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc4b200, rc 0) 00000100:00100000:1.0:1746126626.387420:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:31625:x1830945721745408:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 14280us (16507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.387428:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14178 00000100:00100000:0.0:1746126626.387747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.387853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.387873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.387893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126626.387951:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.387956:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.387966:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.387971:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.387993:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.388032:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+230:1964:x1830945721745792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1466us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.388038:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7424 00000100:00100000:2.0:1746126626.388053:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721746048 00000100:00100000:2.0:1746126626.388057:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721746048 00010000:00010000:2.0:1746126626.388071:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.388084:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721746176 00000100:00100000:2.0:1746126626.388086:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721746176 00010000:00010000:2.0:1746126626.388094:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.388106:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7425 00000100:00100000:2.0:1746126626.388111:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1963:x1830945721746048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.388119:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.388138:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.388147:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.388162:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c337c00/0xb50e8258676151dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf1 expref: 23 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.388175:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.388188:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1963:x1830945721746048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.388193:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7425 00000100:00100000:2.0:1746126626.388220:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7426 00000100:00100000:2.0:1746126626.388224:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721746176:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.388229:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.388235:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.388242:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.388253:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676151c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebe3 expref: 32 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.388261:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.388263:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.388268:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388278:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388304:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.388316:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721476608:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.388365:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.388388:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721746304 00000100:00100000:2.0:1746126626.388390:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721746304 00000100:00100000:2.0:1746126626.388412:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721745920 00000100:00100000:2.0:1746126626.388415:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721745920 00000100:00100000:2.0:1746126626.388428:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14181 00000100:00100000:2.0:1746126626.388432:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721746304:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.388445:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.388456:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867615254 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec45 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388472:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867615254 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec45 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.388480:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c893200/0xb50e825867615254 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec45 expref: 23 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.388487:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c893200, rc 0) 00000100:00100000:2.0:1746126626.388502:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721746304:12345-192.168.203.2@tcp:101:cat.0 Request processed in 69us (628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.388507:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14181 00000100:00100000:2.0:1746126626.388517:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14182 00000100:00100000:2.0:1746126626.388521:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:31618:x1830945721745920:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.388527:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.388533:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec3e expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388545:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388551:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126626.388552:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126626.388555:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 33 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388570:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388579:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 21 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.388587:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721476736:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.388606:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7fc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746126626.388632:0:20362:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388639:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388656:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388662:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388667:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388672:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c336a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126626.388675:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388681:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388689:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.388692:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126626.388695:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388699:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c336a00/0xb50e825867615238 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.388733:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337200/0xb50e825867615231 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec22 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388740:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337200/0xb50e825867615231 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec22 expref: 12 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.388747:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c337200, rc 0) 00000100:00100000:2.0:1746126626.388766:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31622:x1830945721745280:12345-192.168.203.2@tcp:101:mirror_io.0 Request processed in 16424us (19861us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.388772:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9087 00000100:00100000:2.0:1746126626.395132:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721476608:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.395158:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.395210:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721746176:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6983us (7355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.395222:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7426 00000100:00100000:3.0:1746126626.396716:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721476736:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.396744:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 32 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.396767:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c892600, rc 0) 00000100:00100000:3.0:1746126626.396813:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:31618:x1830945721745920:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8290us (8918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.396821:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14182 00000100:00100000:0.0:1746126626.397121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.397175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.397202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.397235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.397328:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721746560 00000100:00100000:2.0:1746126626.397335:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721746560 00000100:00100000:2.0:1746126626.397367:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3872 00000100:00100000:2.0:1746126626.397374:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:31622:x1830945721746560:12345-192.168.203.2@tcp:35:mirror_io.0 00000100:00100000:2.0:1746126626.397553:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31622:x1830945721746560:12345-192.168.203.2@tcp:35:mirror_io.0 Request processed in 179us (433us total) trans 8589943291 rc 0/0 00000100:00100000:2.0:1746126626.397558:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3872 00000100:00100000:2.0:1746126626.397574:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721746816 00000100:00100000:2.0:1746126626.397577:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721746816 00002000:00100000:2.0:1746126626.397600:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3334144->3338239) req@ffff880090256d80 x1830945721746816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.397610:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090256d80 with x1830945721746816 ext(3334144->3338239) 00002000:00010000:2.0:1746126626.397614:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090256d80 00000100:00100000:2.0:1746126626.397626:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721746944 00000100:00100000:2.0:1746126626.397627:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721746944 00002000:00100000:2.0:1746126626.397637:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4337663) req@ffff880090257100 x1830945721746944/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.397642:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090257100 with x1830945721746944 ext(4194304->4337663) 00010000:00010000:2.0:1746126626.397649:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 22 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.397661:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 22 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.397667:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090257100 00000100:00100000:2.0:1746126626.397678:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1870 00000100:00100000:2.0:1746126626.397683:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1964:x1830945721746944:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126626.398090:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721747072 00000100:00100000:3.0:1746126626.398094:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721747072 00000100:00100000:3.0:1746126626.398122:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14183 00000100:00100000:3.0:1746126626.398127:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31616:x1830945721747072:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.398136:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.398149:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec4c expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.398166:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.398170:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->4976639] (req 4337664->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.398179:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->4976639] (req 4337664->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.398187:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c336600, rc 0) 00000100:00100000:3.0:1746126626.398207:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31616:x1830945721747072:12345-192.168.203.2@tcp:101:cat.0 Request processed in 80us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.398213:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14183 00000100:00100000:3.0:1746126626.398233:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8110 00000100:00100000:3.0:1746126626.398239:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721746816:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.398347:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721746816:12345-192.168.203.2@tcp:3:cat.0 Request processed in 108us (1171us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126626.398353:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8110 00002000:00100000:3.0:1746126626.398358:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3334144->3338239) req@ffff880090256d80 x1830945721746816/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.398364:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090256d80 with x1830945721746816 ext(3334144->3338239) 00002000:00010000:3.0:1746126626.398367:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090256d80 00000100:00100000:2.0:1746126626.405698:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721746944:12345-192.168.203.2@tcp:4:cat.0 Request processed in 7999us (8480us total) trans 21474840470 rc 0/0 00000100:00100000:2.0:1746126626.405712:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1870 00002000:00100000:2.0:1746126626.405727:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4337663) req@ffff880090257100 x1830945721746944/t21474840470(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.405737:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090257100 with x1830945721746944 ext(4194304->4337663) 00010000:00010000:2.0:1746126626.405748:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.405762:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.405768:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090257100 00000100:00100000:0.0:1746126626.406913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.407282:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721747328 00000100:00100000:2.0:1746126626.407291:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721747328 00002000:00100000:2.0:1746126626.407333:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3547136->3551231) req@ffff880090257800 x1830945721747328/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.407348:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090257800 with x1830945721747328 ext(3547136->3551231) 00002000:00010000:2.0:1746126626.407352:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090257800 00000100:00100000:2.0:1746126626.407372:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8111 00000100:00100000:2.0:1746126626.407379:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721747328:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.407548:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721747328:12345-192.168.203.2@tcp:3:cat.0 Request processed in 169us (639us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126626.407554:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8111 00002000:00100000:2.0:1746126626.407559:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3547136->3551231) req@ffff880090257800 x1830945721747328/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.407565:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090257800 with x1830945721747328 ext(3547136->3551231) 00002000:00010000:2.0:1746126626.407568:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090257800 00000100:00100000:0.0:1746126626.409902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.410188:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721747456 00000100:00100000:2.0:1746126626.410196:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721747456 00010000:00010000:2.0:1746126626.410224:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.410247:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7427 00000100:00100000:2.0:1746126626.410253:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721747456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.410265:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126626.410281:0:7892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126625 -> 1746126626 00010000:00010000:2.0:1746126626.410286:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.410297:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.410319:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e443a00/0xb50e825867615197 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [4194304->4972543] (req 4194304->4337663) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebc7 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.410342:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.410344:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.410351:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 31 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.410358:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 31 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.410365:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.410366:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.410368:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 24 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.410374:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 24 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.410398:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 24 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.410407:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721476864:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.410488:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 31 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.410501:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721476992:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.410521:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.412410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.412914:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721747712 00000100:00100000:1.0:1746126626.412923:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721747712 00000100:00100000:1.0:1746126626.412971:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3873 00000100:00100000:1.0:1746126626.412978:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+230:31625:x1830945721747712:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:1.0:1746126626.413251:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27c713d7-92e0-4974-b612-500c641c1d6c+231:31625:x1830945721747712:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 272us (846us total) trans 8589943292 rc 0/0 00000100:00100000:1.0:1746126626.413258:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3873 00000100:00100000:0.0:1746126626.415891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.415925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.416020:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721747968 00000100:00100000:3.0:1746126626.416028:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721747968 00002000:00100000:3.0:1746126626.416064:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4337664->4976639) req@ffff880090254000 x1830945721747968/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.416073:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090254000 with x1830945721747968 ext(4337664->4976639) 00002000:00010000:3.0:1746126626.416078:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090254000 00000100:00100000:3.0:1746126626.416098:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721748224 00000100:00100000:3.0:1746126626.416100:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721748224 00002000:00100000:3.0:1746126626.416109:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4972543) req@ffff880090254380 x1830945721748224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.416115:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090254380 with x1830945721748224 ext(4194304->4972543) 00002000:00010000:3.0:1746126626.416118:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090254380 00000100:00100000:3.0:1746126626.416137:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8112 00000100:00100000:3.0:1746126626.416143:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721747968:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.416968:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8113 00000100:00100000:3.0:1746126626.416974:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721748224:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126626.420083:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721476864:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.420100:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721476992:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.420122:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.420175:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721747456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 9920us (10279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.420185:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7427 00000100:00100000:3.0:1746126626.427436:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721747968:12345-192.168.203.2@tcp:3:cat.0 Request processed in 11281us (11539us total) trans 0 rc 638976/638976 00000100:00100000:3.0:1746126626.427451:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8112 00002000:00100000:3.0:1746126626.427462:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4337664->4976639) req@ffff880090254000 x1830945721747968/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 638976/638976 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.427472:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090254000 with x1830945721747968 ext(4337664->4976639) 00002000:00010000:3.0:1746126626.427477:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090254000 00000100:00100000:3.0:1746126626.435974:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721748224:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18988us (20035us total) trans 0 rc 778240/778240 00000100:00100000:3.0:1746126626.435986:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8113 00002000:00100000:3.0:1746126626.436007:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4972543) req@ffff880090254380 x1830945721748224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.436016:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090254380 with x1830945721748224 ext(4194304->4972543) 00002000:00010000:3.0:1746126626.436021:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090254380 00000100:00100000:0.0:1746126626.438338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.438413:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721748352 00000100:00100000:2.0:1746126626.438423:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721748352 00000100:00100000:2.0:1746126626.438481:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14184 00000100:00100000:2.0:1746126626.438489:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721748352:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.438510:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.438528:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098eb9000/0xb50e825867615269 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec53 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.438557:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098eb9000/0xb50e825867615269 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec53 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.438568:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098eb9000/0xb50e825867615269 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec53 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.438592:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098eb9000, rc 0) 00000100:00100000:2.0:1746126626.438639:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1966:x1830945721748352:12345-192.168.203.2@tcp:101:cat.0 Request processed in 150us (307us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.438645:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14184 00000100:00100000:0.0:1746126626.441771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.441864:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721748480 00000100:00100000:3.0:1746126626.441872:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721748480 00000100:00100000:3.0:1746126626.441914:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14185 00000100:00100000:3.0:1746126626.441920:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721748480:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.441936:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.441952:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e825867615270 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec5a expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.441978:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e825867615270 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec5a expref: 33 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.441987:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e825867615270 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec5a expref: 33 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.442016:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c336400, rc 0) 00000100:00100000:3.0:1746126626.442364:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721748480:12345-192.168.203.2@tcp:101:cat.0 Request processed in 135us (293us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126626.442372:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14185 00000100:00100000:0.0:1746126626.444934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.445437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.445505:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721748608 00000100:00100000:2.0:1746126626.445515:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721748608 00000100:00100000:2.0:1746126626.445566:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721748736 00000100:00100000:2.0:1746126626.445569:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721748736 00000100:00100000:2.0:1746126626.445587:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14186 00000100:00100000:2.0:1746126626.445594:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721748608:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:1.0:1746126626.445607:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14187 00010000:00010000:2.0:1746126626.445611:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126626.445616:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721748736:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.445624:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.445626:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098eb8400/0xb50e825867615277 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec61 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.445632:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e82586761527e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec68 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.445715:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e82586761527e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec68 expref: 33 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.445723:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098eb8400/0xb50e825867615277 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec61 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.445725:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e82586761527e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec68 expref: 33 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.445731:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098eb8400/0xb50e825867615277 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec61 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.445752:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098eb8400, rc 0) 00010000:00010000:1.0:1746126626.445754:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a000, rc 0) 00000100:00100000:2.0:1746126626.445793:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721748608:12345-192.168.203.2@tcp:101:cat.0 Request processed in 200us (867us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.445799:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14186 00000100:00100000:1.0:1746126626.445878:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+32:1966:x1830945721748736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 263us (441us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.445883:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14187 00000100:00100000:0.0:1746126626.502590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.502806:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721748992 00000100:00100000:2.0:1746126626.502816:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721748992 00000100:00100000:2.0:1746126626.503232:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9088 00000100:00100000:2.0:1746126626.503240:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+16:31631:x1830945721748992:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126626.503266:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.503287:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e825867615285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec6f expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.503391:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.503408:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.503420:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126626.503430:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126626.503548:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e825867615285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 19 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.503577:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 18 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.503586:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.503589:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126626.503591:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098eb8200, rc 0) 00000100:00100000:2.0:1746126626.503641:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31631:x1830945721748992:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 401us (1061us total) trans 8589943293 rc 0/0 00000100:00100000:2.0:1746126626.503647:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9088 00000100:00100000:0.0:1746126626.647103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.649172:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721749248 00000100:00100000:2.0:1746126626.649182:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721749248 00000100:00100000:2.0:1746126626.649243:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9089 00000100:00100000:2.0:1746126626.649249:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+231:31633:x1830945721749248:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126626.649267:0:20362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.649282:0:20362:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb9000/0xb50e82586761529a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec76 expref: -99 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.649349:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.649360:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126626.649368:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00200000:2.0:1746126626.649375:0:20362:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126626.649452:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb9000/0xb50e82586761529a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 234 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.649481:0:20362:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 233 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.649487:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.649490:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126626.649492:0:20362:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098eb8400, rc 0) 00000100:00100000:2.0:1746126626.649534:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+233:31633:x1830945721749248:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 286us (2447us total) trans 8589943294 rc 0/0 00000100:00100000:2.0:1746126626.649539:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9089 00000100:00100000:0.0:1746126626.672114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.672972:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721749376 00000100:00100000:1.0:1746126626.672980:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721749376 00000100:00100000:1.0:1746126626.673038:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14188 00000100:00100000:1.0:1746126626.673413:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721749376:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.673428:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.673441:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e8258676152af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec7d expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.673466:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e8258676152af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec7d expref: 25 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.673475:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a800/0xb50e8258676152af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec7d expref: 25 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.673683:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a800, rc 0) 00000100:00100000:1.0:1746126626.673729:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721749376:12345-192.168.203.2@tcp:101:cat.0 Request processed in 685us (1622us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.673734:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14188 00000100:00100000:0.0:1746126626.684186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.684283:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721749504 00000100:00100000:1.0:1746126626.684293:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721749504 00000100:00100000:0.0:1746126626.684313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.684613:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721749632 00000100:00100000:1.0:1746126626.684617:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721749632 00000100:00100000:2.0:1746126626.684619:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14189 00000100:00100000:2.0:1746126626.684629:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721749504:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.684648:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.684666:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098eb9000/0xb50e8258676152b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec84 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.684698:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098eb9000/0xb50e8258676152b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec84 expref: 33 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.684708:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098eb9000/0xb50e8258676152b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec84 expref: 33 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.684731:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098eb9000, rc 0) 00000100:00100000:2.0:1746126626.684778:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721749504:12345-192.168.203.2@tcp:101:cat.0 Request processed in 151us (603us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.684784:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14189 00000100:00100000:2.0:1746126626.684803:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14190 00000100:00100000:2.0:1746126626.684807:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:31638:x1830945721749632:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.684813:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.684819:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec8b expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.684855:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.684857:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.684866:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 25 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.684878:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 25 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.684886:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a02600, rc 0) 00000100:00100000:2.0:1746126626.684902:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31638:x1830945721749632:12345-192.168.203.2@tcp:101:cat.0 Request processed in 94us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.684907:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14190 00000100:00100000:0.0:1746126626.692046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.692177:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721749888 00000100:00100000:3.0:1746126626.692187:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721749888 00002000:00100000:3.0:1746126626.692240:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5965880 x1830945721749888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.692250:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965880 with x1830945721749888 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.692255:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965880 00000100:00100000:3.0:1746126626.692287:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8114 00000100:00100000:3.0:1746126626.692294:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721749888:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.697935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.699089:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721750144 00000100:00100000:1.0:1746126626.699100:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721750144 00002000:00100000:1.0:1746126626.699146:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5967800 x1830945721750144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.699157:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967800 with x1830945721750144 ext(1048576->2097151) 00002000:00010000:1.0:1746126626.699163:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967800 00000100:00100000:1.0:1746126626.699187:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8115 00000100:00100000:1.0:1746126626.699196:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721750144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.710594:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5965880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1966:x1830945721749888:12345-192.168.203.2@tcp:3:cat.0 Request processed in 18289us (18759us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.710607:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8114 00002000:00100000:3.0:1746126626.710619:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff8800a5965880 x1830945721749888/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.710629:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5965880 with x1830945721749888 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.710635:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5965880 00000100:00100000:1.0:1746126626.715032:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721750144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15824us (17095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126626.715044:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8115 00002000:00100000:1.0:1746126626.715056:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff8800a5967800 x1830945721750144/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.715065:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5967800 with x1830945721750144 ext(1048576->2097151) 00002000:00010000:1.0:1746126626.715070:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5967800 00000100:00100000:0.0:1746126626.726012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.726076:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721750272 00000100:00100000:1.0:1746126626.726086:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721750272 00000100:00100000:1.0:1746126626.726140:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14191 00000100:00100000:1.0:1746126626.726147:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+25:31638:x1830945721750272:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.726165:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.726181:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec92 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.726209:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.726222:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126626.726224:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126626.726227:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.726253:0:20294:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.726263:0:20294:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 31 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.726274:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721477120:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.726363:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.731615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.734849:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721477120:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.734885:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.734903:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b200, rc 0) 00000100:00100000:1.0:1746126626.734954:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31638:x1830945721750272:12345-192.168.203.2@tcp:101:cat.0 Request processed in 8807us (8961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.734962:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14191 00000100:00100000:2.0:1746126626.737242:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721750400 00000100:00100000:2.0:1746126626.737254:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721750400 00002000:00100000:2.0:1746126626.737307:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3334144->3551231) req@ffff88009204e680 x1830945721750400/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.737316:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204e680 with x1830945721750400 ext(3334144->3551231) 00010000:00010000:2.0:1746126626.737330:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 32 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.737344:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 32 pid: 8437 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.737350:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204e680 00000100:00100000:2.0:1746126626.737386:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1871 00000100:00100000:2.0:1746126626.737393:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1965:x1830945721750400:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126626.737979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.738116:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721750528 00000100:00100000:1.0:1746126626.738121:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721750528 00000100:00100000:1.0:1746126626.738145:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14192 00000100:00100000:1.0:1746126626.738150:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+34:31639:x1830945721750528:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.738159:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.738173:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ec99 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.738193:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.738195:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.738202:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 35 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.738216:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 35 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.738227:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39bc00, rc 0) 00000100:00100000:1.0:1746126626.738252:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:31639:x1830945721750528:12345-192.168.203.2@tcp:101:cat.0 Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.738258:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14192 00000100:00100000:0.0:1746126626.745937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.745985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.746086:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721750784 00000100:00100000:3.0:1746126626.746093:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721750784 00000100:00100000:3.0:1746126626.746133:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721750656 00000100:00100000:3.0:1746126626.746135:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721750656 00000100:00100000:3.0:1746126626.746155:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14193 00000100:00100000:3.0:1746126626.746162:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+35:31633:x1830945721750784:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126626.746175:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.746190:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eca7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.746205:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14194 00010000:00010000:3.0:1746126626.746211:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.746220:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 6 pid: 9686 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126626.746220:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31631:x1830945721750656:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126626.746226:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.746231:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.746232:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.746234:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.746235:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [1064960->1658879] (req 1064960->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.746249:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eca0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.746258:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.746267:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 36 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.746271:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126626.746277:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 27 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126626.746278:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721477248:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.746288:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746126626.746291:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.746321:0:23766:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 27 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.746333:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.746342:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dfd7000, rc 0) 00010000:00010000:3.0:1746126626.746353:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 6 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.746362:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 6 pid: 9686 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746126626.746369:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721477504:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.746376:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31631:x1830945721750656:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 163us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.746382:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14194 00010000:00010000:3.0:1746126626.746398:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 26 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.746405:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 26 pid: 4640 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746126626.746413:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721477632:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.746429:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.749188:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721750400:12345-192.168.203.2@tcp:4:cat.0 Request processed in 11787us (17574us total) trans 21474840471 rc 0/0 00000100:00100000:2.0:1746126626.749199:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1871 00002000:00100000:2.0:1746126626.749208:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3334144->3551231) req@ffff88009204e680 x1830945721750400/t21474840471(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.749218:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204e680 with x1830945721750400 ext(3334144->3551231) 00010000:00010000:2.0:1746126626.749227:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 37 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.749238:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 37 pid: 8437 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.749245:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009204e680 00000100:00100000:0.0:1746126626.752499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.752520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.752545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.752778:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721751168 00000100:00100000:2.0:1746126626.752789:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721751168 00010000:00010000:2.0:1746126626.752867:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746126626.752898:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721477248:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.752908:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721477504:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.752916:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721477632:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.752943:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [1064960->1658879] (req 1064960->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.752957:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c336400, rc 0) 00000100:00100000:3.0:1746126626.753003:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+37:31633:x1830945721750784:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6833us (7065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.753010:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14193 00000100:00100000:3.0:1746126626.753064:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721751040 00000100:00100000:3.0:1746126626.753069:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721751040 00002000:00100000:3.0:1746126626.753097:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009204ca80 x1830945721751040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.753105:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ca80 with x1830945721751040 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.753109:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204ca80 00000100:00100000:3.0:1746126626.753122:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8116 00000100:00100000:3.0:1746126626.753127:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721751040:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126626.753328:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721751296 00000100:00100000:2.0:1746126626.753332:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721751296 00010000:00010000:2.0:1746126626.753347:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 7 pid: 9686 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.753365:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7428 00000100:00100000:2.0:1746126626.753371:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721751168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.753384:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.753404:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.753415:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.753437:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fcda00/0xb50e825867614f4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea4d expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.753457:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.753493:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721751168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 122us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.753655:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7428 00000100:00100000:2.0:1746126626.753668:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7429 00000100:00100000:2.0:1746126626.753673:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721751296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.753680:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.753688:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 7 pid: 9686 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.753696:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 7 pid: 9686 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.753865:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b210e00/0xb50e82586761506a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eaf5 expref: 7 pid: 9686 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.753875:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.753893:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721751296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 220us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.753898:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7429 00000100:00100000:0.0:1746126626.754910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.754941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.755062:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721751424 00000100:00100000:2.0:1746126626.755067:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721751424 00010000:00010000:2.0:1746126626.755085:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.755101:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721751552 00000100:00100000:2.0:1746126626.755103:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721751552 00010000:00010000:2.0:1746126626.755112:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 37 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.755130:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7430 00000100:00100000:2.0:1746126626.755135:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721751424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.755145:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.755156:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.755164:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.755178:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c892000/0xb50e825867614f21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea23 expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.755188:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.755190:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.755196:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.755203:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.755234:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.755245:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721477760:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.755299:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098d7f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.755318:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7431 00000100:00100000:2.0:1746126626.755323:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+37:1966:x1830945721751552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.755330:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126626.755337:0:7072:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126625 -> 1746126626 00010000:00010000:2.0:1746126626.755342:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 37 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.755349:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 37 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.755360:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc4b200/0xb50e82586761523f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [3334144->4194303] (req 3334144->3551231) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec29 expref: 37 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.755369:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.755370:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.755375:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.755381:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.755398:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.755407:0:7072:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.755420:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721477888:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.755447:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.761018:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721751040:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 7883us (8519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126626.761029:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8116 00002000:00100000:3.0:1746126626.761038:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88009204ca80 x1830945721751040/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.761047:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204ca80 with x1830945721751040 ext(2097152->3145727) 00002000:00010000:3.0:1746126626.761053:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204ca80 00000100:00100000:3.0:1746126626.761884:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721477760:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126626.761899:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126626.761939:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721751424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6803us (7031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.761946:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7430 00000100:00100000:2.0:1746126626.762263:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7072:1830945721477888:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.762281:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.762323:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+34:1966:x1830945721751552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6997us (7379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.762333:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7431 00000100:00100000:0.0:1746126626.763071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.763133:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721751808 00000100:00100000:3.0:1746126626.763140:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721751808 00002000:00100000:3.0:1746126626.763169:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1064960->1069055) req@ffff8800918e8700 x1830945721751808/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.763176:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8700 with x1830945721751808 ext(1064960->1069055) 00002000:00010000:3.0:1746126626.763181:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918e8700 00000100:00100000:3.0:1746126626.763206:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8117 00000100:00100000:3.0:1746126626.763213:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721751808:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126626.763358:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721751808:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 145us (288us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126626.763363:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8117 00002000:00100000:3.0:1746126626.763368:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1064960->1069055) req@ffff8800918e8700 x1830945721751808/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.763374:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8700 with x1830945721751808 ext(1064960->1069055) 00002000:00010000:3.0:1746126626.763377:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918e8700 00000100:00100000:0.0:1746126626.764001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.764051:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721752064 00000100:00100000:3.0:1746126626.764055:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721752064 00002000:00100000:3.0:1746126626.764068:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800918e8380 x1830945721752064/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.764074:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8380 with x1830945721752064 ext(3145728->4194303) 00010000:00010000:3.0:1746126626.764081:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.764092:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.764097:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918e8380 00000100:00100000:3.0:1746126626.764106:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1872 00000100:00100000:3.0:1746126626.764111:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721752064:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126626.781198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.782335:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721752192 00000100:00100000:3.0:1746126626.782343:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721752192 00000100:00100000:3.0:1746126626.782376:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14195 00000100:00100000:3.0:1746126626.782383:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:31639:x1830945721752192:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.782397:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.782410:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecae expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.782431:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.782436:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.782441:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126626.782444:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.782474:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 27 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.782484:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.782494:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c337800, rc 0) 00000100:00100000:3.0:1746126626.782534:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27c713d7-92e0-4974-b612-500c641c1d6c+35:31639:x1830945721752192:12345-192.168.203.2@tcp:101:cat.0 Request processed in 151us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.782539:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14195 00000100:00100000:0.0:1746126626.786496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.786526:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721752448 00000100:00100000:0.0:1746126626.786532:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721752448 00002000:00100000:0.0:1746126626.786560:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1654784->1658879) req@ffff8800918e8a80 x1830945721752448/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126626.786569:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8a80 with x1830945721752448 ext(1654784->1658879) 00002000:00010000:0.0:1746126626.786574:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918e8a80 00000100:00100000:0.0:1746126626.786597:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8118 00000100:00100000:0.0:1746126626.786602:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721752448:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126626.786727:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1965:x1830945721752448:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 124us (237us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126626.786734:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8118 00002000:00100000:0.0:1746126626.786739:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x31f:0x0] (1654784->1658879) req@ffff8800918e8a80 x1830945721752448/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126626.786746:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8a80 with x1830945721752448 ext(1654784->1658879) 00002000:00010000:0.0:1746126626.786748:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918e8a80 00000100:00100000:2.0:1746126626.795270:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721752064:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 31146us (31265us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126626.795940:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1872 00002000:00100000:2.0:1746126626.795954:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff8800918e8380 x1830945721752064/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.795962:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918e8380 with x1830945721752064 ext(3145728->4194303) 00010000:00010000:2.0:1746126626.795973:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.795987:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.796001:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918e8380 00000100:00100000:0.0:1746126626.812658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.813795:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721752704 00000100:00100000:2.0:1746126626.813806:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721752704 00002000:00100000:2.0:1746126626.813902:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4337663) req@ffff8800918eb100 x1830945721752704/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.813918:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eb100 with x1830945721752704 ext(4194304->4337663) 00010000:00010000:2.0:1746126626.813929:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.813943:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.813950:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eb100 00000100:00100000:3.0:1746126626.818678:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1873 00000100:00100000:3.0:1746126626.818698:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721752704:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126626.823087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.824000:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721752832 00000100:00100000:1.0:1746126626.824011:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721752832 00000100:00100000:1.0:1746126626.824065:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9090 00000100:00100000:1.0:1746126626.824072:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31641:x1830945721752832:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126626.824103:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.824123:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e8258676152e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecb5 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.824182:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824194:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824204:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824216:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824221:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824226:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824338:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824349:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 17 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.824355:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 232 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.824362:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.824391:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 232 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.824401:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 232 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.824411:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721478144:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.824505:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 17 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.824512:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 17 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.824520:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721478272:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.824538:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.829433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.829475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.829952:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721752704:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 11260us (17300us total) trans 0 rc 143360/143360 00000100:00100000:3.0:1746126626.829964:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1873 00002000:00100000:3.0:1746126626.829976:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4337663) req@ffff8800918eb100 x1830945721752704/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 143360/143360 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.829985:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eb100 with x1830945721752704 ext(4194304->4337663) 00010000:00010000:3.0:1746126626.830004:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.830018:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.830026:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eb100 00000100:00100000:0.0:1746126626.830471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.830563:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721478144:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.830573:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721478272:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.830598:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126626.830608:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721752960 00000100:00100000:2.0:1746126626.830615:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721752960 00000100:00100000:2.0:1746126626.830645:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753088 00000100:00100000:2.0:1746126626.830648:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753088 00000100:00100000:2.0:1746126626.830661:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14196 00000100:00100000:2.0:1746126626.830667:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721752960:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126626.830669:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14197 00000100:00100000:3.0:1746126626.830674:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721753088:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126626.830681:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.830681:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.830695:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c337e00/0xb50e82586761530a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecc3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.830695:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918fd600/0xb50e825867615303 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecbc expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.830713:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.830722:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c337e00/0xb50e82586761530a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecc3 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.830730:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c337e00/0xb50e82586761530a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecc3 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126626.830738:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721478400:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126626.830752:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c337e00, rc 0) 00000100:00100000:2.0:1746126626.830798:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.830812:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753344 00000100:00100000:2.0:1746126626.830815:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753344 00000100:00100000:2.0:1746126626.830851:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3874 00000100:00100000:2.0:1746126626.830856:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f02cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+233:27349:x1830945721753344:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126626.831179:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721753088:12345-192.168.203.2@tcp:101:cat.0 Request processed in 503us (1701us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126626.831185:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14197 00000100:00100000:1.0:1746126626.831425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.831468:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753472 00000100:00100000:3.0:1746126626.831471:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753472 00010000:00010000:3.0:1746126626.831489:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 18 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.831518:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7432 00000100:00100000:3.0:1746126626.831523:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:1963:x1830945721753472:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126626.831535:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126626.831540:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 18 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.831549:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 18 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.831567:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8200/0xb50e82586761528c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec6f expref: 18 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.831578:0:7072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126626.831581:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126626.831589:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126626.831594:0:7072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126626.831598:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126626.831617:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:1963:x1830945721753472:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.831622:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7432 00000100:00100000:2.0:1746126626.833340:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f02cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+234:27349:x1830945721753344:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 2476us (2861us total) trans 8589943295 rc 0/0 00000100:00100000:2.0:1746126626.833350:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3874 00002000:00010000:2.0:1746126626.835694:0:20294:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime: 1746126620 -> 1746126626 00000100:00100000:0.0:1746126626.835942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.835985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00002000:00010000:2.0:1746126626.836002:0:20294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime: 1746126618 -> 1746126626 00002000:00010000:2.0:1746126626.836005:0:20294:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime: 1746126620 -> 1746126626 00000100:00100000:2.0:1746126626.836027:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721478400:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126626.836065:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918fd600/0xb50e825867615303 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecbc expref: 27 pid: 20294 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126626.836072:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753600 00000100:00100000:1.0:1746126626.836078:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753600 00010000:00010000:2.0:1746126626.836079:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918fd600/0xb50e825867615303 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecbc expref: 27 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.836089:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fd600, rc 0) 00010000:00010000:1.0:1746126626.836106:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 234 pid: 20362 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.836126:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753728 00000100:00100000:1.0:1746126626.836128:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753728 00000100:00100000:2.0:1746126626.836129:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721752960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5462us (6707us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.836136:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14196 00010000:00010000:1.0:1746126626.836137:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 27 pid: 20294 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.836149:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7433 00000100:00100000:1.0:1746126626.836154:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+234:1966:x1830945721753600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746126626.836158:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7434 00000100:00100000:2.0:1746126626.836163:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721753728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.836166:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.836169:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.836171:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 234 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.836179:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.836180:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 234 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.836188:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.836199:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb8400/0xb50e8258676152a1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec76 expref: 234 pid: 20362 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.836200:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e8258676152c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec92 expref: 26 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.836211:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.836213:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.836215:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.836216:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.836221:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.836223:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.836229:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.836229:0:7892:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836245:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.836262:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+233:1966:x1830945721753600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.836267:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7433 00010000:00010000:1.0:1746126626.836286:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836292:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126626.836332:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:1.0:1746126626.836337:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746126626.836351:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836361:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836370:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836376:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836381:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836386:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e39b000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126626.836390:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836396:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836405:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:1.0:1746126626.836407:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126626.836410:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836414:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39b000/0xb50e8258676152ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836422:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836427:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836431:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836436:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e39a200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746126626.836438:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836442:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836448:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e215d00) 00010000:00010000:1.0:1746126626.836449:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126626.836452:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836456:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a200/0xb50e8258676152f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.836486:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39ac00/0xb50e8258676152e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.836497:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.836502:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126626.836504:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126626.836506:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a400, rc 0) 00000100:00100000:1.0:1746126626.836528:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31641:x1830945721752832:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 12457us (13453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.836534:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9090 00010000:00010000:2.0:1746126626.838344:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 25 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.838363:0:7073:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.838377:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721478528:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.843007:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.844160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.844190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.845897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.846259:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753984 00000100:00100000:2.0:1746126626.846268:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753984 00000100:00100000:2.0:1746126626.846308:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721753856 00000100:00100000:2.0:1746126626.846311:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721753856 00000100:00100000:3.0:1746126626.846373:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721754112 00000100:00100000:3.0:1746126626.846377:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721754112 00000100:00100000:2.0:1746126626.846538:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14198 00000100:00100000:2.0:1746126626.846546:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31638:x1830945721753984:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126626.846565:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.846582:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecd1 expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.846613:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.846616:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.846624:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 27 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.846638:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 27 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.846649:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fce00, rc 0) 00000100:00100000:2.0:1746126626.846692:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31638:x1830945721753984:12345-192.168.203.2@tcp:101:cat.0 Request processed in 147us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.846698:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14198 00000100:00100000:2.0:1746126626.846714:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14199 00000100:00100000:2.0:1746126626.846719:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721753856:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126626.846724:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.846730:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918fd200/0xb50e825867615318 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecca expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.846767:0:20294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008daba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721478656:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126626.846809:0:20294:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.846853:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721478528:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126626.846868:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.846885:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721753728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 10722us (10900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.846893:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7434 00000100:00100000:1.0:1746126626.848572:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14200 00000100:00100000:1.0:1746126626.848586:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721754112:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126626.848600:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.848613:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39be00/0xb50e82586761531f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecd8 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.848639:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39be00/0xb50e82586761531f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd8 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.848647:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39be00/0xb50e82586761531f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd8 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.848660:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39be00, rc 0) 00000100:00100000:1.0:1746126626.848693:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721754112:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 111us (2800us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.848699:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14200 00000100:00100000:1.0:1746126626.849676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.850005:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721754368 00000100:00100000:3.0:1746126626.850013:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721754368 00002000:00100000:3.0:1746126626.850052:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3956736->3960831) req@ffff8800920bea00 x1830945721754368/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.850061:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bea00 with x1830945721754368 ext(3956736->3960831) 00010000:00010000:3.0:1746126626.850070:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 26 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.850081:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 26 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.850087:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920bea00 00000100:00100000:3.0:1746126626.850115:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1874 00000100:00100000:3.0:1746126626.850121:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721754368:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.850270:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721754368:12345-192.168.203.2@tcp:3:cat.0 Request processed in 148us (595us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126626.850276:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1874 00002000:00100000:3.0:1746126626.850282:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3956736->3960831) req@ffff8800920bea00 x1830945721754368/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.850289:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920bea00 with x1830945721754368 ext(3956736->3960831) 00010000:00010000:3.0:1746126626.850294:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 26 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.850303:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 26 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.850308:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920bea00 00000100:00100000:2.0:1746126626.851044:0:20294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008daba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20294:1830945721478656:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126626.851074:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918fd200/0xb50e825867615318 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecca expref: 7 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.851085:0:20294:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918fd200/0xb50e825867615318 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecca expref: 7 pid: 20294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.851095:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fd200, rc 0) 00000100:00100000:2.0:1746126626.851372:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721753856:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 4651us (7179us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.851379:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14199 00000100:00100000:2.0:1746126626.861469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.861517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.861560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.861601:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755136 00000100:00100000:2.0:1746126626.861610:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755136 00002000:00100000:2.0:1746126626.861655:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4337663) req@ffff88008dab8e00 x1830945721755136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.861666:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8e00 with x1830945721755136 ext(4194304->4337663) 00002000:00010000:2.0:1746126626.861671:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab8e00 00000100:00100000:2.0:1746126626.861697:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755008 00000100:00100000:2.0:1746126626.861700:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755008 00002000:00100000:2.0:1746126626.861710:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3956736->4194303) req@ffff88008dabb480 x1830945721755008/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.861716:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb480 with x1830945721755008 ext(3956736->4194303) 00010000:00010000:2.0:1746126626.861724:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.861737:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 27 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746126626.861743:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dabb480 00000100:00100000:2.0:1746126626.861755:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1875 00000100:00100000:2.0:1746126626.861761:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721755008:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126626.862121:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8119 00000100:00100000:2.0:1746126626.862126:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721755136:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126626.862223:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.862531:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721754752 00000100:00100000:2.0:1746126626.862535:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721754752 00000100:00100000:2.0:1746126626.862561:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9091 00000100:00100000:2.0:1746126626.862565:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31641:x1830945721754752:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126626.862576:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.862593:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc400/0xb50e825867615326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecdf expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126626.862736:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721754880 00000100:00100000:3.0:1746126626.862740:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721754880 00000100:00100000:3.0:1746126626.862769:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14201 00000100:00100000:3.0:1746126626.862775:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31631:x1830945721754880:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126626.862782:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126626.862793:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ece6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.862812:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.862821:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.862849:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.862860:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.862863:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126626.862866:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [3145728->3928063] (req 3145728->3928063) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.862896:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 27 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.862906:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 27 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.862917:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721478784:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.862981:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126626.862989:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 8 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746126626.863009:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721478912:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126626.863038:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 35 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126626.863045:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.863056:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721479040:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126626.863071:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920849c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746126626.863972:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.863987:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.864001:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.864023:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.864030:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 14 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.864039:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721479168:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.865259:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746126626.865449:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746126626.870788:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721755136:12345-192.168.203.2@tcp:3:cat.0 Request processed in 8650us (9258us total) trans 0 rc 143360/143360 00000100:00100000:2.0:1746126626.872560:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8119 00002000:00100000:2.0:1746126626.872577:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4337663) req@ffff88008dab8e00 x1830945721755136/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 143360/143360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.872586:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dab8e00 with x1830945721755136 ext(4194304->4337663) 00002000:00010000:2.0:1746126626.872592:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dab8e00 00000100:00100000:0.0:1746126626.873484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.873500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.873517:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755520 00000100:00100000:0.0:1746126626.873523:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755520 00010000:00010000:0.0:1746126626.873550:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.873576:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755392 00000100:00100000:0.0:1746126626.873578:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755392 00010000:00010000:0.0:1746126626.873587:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746126626.873600:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7435 00000100:00100000:0.0:1746126626.873606:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1963:x1830945721755520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126626.873616:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126626.873621:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.873630:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.873646:0:11130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00000100:00100000:1.0:1746126626.873739:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7436 00000100:00100000:1.0:1746126626.873750:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721755392:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.873764:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.873788:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.873799:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.873820:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.873891:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1963:x1830945721755392:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 143us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.873898:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7436 00000100:00100000:1.0:1746126626.873954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.873969:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755648 00000100:00100000:1.0:1746126626.873974:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755648 00010000:00010000:1.0:1746126626.873988:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 28 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.874019:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7437 00000100:00100000:1.0:1746126626.874024:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721755648:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.874030:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.874037:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 28 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.874045:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 28 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.874057:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.874071:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721755648:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.874076:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7437 00010000:00010000:2.0:1746126626.874441:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c29400/0xb50e8258676151a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebd5 expref: 27 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.874457:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721478784:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.874466:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb29600/0xb50e8258676151f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec0d expref: 8 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.874475:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721478912:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.874483:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830945721479040:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.874511:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->3928063] (req 3145728->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.874525:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c336c00, rc 0) 00000100:00100000:2.0:1746126626.874545:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:31631:x1830945721754880:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 11770us (13086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.874551:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14201 00010000:00010000:2.0:1746126626.874579:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e39a400/0xb50e8258676152fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecb5 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.874589:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721479168:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.875576:0:11130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.875592:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.875599:0:11130:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.875613:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746126626.875619:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126626.875624:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.875629:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126626.875648:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000100:00100000:0.0:1746126626.875658:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1963:x1830945721755520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2049us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.875666:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7435 00000100:00100000:0.0:1746126626.875722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.875737:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755776 00000100:00100000:0.0:1746126626.875741:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755776 00010000:00010000:0.0:1746126626.875755:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.875773:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7438 00000100:00100000:0.0:1746126626.875778:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721755776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126626.875786:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.875791:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc400/0xb50e825867615326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecdf expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.875801:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.875805:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecdf expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.875809:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.875813:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.875815:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126626.875817:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fc200, rc 0) 00010000:00010000:0.0:1746126626.875824:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c336e00/0xb50e82586761519e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebce expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.875851:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.875853:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.875858:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.875865:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.875866:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31641:x1830945721754752:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 13299us (13649us total) trans 8589943296 rc 0/0 00000100:00100000:2.0:1746126626.875873:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9091 00010000:00010000:0.0:1746126626.875891:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126626.875902:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721479296:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126626.875941:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746126626.878678:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721755008:12345-192.168.203.2@tcp:4:cat.0 Request processed in 16906us (17107us total) trans 21474840472 rc 0/0 00000100:00100000:3.0:1746126626.878689:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1875 00002000:00100000:3.0:1746126626.878700:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3956736->4194303) req@ffff88008dabb480 x1830945721755008/t21474840472(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.878710:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabb480 with x1830945721755008 ext(3956736->4194303) 00010000:00010000:3.0:1746126626.878720:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 28 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.878735:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 28 pid: 23766 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.878742:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008dabb480 00000100:00100000:1.0:1746126626.880561:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11130:1830945721479296:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126626.880582:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.880616:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721755776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4838us (4893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.880626:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7438 00000100:00100000:0.0:1746126626.895576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.900047:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721755904 00000100:00100000:2.0:1746126626.900062:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721755904 00000100:00100000:2.0:1746126626.900124:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14202 00000100:00100000:2.0:1746126626.900132:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721755904:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126626.900150:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.900169:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918fc000/0xb50e825867615342 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eced expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.900223:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721479424:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126626.900304:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.900441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.900489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.900502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.900514:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721756032 00000100:00100000:1.0:1746126626.900517:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721756032 00000100:00100000:1.0:1746126626.900532:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721756160 00000100:00100000:1.0:1746126626.900533:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721756160 00000100:00100000:1.0:1746126626.900540:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721756288 00000100:00100000:1.0:1746126626.900541:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721756288 00000100:00100000:1.0:1746126626.900550:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14203 00000100:00100000:1.0:1746126626.900555:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721756032:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.900561:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.900567:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e825867615349 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecf4 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.900589:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721479552:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126626.900608:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.900621:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14204 00000100:00100000:1.0:1746126626.900625:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721756160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.900630:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.900635:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a200/0xb50e825867615350 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ecfb expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.900649:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a200/0xb50e825867615350 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecfb expref: 31 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.900658:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a200/0xb50e825867615350 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecfb expref: 31 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.900677:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a200, rc 0) 00000100:00100000:1.0:1746126626.900693:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721756160:12345-192.168.203.2@tcp:101:cat.0 Request processed in 67us (203us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.900698:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14204 00000100:00100000:1.0:1746126626.900713:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14205 00000100:00100000:1.0:1746126626.900716:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721756288:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126626.900720:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.900724:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e825867615357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed02 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.900733:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e825867615357 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed02 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.900740:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b200/0xb50e825867615357 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed02 expref: 9 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.900745:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b200, rc 0) 00000100:00100000:1.0:1746126626.900753:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721756288:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 37us (251us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.900757:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14205 00000100:00100000:1.0:1746126626.900780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.900791:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721756416 00000100:00100000:1.0:1746126626.900793:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721756416 00000100:00100000:1.0:1746126626.900806:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14206 00000100:00100000:1.0:1746126626.900810:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721756416:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126626.900817:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.900847:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e82586761535e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed09 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.900874:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721479680:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126626.900920:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.900971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.901090:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721756672 00000100:00100000:3.0:1746126626.901094:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721756672 00002000:00100000:3.0:1746126626.901124:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3923968->3928063) req@ffff880093af6d80 x1830945721756672/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.901133:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6d80 with x1830945721756672 ext(3923968->3928063) 00002000:00010000:3.0:1746126626.901137:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af6d80 00000100:00100000:3.0:1746126626.901149:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8120 00000100:00100000:3.0:1746126626.901153:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721756672:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126626.901296:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721756672:12345-192.168.203.2@tcp:3:cat.0 Request processed in 141us (325us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126626.901301:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8120 00002000:00100000:3.0:1746126626.901305:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3923968->3928063) req@ffff880093af6d80 x1830945721756672/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/4536 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.901312:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af6d80 with x1830945721756672 ext(3923968->3928063) 00002000:00010000:3.0:1746126626.901315:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093af6d80 00000100:00100000:0.0:1746126626.902866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.903176:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721756800 00000100:00100000:2.0:1746126626.903188:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721756800 00010000:00010000:2.0:1746126626.903225:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 30 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.903283:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7439 00000100:00100000:2.0:1746126626.903292:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721756800:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.903307:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126626.903327:0:11130:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126625 -> 1746126626 00010000:00010000:2.0:1746126626.903335:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 30 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.903348:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 30 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.903371:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dfd7000/0xb50e8258676152d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [3956736->4194303] (req 3956736->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca0 expref: 30 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.903389:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.903390:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.903397:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.903406:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.903436:0:11130:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.903447:0:11130:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721479808:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126626.903527:0:11130:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.912225:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830945721479424:192.168.203.2@tcp:106: 00010000:00010000:2.0:1746126626.912273:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918fc000/0xb50e825867615342 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eced expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.912290:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918fc000/0xb50e825867615342 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eced expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.912316:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fc000, rc 0) 00000100:00100000:2.0:1746126626.912391:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721755904:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 12258us (16826us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126626.912402:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14202 00000100:00100000:2.0:1746126626.918985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.919025:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721757056 00000100:00100000:2.0:1746126626.919034:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721757056 00000100:00100000:2.0:1746126626.919079:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3875 00000100:00100000:2.0:1746126626.919086:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+17:31631:x1830945721757056:12345-192.168.203.2@tcp:35:multiop.0 00000100:00100000:3.0:1746126626.919242:0:11130:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11130:1830945721479808:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126626.919263:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.919307:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31631:x1830945721757056:12345-192.168.203.2@tcp:35:multiop.0 Request processed in 221us (331us total) trans 8589943297 rc 0/0 00000100:00100000:2.0:1746126626.919313:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3875 00000100:00100000:3.0:1746126626.919395:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721756800:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 16103us (16534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126626.919405:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7439 00002000:00010000:0.0:1746126626.919763:0:4642:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime: 1746126625 -> 1746126626 00002000:00010000:0.0:1746126626.919767:0:4642:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126625 -> 1746126626 00002000:00010000:0.0:1746126626.919769:0:4642:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime: 1746126625 -> 1746126626 00000100:00100000:0.0:1746126626.919785:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721479680:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126626.919813:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e82586761535e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed09 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.919824:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39b000/0xb50e82586761535e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed09 expref: 9 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.919862:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b000, rc 0) 00000100:00100000:0.0:1746126626.919888:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721756416:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 19077us (19107us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126626.919895:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14206 00000100:00100000:1.0:1746126626.920123:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721479552:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126626.920141:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e825867615349 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecf4 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.920150:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a000/0xb50e825867615349 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecf4 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.920168:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a000, rc 0) 00000100:00100000:1.0:1746126626.920200:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721756032:12345-192.168.203.2@tcp:101:cat.0 Request processed in 19644us (19759us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.920206:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14203 00000100:00100000:2.0:1746126626.920311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.920692:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721757312 00000100:00100000:3.0:1746126626.920700:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721757312 00002000:00100000:3.0:1746126626.920734:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008dabbb80 x1830945721757312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.920743:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabbb80 with x1830945721757312 ext(3145728->4194303) 00002000:00010000:3.0:1746126626.920747:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabbb80 00000100:00100000:3.0:1746126626.920776:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8121 00000100:00100000:3.0:1746126626.920781:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721757312:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126626.930039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.930166:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721757568 00000100:00100000:2.0:1746126626.930178:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721757568 00000100:00100000:2.0:1746126626.930250:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9092 00000100:00100000:2.0:1746126626.930262:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31641:x1830945721757568:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126626.930291:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.930294:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126626.930326:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc200/0xb50e825867615334 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecdf expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.930369:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.930375:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126626.930388:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fd600/0xb50e825867615365 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed10 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.930504:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.930523:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.930533:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126626.930546:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126626.930683:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fd600/0xb50e825867615365 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.930698:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.930706:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126626.930708:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126626.930710:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fdc00, rc 0) 00000100:00100000:2.0:1746126626.930768:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:31641:x1830945721757568:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 509us (742us total) trans 8589943298 rc 0/0 00000100:00100000:2.0:1746126626.930775:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9092 00000100:00100000:1.0:1746126626.934257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.934343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.934374:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721757824 00000100:00100000:1.0:1746126626.934385:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721757824 00000100:00100000:1.0:1746126626.934436:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14207 00000100:00100000:1.0:1746126626.934446:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721757824:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126626.934467:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126626.934487:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fe80800/0xb50e82586761537a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed17 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.934548:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721479936:192.168.203.2@tcp:106: 00000100:00100000:2.0:1746126626.934803:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721757696 00000100:00100000:2.0:1746126626.934809:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721757696 00002000:00100000:2.0:1746126626.934868:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1064960->1658879) req@ffff880093af5180 x1830945721757696/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.934877:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5180 with x1830945721757696 ext(1064960->1658879) 00002000:00010000:2.0:1746126626.934882:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093af5180 00000100:00100000:2.0:1746126626.934923:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8122 00000100:00100000:2.0:1746126626.934931:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721757696:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126626.936136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.936159:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721757952 00000100:00100000:0.0:1746126626.936164:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721757952 00000100:00100000:1.0:1746126626.936424:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.939317:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14208 00000100:00100000:0.0:1746126626.939331:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721757952:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126626.939348:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126626.939365:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed1e expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.939388:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.939390:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.939398:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 30 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939412:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 30 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939422:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a400, rc 0) 00000100:00100000:0.0:1746126626.939449:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1964:x1830945721757952:12345-192.168.203.2@tcp:101:cat.0 Request processed in 123us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.939456:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14208 00000100:00100000:0.0:1746126626.939576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.939589:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758080 00000100:00100000:0.0:1746126626.939595:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758080 00000100:00100000:0.0:1746126626.939617:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14209 00000100:00100000:0.0:1746126626.939622:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721758080:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1746126626.939644:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.939656:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 29 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939669:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 6 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939676:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 38 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939681:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.939682:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.939684:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.939711:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 38 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939722:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 38 pid: 8437 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746126626.939734:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721480064:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.939794:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 6 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939802:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 6 pid: 23766 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746126626.939810:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721480192:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.939864:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 29 pid: 4640 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126626.939871:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 29 pid: 4640 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746126626.939879:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721480320:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.939897:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126626.939930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.944890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.945966:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758208 00000100:00100000:2.0:1746126626.945980:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758208 00000100:00100000:2.0:1746126626.946054:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14210 00000100:00100000:2.0:1746126626.946065:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721758208:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:2.0:1746126626.946119:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.946140:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 25 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.946148:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 34 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.946155:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.946162:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.946164:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126626.946167:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.946203:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 8 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.946215:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 8 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.946235:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721480448:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.946352:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 34 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126626.946362:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 34 pid: 23766 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.946370:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131d55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721480576:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.946432:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 25 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.946442:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.946451:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721480704:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.946477:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.946918:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+37:1964:x1830945721757312:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 26133us (26610us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126626.946927:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8121 00002000:00100000:2.0:1746126626.946939:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008dabbb80 x1830945721757312/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/440 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126626.946948:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008dabbb80 with x1830945721757312 ext(3145728->4194303) 00002000:00010000:2.0:1746126626.946953:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008dabbb80 00000100:00100000:1.0:1746126626.947317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.947364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.947446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.947459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.947473:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758336 00000100:00100000:1.0:1746126626.947478:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758336 00000100:00100000:1.0:1746126626.947496:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758464 00000100:00100000:1.0:1746126626.947498:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758464 00000100:00100000:1.0:1746126626.947509:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758592 00000100:00100000:1.0:1746126626.947511:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758592 00000100:00100000:1.0:1746126626.947518:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758720 00000100:00100000:1.0:1746126626.947520:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758720 00000100:00100000:1.0:1746126626.947532:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14211 00000100:00100000:1.0:1746126626.947537:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1963:x1830945721758336:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126626.947561:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947573:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 34 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947580:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.947591:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 25 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947596:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.947598:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.947600:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947616:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 25 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947623:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 25 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.947630:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721480832:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.947669:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 10 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.947676:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 10 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746126626.947682:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721480960:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.947699:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 34 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947709:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 34 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.947714:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721481088:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.947724:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.947739:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14212 00000100:00100000:1.0:1746126626.947744:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721758464:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126626.947769:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947778:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947783:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126626.947784:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126626.947786:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947800:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947807:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 36 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.947816:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093231c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721481216:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.947860:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.947874:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14213 00000100:00100000:1.0:1746126626.947879:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721758592:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126626.947894:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947903:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947909:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 29 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.947915:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947921:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947928:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947934:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 29 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947955:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 29 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947966:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 36 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947971:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 6 00010000:00010000:1.0:1746126626.947972:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 6 00010000:00010000:1.0:1746126626.947974:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 11/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.947989:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 36 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948005:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 36 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948013:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481344:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948037:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 29 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948045:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 29 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948052:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481472:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948070:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 29 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948081:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 29 pid: 20294 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948088:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481600:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948105:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948113:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948119:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481728:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948136:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948142:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 36 pid: 20294 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948149:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481856:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948164:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948171:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948181:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481984:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948200:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 29 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.948207:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 29 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746126626.948214:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721482112:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.948230:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948236:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 36 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948242:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721482240:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.948254:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126626.948357:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830945721479936:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126626.948380:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fe80800/0xb50e82586761537a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed17 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.948389:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fe80800/0xb50e82586761537a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed17 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126626.948408:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fe80800, rc 0) 00000100:00100000:1.0:1746126626.948422:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721757824:12345-192.168.203.2@tcp:101:cat.0 Request processed in 13979us (14082us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126626.948427:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14207 00000100:00100000:1.0:1746126626.948441:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14214 00000100:00100000:1.0:1746126626.948446:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721758720:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126626.948461:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948469:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948475:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126626.948476:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126626.948478:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948490:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.948498:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 25 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.948505:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091da2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721482368:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.948519:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.950152:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721758976 00000100:00100000:2.0:1746126626.950162:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721758976 00000100:00100000:2.0:1746126626.951115:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9093 00000100:00100000:2.0:1746126626.951124:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+233:31643:x1830945721758976:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126626.951144:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126626.951159:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fcc00/0xb50e8258676153b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed25 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.951243:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.951255:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.951261:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126626.951287:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126626.951295:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 14 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.951305:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721482496:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.951367:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126626.953640:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721480064:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.953652:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721480192:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.953660:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:4642:1830945721480320:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.953687:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.961453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.961745:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dabb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721480448:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.972558:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091da2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721482368:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.972587:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.972675:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721480832:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.972702:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093230380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721480960:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126626.972724:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721481088:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.972738:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.972773:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093231c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721481216:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126626.972783:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126626.972933:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481344:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972941:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481472:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972947:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481600:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972953:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481728:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972959:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481856:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972965:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721481984:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972971:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721482112:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126626.972976:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f15d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721482240:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126626.973011:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.973089:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131d55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721480576:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126626.973097:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721480704:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.973133:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126626.973155:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830945721482496:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126626.973165:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126626.973197:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759488 00000100:00100000:2.0:1746126626.973204:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759488 00010000:00010000:2.0:1746126626.973233:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.973273:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7440 00000100:00100000:2.0:1746126626.973280:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+37:1965:x1830945721759488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.973294:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.973317:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.973329:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.973352:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e85e00/0xb50e825867614f36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea38 expref: 37 pid: 8437 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746126626.974404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1746126626.974421:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126626.974432:0:20294:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760128 00000100:00100000:0.0:1746126626.974439:0:20294:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760128 00000100:00100000:2.0:1746126626.974469:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+36:1965:x1830945721759488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1186us (13026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.974477:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7440 00000100:00100000:0.0:1746126626.975332:0:20294:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14215 00000100:00100000:0.0:1746126626.975345:0:20294:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+35:31639:x1830945721760128:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126626.975360:0:20294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126626.975375:0:20294:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed2c expref: -99 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.975396:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126626.975399:0:20294:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.975404:0:20294:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126626.975408:0:20294:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.975421:0:20294:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.975430:0:20294:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 36 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.975438:0:20294:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a800, rc 0) 00000100:00100000:0.0:1746126626.975585:0:20294:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27c713d7-92e0-4974-b612-500c641c1d6c+36:31639:x1830945721760128:12345-192.168.203.2@tcp:101:cat.0 Request processed in 242us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.975590:0:20294:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14215 00000100:00100000:0.0:1746126626.975629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.975687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.978201:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760000 00000100:00100000:1.0:1746126626.978213:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760000 00002000:00100000:1.0:1746126626.978251:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3928063) req@ffff880099251180 x1830945721760000/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/0 e 0 to 0 dl 1746126637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126626.978260:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251180 with x1830945721760000 ext(3145728->3928063) 00010000:00010000:1.0:1746126626.978269:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.978280:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746126626.978297:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099251180 00000100:00100000:1.0:1746126626.978316:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1876 00000100:00100000:1.0:1746126626.978325:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721760000:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1746126626.981030:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721757696:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 46090us (46775us total) trans 21474840473 rc 0/0 00000100:00100000:3.0:1746126626.981041:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8122 00002000:00100000:3.0:1746126626.981051:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1064960->1658879) req@ffff880093af5180 x1830945721757696/t21474840473(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126626.981061:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093af5180 with x1830945721757696 ext(1064960->1658879) 00010000:00010000:3.0:1746126626.981070:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 36 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.981081:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 36 pid: 8437 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126626.981087:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093af5180 00000100:00100000:1.0:1746126626.982591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.982858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126626.983068:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760384 00000100:00100000:0.0:1746126626.983079:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760384 00000100:00100000:2.0:1746126626.984384:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760256 00000100:00100000:2.0:1746126626.984394:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760256 00000100:00100000:1.0:1746126626.985165:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761280 00000100:00100000:1.0:1746126626.985170:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761280 00000100:00100000:3.0:1746126626.985257:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.985282:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126626.985295:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759232 00000100:00100000:3.0:1746126626.985298:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759232 00010000:00010000:0.0:1746126626.985891:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.985924:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759616 00000100:00100000:0.0:1746126626.985929:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759616 00010000:00010000:2.0:1746126626.986641:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 36 pid: 23766 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746126626.986676:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7441 00000100:00100000:2.0:1746126626.986686:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1966:x1830945721760384:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.986699:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.986723:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.986734:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.986757:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e442e00/0xb50e825867615166 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eba4 expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.986780:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.986840:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721760384:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 141us (11136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.986848:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7441 00000100:00100000:2.0:1746126626.986867:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7442 00000100:00100000:2.0:1746126626.986872:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+36:1966:x1830945721760256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.986878:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.986885:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 36 pid: 23766 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.986893:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 36 pid: 23766 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.986912:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc4bc00/0xb50e825867615246 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec30 expref: 36 pid: 23766 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746126626.986920:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.986935:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1966:x1830945721760256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 63us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.986940:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7442 00000100:00100000:2.0:1746126626.987048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.987059:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759872 00000100:00100000:2.0:1746126626.987063:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759872 00010000:00010000:2.0:1746126626.987076:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.987092:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7443 00000100:00100000:2.0:1746126626.987096:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1964:x1830945721759872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.987104:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.987119:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.987126:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.987140:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a02600/0xb50e8258676152bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec8b expref: 29 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.987148:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.987163:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1964:x1830945721759872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 66us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126626.987168:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7443 00010000:00010000:3.0:1746126626.988148:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746126626.988156:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.988185:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7444 00000100:00100000:3.0:1746126626.988193:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1964:x1830945721759232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126626.988198:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7445 00010000:00010000:3.0:1746126626.988201:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126626.988208:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721759616:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126626.988213:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746126626.988220:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126626.988222:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746126626.988237:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64200/0xb50e825867614f0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea0e expref: 27 pid: 4640 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746126626.988237:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.988246:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126626.988257:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126626.988265:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c892600/0xb50e82586761525b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec3e expref: 36 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746126626.988278:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721759232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 87us (3024us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126626.988280:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126626.988283:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7444 00000100:00100000:0.0:1746126626.988314:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721759616:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 110us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.988319:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7445 00010000:00010000:1.0:1746126626.990779:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 27 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.990822:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7446 00000100:00100000:1.0:1746126626.990846:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721761280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.990861:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.990879:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 27 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.990889:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 27 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.990907:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e443400/0xb50e825867615189 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebb9 expref: 27 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.990924:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.990962:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721761280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 123us (8106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.990971:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7446 00000100:00100000:1.0:1746126626.991092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.991110:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760640 00000100:00100000:1.0:1746126626.991116:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760640 00010000:00010000:1.0:1746126626.991137:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 26 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746126626.991160:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7447 00000100:00100000:1.0:1746126626.991166:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1964:x1830945721760640:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.991176:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.991192:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 26 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.991202:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 26 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.991217:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615381 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed1e expref: 26 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.991231:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.991255:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721760640:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 88us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.991261:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7447 00000100:00100000:1.0:1746126626.991318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.991337:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760896 00000100:00100000:1.0:1746126626.991342:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760896 00010000:00010000:1.0:1746126626.991357:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.991379:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7448 00000100:00100000:1.0:1746126626.991385:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721760896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.991394:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.991404:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.991412:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.991428:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b400/0xb50e8258676150a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 8 type: EXT [4972544->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb2d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.991439:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.991460:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721760896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.991466:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7448 00000100:00100000:1.0:1746126626.991517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.991536:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761152 00000100:00100000:1.0:1746126626.991541:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761152 00010000:00010000:1.0:1746126626.991557:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.991574:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7449 00000100:00100000:1.0:1746126626.991580:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+15:1964:x1830945721761152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.991593:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.991599:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.991606:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.991621:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fdc00/0xb50e82586761536c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed10 expref: 15 pid: 14548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.991634:0:7073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126626.991639:0:7073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.991648:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.991655:0:7073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.991680:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.991703:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1964:x1830945721761152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 122us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.991709:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7449 00010000:00010000:1.0:1746126626.991733:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126626.991741:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126626.991758:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126626.991954:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fcc00/0xb50e8258676153b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed25 expref: 236 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.991972:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed25 expref: 235 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.991978:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126626.991981:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126626.991983:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918fc800, rc 0) 00000100:00100000:1.0:1746126626.992026:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a448d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+235:31643:x1830945721758976:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 40902us (44707us total) trans 8589943299 rc 0/0 00000100:00100000:1.0:1746126626.992034:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9093 00000100:00100000:1.0:1746126626.992090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.992110:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759104 00000100:00100000:1.0:1746126626.992115:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759104 00010000:00010000:1.0:1746126626.992131:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 9 pid: 23766 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746126626.992146:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7450 00000100:00100000:1.0:1746126626.992153:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721759104:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.992161:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.992173:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 9 pid: 23766 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.992181:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 9 pid: 23766 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.992195:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135527800/0xb50e82586761504e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eae0 expref: 9 pid: 23766 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.992206:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.992208:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.992212:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992219:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992240:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126626.992255:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992263:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992282:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992289:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992295:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992301:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e39ac00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126626.992305:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992316:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992326:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992332:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39ac00/0xb50e825867615388 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.992368:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1963:x1830945721758080:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 52745us (52793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.992375:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14209 00000100:00100000:1.0:1746126626.992403:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1964:x1830945721759104:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 250us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.992409:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7450 00000100:00100000:1.0:1746126626.992553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.992573:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759360 00000100:00100000:1.0:1746126626.992577:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759360 00010000:00010000:1.0:1746126626.992594:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 11 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746126626.992610:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7451 00000100:00100000:1.0:1746126626.992616:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+11:1964:x1830945721759360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.992625:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.992639:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 11 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.992648:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 11 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.992661:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b54600/0xb50e8258676151e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebf8 expref: 11 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.992672:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.992673:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.992676:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992682:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992701:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.992720:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+10:1964:x1830945721759360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 103us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.992725:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7451 00010000:00010000:1.0:1746126626.992745:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992752:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992768:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992779:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992784:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992789:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918fc200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126626.992792:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992798:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992807:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.992813:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918fc200/0xb50e82586761538f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.992858:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721758208:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 46797us (52928us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.992864:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14210 00000100:00100000:1.0:1746126626.992903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.992913:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721759744 00000100:00100000:1.0:1746126626.992915:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721759744 00010000:00010000:1.0:1746126626.992924:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 34 pid: 20294 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.992935:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7452 00000100:00100000:1.0:1746126626.992952:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721759744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.992958:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.992966:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 34 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.992973:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 34 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.992984:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39bc00/0xb50e8258676152cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec99 expref: 34 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.993000:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.993011:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721759744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.993016:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7452 00000100:00100000:1.0:1746126626.993053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.993062:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760512 00000100:00100000:1.0:1746126626.993065:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760512 00010000:00010000:1.0:1746126626.993073:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746126626.993084:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7453 00000100:00100000:1.0:1746126626.993088:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+9:1964:x1830945721760512:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.993094:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.993103:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.993110:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.993119:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb29e00/0xb50e8258676151f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ebff expref: 9 pid: 4642 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746126626.993127:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126626.993136:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+8:1964:x1830945721760512:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 48us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.993140:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7453 00000100:00100000:1.0:1746126626.993186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.993196:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721760768 00000100:00100000:1.0:1746126626.993198:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721760768 00010000:00010000:1.0:1746126626.993207:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126626.993218:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7454 00000100:00100000:1.0:1746126626.993222:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721760768:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126626.993226:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126626.993232:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.993239:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.993252:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ada7000/0xb50e82586761515f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eb9d expref: 35 pid: 17475 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126626.993260:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.993261:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126626.993264:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993270:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993281:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126626.993292:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993298:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993310:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993315:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993321:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993330:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fe81800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126626.993333:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993339:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993347:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126626.993352:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fe81800/0xb50e825867615396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126626.993391:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+7:1963:x1830945721758336:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 45851us (48512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.993397:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14211 00000100:00100000:1.0:1746126626.993426:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721760768:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 203us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126626.993432:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7454 00000100:00100000:1.0:1746126626.993485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126626.993505:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761024 00000100:00100000:1.0:1746126626.993509:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761024 00010000:00010000:1.0:1746126626.993525:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.993544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126626.993571:0:9817:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761408 00000100:00100000:2.0:1746126626.993574:0:9817:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761408 00010000:00010000:2.0:1746126626.993588:0:9817:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 33 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.993603:0:9817:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7455 00000100:00100000:2.0:1746126626.993608:0:9817:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1964:x1830945721761024:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.993615:0:9817:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126626.993623:0:9817:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746126626.993631:0:9817:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.993639:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7456 00010000:00010000:2.0:1746126626.993644:0:9817:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c336600/0xb50e825867615262 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 6 type: EXT [4337664->18446744073709551615] (req 4337664->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec4c expref: 25 pid: 23766 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.993648:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+33:1963:x1830945721761408:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126626.993655:0:9817:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126626.993658:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126626.993667:0:9817:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721761024:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 59us (183us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126626.993671:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 33 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.993673:0:9817:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7455 00010000:00010000:0.0:1746126626.993680:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 33 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.993694:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c337800/0xb50e8258676152e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecae expref: 33 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746126626.993708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126626.993710:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126626.993719:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761536 00000100:00100000:2.0:1746126626.993722:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761536 00000100:00100000:0.0:1746126626.993728:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+32:1963:x1830945721761408:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 82us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126626.993734:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 24 pid: 20294 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746126626.993734:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7456 00000100:00100000:0.0:1746126626.993747:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7457 00000100:00100000:0.0:1746126626.993751:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1964:x1830945721761536:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126626.993758:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126626.993766:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 24 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.993773:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 24 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.993785:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918fce00/0xb50e825867615311 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ecd1 expref: 24 pid: 20294 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746126626.993799:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.993800:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126626.993804:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993809:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993867:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126626.993886:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1964:x1830945721761536:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 132us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.993892:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7457 00010000:00010000:0.0:1746126626.993914:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993922:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993938:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993945:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993951:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993960:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e36600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:0.0:1746126626.993963:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993968:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993976:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126626.993982:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e36600/0xb50e8258676153a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126626.994021:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1963:x1830945721758592:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 46141us (46574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126626.994026:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14213 00000100:00100000:0.0:1746126627.000045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.000412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.000450:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761664 00000100:00100000:1.0:1746126627.000457:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761664 00000100:00100000:1.0:1746126627.000497:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14216 00000100:00100000:1.0:1746126627.000504:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+34:31643:x1830945721761664:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126627.000576:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.000594:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed33 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126627.000613:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c721, atime: 0x6813c720, ctime: 0x6813c721, blocks: 0x821 00010000:00010000:1.0:1746126627.000630:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.000632:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.000639:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 35 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.000651:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 35 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.000658:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b93600, rc 0) 00000100:00100000:1.0:1746126627.000694:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+35:31643:x1830945721761664:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 191us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.000699:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14216 00000100:00100000:1.0:1746126627.000718:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721761792 00000100:00100000:1.0:1746126627.000720:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721761792 00010000:00010000:1.0:1746126627.000888:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 32 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126627.000906:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7458 00000100:00100000:1.0:1746126627.000911:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721761792:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126627.000922:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126627.000935:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 32 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126627.000942:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 32 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126627.000958:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c336400/0xb50e8258676152d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1658879) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eca7 expref: 32 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126627.000969:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.000970:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.000973:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.000980:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001010:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126627.001022:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001029:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001044:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001054:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001060:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001065:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e36000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126627.001067:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001073:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001081:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.001085:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e36000/0xb50e82586761539d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126627.001139:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1964:x1830945721758464:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 53393us (53772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.001144:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14212 00000100:00100000:1.0:1746126627.001166:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+31:1964:x1830945721761792:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 256us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.001171:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7458 00000100:00100000:0.0:1746126627.002726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126627.003678:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721762048 00000100:00100000:3.0:1746126627.003685:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721762048 00002000:00100000:3.0:1746126627.003714:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1581056->1585151) req@ffff88008f15c700 x1830945721762048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.003723:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15c700 with x1830945721762048 ext(1581056->1585151) 00002000:00010000:3.0:1746126627.003728:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15c700 00000100:00100000:3.0:1746126627.003756:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8123 00000100:00100000:3.0:1746126627.003763:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721762048:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126627.003909:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721762048:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 146us (1186us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126627.003916:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8123 00002000:00100000:3.0:1746126627.003920:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1581056->1585151) req@ffff88008f15c700 x1830945721762048/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.003927:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15c700 with x1830945721762048 ext(1581056->1585151) 00002000:00010000:3.0:1746126627.003930:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15c700 00000100:00100000:3.0:1746126627.006211:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721760000:12345-192.168.203.2@tcp:4:cat.0 Request processed in 27876us (30568us total) trans 17179873328 rc 0/0 00000100:00100000:3.0:1746126627.006224:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1876 00002000:00100000:3.0:1746126627.006235:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x325:0x0] (3145728->3928063) req@ffff880099251180 x1830945721760000/t17179873328(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:387/0 lens 488/448 e 0 to 0 dl 1746126637 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.006245:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099251180 with x1830945721760000 ext(3145728->3928063) 00010000:00010000:3.0:1746126627.006254:0:21464:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746126627.006269:0:21464:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746126627.006275:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099251180 00000100:00100000:0.0:1746126627.008386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126627.008552:0:21464:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721762304 00000100:00100000:3.0:1746126627.008560:0:21464:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721762304 00002000:00100000:3.0:1746126627.008594:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1622016->1626111) req@ffff88008f15d500 x1830945721762304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.008602:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15d500 with x1830945721762304 ext(1622016->1626111) 00002000:00010000:3.0:1746126627.008607:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15d500 00000100:00100000:3.0:1746126627.008629:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8124 00000100:00100000:3.0:1746126627.008635:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721762304:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126627.008771:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721762304:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 136us (391us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126627.008777:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8124 00002000:00100000:3.0:1746126627.008782:0:21464:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x323:0x0] (1622016->1626111) req@ffff88008f15d500 x1830945721762304/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.008787:0:21464:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15d500 with x1830945721762304 ext(1622016->1626111) 00002000:00010000:3.0:1746126627.008790:0:21464:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15d500 00000100:00100000:2.0:1746126627.011661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.011879:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721762432 00000100:00100000:1.0:1746126627.011892:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721762432 00010000:00010000:1.0:1746126627.011924:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746126627.011955:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7459 00000100:00100000:1.0:1746126627.011961:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1963:x1830945721762432:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126627.011972:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126627.011988:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126627.012008:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126627.012026:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c336c00/0xb50e82586761532d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3928063) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ece6 expref: 26 pid: 8437 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746126627.012038:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.012040:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.012043:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.012049:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.012079:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126627.012113:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126627.012117:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1963:x1830945721762432:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 156us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.012122:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7459 00010000:00010000:2.0:1746126627.012125:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012153:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012159:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012170:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012176:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b92800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126627.012179:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012186:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012200:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.012201:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.012209:0:8438:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012216:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.012264:0:8438:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 34 pid: 20294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.012277:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721482624:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126627.012372:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db7bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746126627.016934:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830945721482624:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126627.016964:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.016976:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b92800/0xb50e8258676153ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.017991:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1964:x1830945721758720:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 69541us (70527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.018010:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14214 00000100:00100000:0.0:1746126627.019526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.019587:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721762688 00000100:00100000:2.0:1746126627.019597:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721762688 00002000:00100000:2.0:1746126627.019642:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f15d180 x1830945721762688/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.019652:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15d180 with x1830945721762688 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.019657:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15d180 00000100:00100000:0.0:1746126627.019918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.020160:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721762944 00000100:00100000:1.0:1746126627.020167:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721762944 00000100:00080000:0.0:1746126627.020186:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126627.020201:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8125 00000100:00100000:1.0:1746126627.020225:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9094 00000100:00100000:1.0:1746126627.020231:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31641:x1830945721762944:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:1.0:1746126627.020269:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1746126627.020279:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721762688:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:1.0:1746126627.020289:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c337000/0xb50e825867615223 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec1b expref: 14 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.020379:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801367f8e00/0xb50e825867615207 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ec14 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.020388:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126627.020391:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126627.020471:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31641:x1830945721762944:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 220us (533us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746126627.020477:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9094 00000100:00100000:2.0:1746126627.023096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.024006:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721763200 00000100:00100000:0.0:1746126627.024016:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721763200 00000100:00100000:0.0:1746126627.024071:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3876 00000100:00100000:0.0:1746126627.024081:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+12:31641:x1830945721763200:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1746126627.024303:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31641:x1830945721763200:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 222us (1213us total) trans 8589943300 rc 0/0 00000100:00100000:0.0:1746126627.024311:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3876 00000100:00100000:0.0:1746126627.030415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.031688:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721763456 00000100:00100000:2.0:1746126627.031700:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721763456 00000100:00100000:2.0:1746126627.032442:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3877 00000100:00100000:2.0:1746126627.032452:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:31641:x1830945721763456:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1746126627.032686:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:31641:x1830945721763456:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 236us (2281us total) trans 8589943301 rc 0/0 00000100:00100000:2.0:1746126627.032693:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3877 00000100:00100000:2.0:1746126627.032978:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721762688:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 12700us (13458us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.032989:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8125 00002000:00100000:2.0:1746126627.033004:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008f15d180 x1830945721762688/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.033013:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15d180 with x1830945721762688 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.033018:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f15d180 00000100:00100000:1.0:1746126627.042284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.042323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.042350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.042372:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721763712 00000100:00100000:1.0:1746126627.042381:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721763712 00000100:00100000:1.0:1746126627.042416:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721763968 00000100:00100000:1.0:1746126627.042418:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721763968 00000100:00100000:1.0:1746126627.042427:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721763584 00000100:00100000:1.0:1746126627.042428:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721763584 00000100:00100000:1.0:1746126627.042440:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14217 00000100:00100000:1.0:1746126627.042447:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+35:1964:x1830945721763712:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.042463:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.042483:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed41 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126627.042509:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c721, atime: 0x6813c721, ctime: 0x6813c721, blocks: 0x821 00010000:00010000:1.0:1746126627.042529:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.042531:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.042540:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 36 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.042555:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 36 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.042565:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e37400, rc 0) 00000100:00100000:1.0:1746126627.042658:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+36:1964:x1830945721763712:12345-192.168.203.2@tcp:101:cat.0 Request processed in 209us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.042665:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14217 00000100:00100000:1.0:1746126627.042683:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14218 00000100:00100000:1.0:1746126627.042688:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721763968:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.042695:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.042705:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed4f expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126627.042720:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c722, atime: 0x6813c722, ctime: 0x6813c722, blocks: 0x163f 00010000:00010000:1.0:1746126627.042729:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.042730:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.042733:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.042745:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.042752:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e37e00, rc 0) 00000100:00100000:1.0:1746126627.042769:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721763968:12345-192.168.203.2@tcp:101:cat.0 Request processed in 81us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.042774:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14218 00000100:00100000:1.0:1746126627.042782:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14219 00000100:00100000:1.0:1746126627.042786:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+32:1964:x1830945721763584:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.042792:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.042799:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed3a expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126627.042809:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c71f, atime: 0x6813c71d, ctime: 0x6813c71f, blocks: 0x79f 00010000:00010000:1.0:1746126627.042816:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.042817:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.042821:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.042847:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 33 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.042853:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e37800, rc 0) 00000100:00100000:1.0:1746126627.042869:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721763584:12345-192.168.203.2@tcp:101:cat.0 Request processed in 82us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.042876:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14219 00000100:00100000:1.0:1746126627.042921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.042937:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721763840 00000100:00100000:1.0:1746126627.042940:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721763840 00000100:00100000:1.0:1746126627.042955:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14220 00000100:00100000:1.0:1746126627.042959:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+33:1964:x1830945721763840:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.042965:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.042975:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed48 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126627.042986:0:23766:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c722, atime: 0x6813c71a, ctime: 0x6813c722, blocks: 0x81f 00010000:00010000:1.0:1746126627.043006:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.043008:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.043013:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 34 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.043022:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 34 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.043028:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e37600, rc 0) 00000100:00100000:1.0:1746126627.043043:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721763840:12345-192.168.203.2@tcp:101:cat.0 Request processed in 84us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.043048:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14220 00000100:00100000:0.0:1746126627.047603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.047700:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721764224 00000100:00100000:2.0:1746126627.047711:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721764224 00002000:00100000:2.0:1746126627.047762:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f15e300 x1830945721764224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.047772:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15e300 with x1830945721764224 ext(4194304->4976639) 00002000:00010000:2.0:1746126627.047777:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f15e300 00000100:00100000:2.0:1746126627.048608:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8126 00000100:00100000:2.0:1746126627.048617:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721764224:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.055989:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+34:1964:x1830945721764224:12345-192.168.203.2@tcp:3:cat.0 Request processed in 7362us (8383us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126627.056011:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8126 00002000:00100000:2.0:1746126627.056023:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88008f15e300 x1830945721764224/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.056032:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f15e300 with x1830945721764224 ext(4194304->4976639) 00002000:00010000:2.0:1746126627.056038:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f15e300 00000100:00100000:1.0:1746126627.179734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.179878:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721764480 00000100:00100000:2.0:1746126627.179888:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721764480 00000100:00100000:2.0:1746126627.179932:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9095 00000100:00100000:2.0:1746126627.179939:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+18:31651:x1830945721764480:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:2.0:1746126627.179961:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126627.179979:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7800/0xb50e8258676153f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed56 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.180080:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7a00/0xb50e8258676153f8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126627.180094:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7a00/0xb50e8258676153f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126627.180106:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7a00/0xb50e8258676153f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746126627.180116:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:2.0:1746126627.180527:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7800/0xb50e8258676153f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed56 expref: 21 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.180545:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7a00/0xb50e8258676153f8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed56 expref: 20 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.180553:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126627.180556:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746126627.180559:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dc7a00, rc 0) 00000100:00100000:2.0:1746126627.180603:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31651:x1830945721764480:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 665us (883us total) trans 8589943302 rc 0/0 00000100:00100000:2.0:1746126627.180610:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9095 00000100:00100000:0.0:1746126627.212708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.212735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.212752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.212781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.214655:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721764608 00000100:00100000:1.0:1746126627.214670:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721764608 00000100:00100000:0.0:1746126627.214673:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721764736 00000100:00100000:0.0:1746126627.214678:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721764736 00000100:00100000:0.0:1746126627.214712:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721764864 00000100:00100000:0.0:1746126627.214714:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721764864 00000100:00100000:1.0:1746126627.214721:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721764992 00000100:00100000:1.0:1746126627.214726:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721764992 00000100:00100000:0.0:1746126627.214733:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14221 00000100:00100000:0.0:1746126627.214740:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+23:1965:x1830945721764736:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:1.0:1746126627.214753:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14222 00010000:00010000:0.0:1746126627.214758:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126627.214760:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31651:x1830945721764608:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126627.214771:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126627.214775:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39b000/0xb50e825867615406 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed64 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.214784:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed5d expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.214798:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.214800:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.214808:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39b000/0xb50e825867615406 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed64 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.214809:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 35 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.214817:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.214819:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.214822:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1499136->1781759] (req 1499136->1781759) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 28 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.214824:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39b000/0xb50e825867615406 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed64 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.214854:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39b000, rc 0) 00000100:00100000:1.0:1746126627.214878:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14223 00000100:00100000:1.0:1746126627.214885:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1965:x1830945721764864:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.214894:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126627.214899:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721764736:12345-192.168.203.2@tcp:101:cat.0 Request processed in 160us (2163us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126627.214901:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fe80e00/0xb50e825867615414 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed6b expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126627.214905:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14221 00010000:00010000:1.0:1746126627.214915:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746126627.214920:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14224 00000100:00100000:0.0:1746126627.214925:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721764992:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.214926:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fe80e00/0xb50e825867615414 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed6b expref: 29 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.214931:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.214936:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fe80e00/0xb50e825867615414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed6b expref: 29 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.214937:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e39aa00/0xb50e82586761541b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed72 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.214952:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fe80e00, rc 0) 00000100:00100000:0.0:1746126627.214973:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721482752:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126627.214981:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721764864:12345-192.168.203.2@tcp:101:cat.0 Request processed in 95us (2226us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126627.214986:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14223 00000100:00100000:0.0:1746126627.215038:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126627.215062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.215079:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721765120 00000100:00100000:0.0:1746126627.215082:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721765120 00000100:00100000:0.0:1746126627.215097:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14225 00000100:00100000:0.0:1746126627.215101:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+24:1965:x1830945721765120:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126627.215107:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126627.215114:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615422 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed79 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.215125:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.215126:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126627.215130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:0.0:1746126627.215131:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed79 expref: 25 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.215144:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed79 expref: 25 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.215151:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39a400, rc 0) 00000100:00100000:0.0:1746126627.215168:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721765120:12345-192.168.203.2@tcp:101:cat.0 Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.215172:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14225 00000100:00100000:0.0:1746126627.215181:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721765248 00000100:00100000:0.0:1746126627.215183:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721765248 00000100:00100000:1.0:1746126627.215186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.215239:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721765376 00000100:00100000:2.0:1746126627.215245:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721765376 00000100:00100000:2.0:1746126627.215262:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14226 00000100:00100000:2.0:1746126627.215271:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+25:1965:x1830945721765248:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126627.215280:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126627.215290:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed80 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.215302:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.215304:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.215310:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 26 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126627.215321:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 26 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126627.215329:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dc7e00, rc 0) 00000100:00100000:2.0:1746126627.215874:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1965:x1830945721765248:12345-192.168.203.2@tcp:101:cat.0 Request processed in 602us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.215881:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14226 00000100:00100000:2.0:1746126627.215922:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14227 00000100:00100000:2.0:1746126627.215928:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+29:1965:x1830945721765376:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126627.215935:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126627.215945:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed87 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.215958:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.215960:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.215966:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126627.215979:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126627.215987:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dc6000, rc 0) 00000100:00100000:2.0:1746126627.216022:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+30:1965:x1830945721765376:12345-192.168.203.2@tcp:101:cat.0 Request processed in 93us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.216027:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14227 00010000:00010000:1.0:1746126627.216887:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 35 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.216902:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 35 pid: 4641 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746126627.216913:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721482880:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126627.216958:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a540 going to sleep for 11 seconds 00002000:00010000:0.0:1746126627.234259:0:10890:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime: 1746126625 -> 1746126626 00002000:00010000:0.0:1746126627.234264:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime: 1746126624 -> 1746126626 00002000:00010000:0.0:1746126627.234266:0:10890:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime: 1746126625 -> 1746126626 00000100:00100000:0.0:1746126627.234291:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721482752:192.168.203.2@tcp:106: 00010000:00010000:0.0:1746126627.234325:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e39aa00/0xb50e82586761541b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed72 expref: 29 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.234339:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39aa00/0xb50e82586761541b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed72 expref: 29 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126627.234349:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e39aa00, rc 0) 00000100:00100000:1.0:1746126627.234508:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721482880:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126627.234529:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1499136->1781759] (req 1499136->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 28 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.234541:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fe80800, rc 0) 00000100:00100000:1.0:1746126627.234577:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31651:x1830945721764608:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 19817us (21878us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.234585:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14222 00000100:00100000:0.0:1746126627.237759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.237787:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721765504 00000100:00100000:0.0:1746126627.237795:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721765504 00010000:00010000:0.0:1746126627.237839:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 36 pid: 4641 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746126627.237872:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7460 00000100:00100000:0.0:1746126627.237879:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721765504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126627.237894:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126627.237915:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 36 pid: 4641 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746126627.237927:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 36 pid: 4641 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746126627.237950:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e37400/0xb50e8258676153d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed41 expref: 36 pid: 4641 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746126627.237963:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.237966:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.237972:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 27 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.237980:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 27 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.238022:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 27 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126627.238035:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721483008:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126627.238104:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.240210:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1965:x1830945721764992:12345-192.168.203.2@tcp:101:cat.0 Request processed in 25276us (27419us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126627.240221:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14224 00000100:00100000:0.0:1746126627.244965:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.245110:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721765760 00000100:00100000:0.0:1746126627.245119:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721765760 00002000:00100000:0.0:1746126627.245164:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1499136->1503231) req@ffff88008f1e2680 x1830945721765760/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.245187:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2680 with x1830945721765760 ext(1499136->1503231) 00002000:00010000:0.0:1746126627.245192:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e2680 00000100:00100000:0.0:1746126627.245213:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8127 00000100:00100000:0.0:1746126627.245221:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721765760:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126627.245371:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721765760:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 150us (414us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126627.245377:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8127 00002000:00100000:0.0:1746126627.245381:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1499136->1503231) req@ffff88008f1e2680 x1830945721765760/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.245387:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2680 with x1830945721765760 ext(1499136->1503231) 00002000:00010000:0.0:1746126627.245390:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e2680 00000100:00100000:0.0:1746126627.245547:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721483008:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126627.245567:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126627.245588:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721765504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7710us (7836us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.245596:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7460 00000100:00100000:0.0:1746126627.253890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.253920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.253942:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721766144 00000100:00100000:0.0:1746126627.253951:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721766144 00002000:00100000:0.0:1746126627.254009:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f1e1180 x1830945721766144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.254019:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1180 with x1830945721766144 ext(0->1048575) 00002000:00010000:0.0:1746126627.254024:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e1180 00000100:00100000:0.0:1746126627.254042:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721766272 00000100:00100000:0.0:1746126627.254045:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721766272 00002000:00100000:0.0:1746126627.254058:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008f1e2a00 x1830945721766272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 504/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.254065:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2a00 with x1830945721766272 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.254068:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e2a00 00000100:00100000:0.0:1746126627.254081:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8128 00000100:00100000:0.0:1746126627.254087:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721766144:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126627.254858:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8129 00000100:00100000:0.0:1746126627.254865:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721766272:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126627.287439:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+27:1966:x1830945721766272:12345-192.168.203.2@tcp:3:cat.0 Request processed in 32564us (33508us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746126627.287452:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8129 00002000:00100000:0.0:1746126627.287464:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88008f1e2a00 x1830945721766272/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 504/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.287473:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e2a00 with x1830945721766272 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.287479:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1e2a00 00000100:00100000:0.0:1746126627.288262:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721766144:12345-192.168.203.2@tcp:3:cat.0 Request processed in 34173us (34380us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126627.288268:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8128 00002000:00100000:0.0:1746126627.288273:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008f1e1180 x1830945721766144/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.288280:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1e1180 with x1830945721766144 ext(0->1048575) 00002000:00010000:0.0:1746126627.288283:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1e1180 00000100:00100000:0.0:1746126627.304674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.304706:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721766400 00000100:00100000:0.0:1746126627.304715:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721766400 00000100:00100000:0.0:1746126627.304756:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14228 00000100:00100000:0.0:1746126627.304763:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+27:31655:x1830945721766400:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126627.304792:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126627.304810:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed8e expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.304854:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 34 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.304861:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126627.304863:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126627.304866:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed8e expref: 28 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.304894:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 34 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.304909:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 34 pid: 4641 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746126627.304920:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721483136:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126627.305000:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7eaef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.315549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.315596:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721483136:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126627.315624:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed8e expref: 28 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.315641:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cc3a00, rc 0) 00000100:00100000:0.0:1746126627.315682:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+28:31655:x1830945721766400:12345-192.168.203.2@tcp:101:cat.0 Request processed in 10918us (11014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.315691:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14228 00000100:00100000:0.0:1746126627.315725:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721766528 00000100:00100000:0.0:1746126627.315731:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721766528 00002000:00100000:0.0:1746126627.315765:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1581056->1626111) req@ffff8800a4c8e680 x1830945721766528/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.315774:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8e680 with x1830945721766528 ext(1581056->1626111) 00010000:00010000:0.0:1746126627.315779:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 35 pid: 4641 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.315791:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 35 pid: 4641 timeout: 849 lvb_type: 0 00002000:00010000:0.0:1746126627.315802:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4c8e680 00000100:00100000:0.0:1746126627.315816:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1877 00000100:00100000:0.0:1746126627.315822:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+35:1963:x1830945721766528:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:1.0:1746126627.322023:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721766528:12345-192.168.203.2@tcp:4:cat.0 Request processed in 6192us (6472us total) trans 17179873329 rc 0/0 00000100:00100000:1.0:1746126627.322036:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1877 00002000:00100000:1.0:1746126627.322046:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1581056->1626111) req@ffff8800a4c8e680 x1830945721766528/t17179873329(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/448 e 0 to 0 dl 1746126638 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126627.322056:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8e680 with x1830945721766528 ext(1581056->1626111) 00010000:00010000:1.0:1746126627.322066:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 37 pid: 4641 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.322080:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 37 pid: 4641 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746126627.322087:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4c8e680 00000100:00100000:0.0:1746126627.332190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.332222:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721766656 00000100:00100000:0.0:1746126627.332230:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721766656 00010000:00010000:0.0:1746126627.332263:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 37 pid: 4641 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746126627.332289:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7461 00000100:00100000:0.0:1746126627.332295:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+37:1963:x1830945721766656:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126627.332308:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126627.332330:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 37 pid: 4641 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.332342:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 37 pid: 4641 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.332362:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b93600/0xb50e8258676153ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1626111) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed33 expref: 37 pid: 4641 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.332374:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.332376:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.332382:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed8e expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.332394:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed8e expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.332423:0:7072:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed8e expref: 27 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126627.332433:0:7072:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4c8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721483264:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126627.332491:0:7072:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.351689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.351705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.351723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.351751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.351797:0:7072:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4c8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7072:1830945721483264:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126627.351815:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126627.351869:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+36:1963:x1830945721766656:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 19573us (19685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.351880:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7461 00000100:00100000:0.0:1746126627.351914:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721766912 00000100:00100000:0.0:1746126627.351920:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721766912 00002000:00100000:0.0:1746126627.351955:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a4c8f800 x1830945721766912/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.351964:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8f800 with x1830945721766912 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.351968:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c8f800 00000100:00100000:0.0:1746126627.351979:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721767168 00000100:00100000:0.0:1746126627.351982:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721767168 00002000:00100000:0.0:1746126627.352006:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a4c8d880 x1830945721767168/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.352012:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8d880 with x1830945721767168 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.352015:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8d880 00000100:00100000:0.0:1746126627.352026:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8130 00000100:00100000:0.0:1746126627.352032:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+28:1966:x1830945721766912:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126627.354884:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8131 00000100:00100000:0.0:1746126627.354900:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721767168:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126627.362925:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721767296 00000100:00100000:1.0:1746126627.362938:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721767296 00000100:00100000:1.0:1746126627.362977:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721767424 00000100:00100000:1.0:1746126627.362979:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721767424 00000100:00100000:1.0:1746126627.363008:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14229 00000100:00100000:1.0:1746126627.363016:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+37:1964:x1830945721767296:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.363034:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.363053:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b211c00/0xb50e82586761543e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed95 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126627.363107:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721483392:192.168.203.2@tcp:106: 00000100:00100000:1.0:1746126627.363184:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126627.363204:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14230 00000100:00100000:1.0:1746126627.363209:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+38:1964:x1830945721767424:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.363218:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.363224:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ed9c expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.363234:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.363237:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.363244:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 39 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.363258:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 39 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.363268:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b210e00, rc 0) 00000100:00100000:1.0:1746126627.363286:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+39:1964:x1830945721767424:12345-192.168.203.2@tcp:101:cat.0 Request processed in 76us (11534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.363292:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14230 00000001:00080000:1.0:1746126627.366881:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873310 is committed 00000001:00080000:1.0:1746126627.366898:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873298 is committed 00000001:00080000:1.0:1746126627.366942:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873311 is committed 00000001:00080000:1.0:1746126627.366946:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873312 is committed 00000001:00080000:1.0:1746126627.366968:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873328 is committed 00000001:00080000:1.0:1746126627.366975:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873326 is committed 00000001:00080000:1.0:1746126627.367001:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873322 is committed 00002000:00010000:1.0:1746126627.378623:0:10890:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime: 1746126625 -> 1746126627 00002000:00010000:1.0:1746126627.378630:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime: 1746126625 -> 1746126627 00002000:00010000:1.0:1746126627.378632:0:10890:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime: 1746126625 -> 1746126627 00000100:00100000:1.0:1746126627.378657:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721483392:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126627.378693:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b211c00/0xb50e82586761543e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed95 expref: 22 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.378706:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b211c00/0xb50e82586761543e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed95 expref: 22 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.378717:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b211c00, rc 0) 00000100:00100000:1.0:1746126627.379737:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721767296:12345-192.168.203.2@tcp:101:cat.0 Request processed in 16716us (28006us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126627.379746:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14229 00000100:00100000:0.0:1746126627.381325:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721766912:12345-192.168.203.2@tcp:3:cat.0 Request processed in 29287us (29639us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126627.381335:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8130 00002000:00100000:0.0:1746126627.381344:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff8800a4c8f800 x1830945721766912/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.381353:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8f800 with x1830945721766912 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.381359:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c8f800 00000100:00100000:0.0:1746126627.391425:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+26:1966:x1830945721767168:12345-192.168.203.2@tcp:3:cat.0 Request processed in 36522us (39709us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126627.391438:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8131 00002000:00100000:0.0:1746126627.391451:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff8800a4c8d880 x1830945721767168/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.391460:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c8d880 with x1830945721767168 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.391466:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c8d880 00000100:00100000:2.0:1746126627.402082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.402111:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721767680 00000100:00100000:2.0:1746126627.402120:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721767680 00002000:00100000:2.0:1746126627.402162:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008e3a8700 x1830945721767680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.402172:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8700 with x1830945721767680 ext(0->1048575) 00002000:00010000:2.0:1746126627.402177:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3a8700 00000100:00100000:2.0:1746126627.402193:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8132 00000100:00100000:2.0:1746126627.402199:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+34:1963:x1830945721767680:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.414801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000001:00080000:3.0:1746126627.415255:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840439 is committed 00000001:00080000:3.0:1746126627.415273:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840455 is committed 00000001:00080000:3.0:1746126627.415283:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840450 is committed 00000001:00080000:3.0:1746126627.415292:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840471 is committed 00000001:00080000:3.0:1746126627.415298:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840470 is committed 00000001:00080000:3.0:1746126627.415307:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840467 is committed 00000001:00080000:3.0:1746126627.415361:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840473 is committed 00000001:00080000:3.0:1746126627.415369:0:371:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840472 is committed 00000100:00100000:3.0:1746126627.415487:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721767936 00000100:00100000:3.0:1746126627.415497:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721767936 00002000:00100000:3.0:1746126627.415539:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008e3a8380 x1830945721767936/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.415548:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8380 with x1830945721767936 ext(2097152->3145727) 00002000:00010000:3.0:1746126627.415553:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3a8380 00000100:00100000:3.0:1746126627.416808:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8133 00000100:00100000:3.0:1746126627.416819:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721767936:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.419229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.419263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.419296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.419319:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721768192 00000100:00100000:2.0:1746126627.419329:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721768192 00002000:00100000:2.0:1746126627.419368:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008e3ab480 x1830945721768192/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.419377:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3ab480 with x1830945721768192 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.419381:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3ab480 00000100:00100000:2.0:1746126627.419395:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721768448 00000100:00100000:2.0:1746126627.419397:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721768448 00002000:00100000:2.0:1746126627.419408:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008e3a9180 x1830945721768448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.419414:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9180 with x1830945721768448 ext(2097152->3145727) 00002000:00010000:2.0:1746126627.419417:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9180 00000100:00100000:2.0:1746126627.419424:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721768576 00000100:00100000:2.0:1746126627.419426:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721768576 00002000:00100000:2.0:1746126627.419433:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008e3a8000 x1830945721768576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.419438:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8000 with x1830945721768576 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.419440:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a8000 00000100:00100000:2.0:1746126627.419450:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8134 00000100:00100000:2.0:1746126627.419456:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721768192:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.421531:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8135 00000100:00100000:2.0:1746126627.421543:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1966:x1830945721768448:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126627.423229:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8136 00000100:00100000:0.0:1746126627.423241:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1965:x1830945721768576:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126627.433914:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.435103:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721768832 00000100:00100000:1.0:1746126627.435116:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721768832 00000100:00100000:1.0:1746126627.435167:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14231 00000100:00100000:1.0:1746126627.435174:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+16:31652:x1830945721768832:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126627.435195:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.435213:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eda3 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.435242:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.435251:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 11 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.435256:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.435258:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.435261:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 17 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.435290:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 11 pid: 17475 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.435302:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 11 pid: 17475 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746126627.435314:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721483520:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126627.435410:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.435418:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 17 pid: 4641 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746126627.435425:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721483648:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126627.435444:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746126627.442807:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721767680:12345-192.168.203.2@tcp:3:cat.0 Request processed in 40596us (40721us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.442820:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8132 00002000:00100000:2.0:1746126627.442853:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31d:0x0] (0->1048575) req@ffff88008e3a8700 x1830945721767680/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.442862:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8700 with x1830945721767680 ext(0->1048575) 00002000:00010000:2.0:1746126627.442868:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3a8700 00000100:00100000:0.0:1746126627.450374:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721483520:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126627.450389:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721483648:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126627.450421:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 15 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.450439:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e36800, rc 0) 00000100:00100000:0.0:1746126627.450488:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+15:31652:x1830945721768832:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 15313us (16583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.450497:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14231 00000100:00100000:3.0:1746126627.450757:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721768192:12345-192.168.203.2@tcp:3:cat.0 Request processed in 31292us (31527us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126627.450768:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8134 00002000:00100000:3.0:1746126627.450779:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88008e3ab480 x1830945721768192/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.450787:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3ab480 with x1830945721768192 ext(3145728->4194303) 00010000:00010000:3.0:1746126627.450796:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 10 pid: 17475 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746126627.450806:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 10 pid: 17475 timeout: 849 lvb_type: 1 00002000:00010000:3.0:1746126627.450813:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e3ab480 00000100:00100000:0.0:1746126627.451516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.452309:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721768960 00000100:00100000:2.0:1746126627.452318:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721768960 00010000:00010000:2.0:1746126627.452349:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 15 pid: 4641 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746126627.452375:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7462 00000100:00100000:2.0:1746126627.452383:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721768960:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126627.452399:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126627.452419:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 15 pid: 4641 timeout: 849 lvb_type: 1 00010000:00010000:2.0:1746126627.452429:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 15 pid: 4641 timeout: 849 lvb_type: 1 00010000:00010000:2.0:1746126627.452451:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e37e00/0xb50e8258676153dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed4f expref: 15 pid: 4641 timeout: 849 lvb_type: 1 00010000:00010000:2.0:1746126627.452466:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126627.452497:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721768960:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 115us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.452502:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7462 00000100:00100000:3.0:1746126627.459245:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721767936:12345-192.168.203.2@tcp:3:cat.0 Request processed in 42419us (44446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126627.459257:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8133 00002000:00100000:3.0:1746126627.459268:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008e3a8380 x1830945721767936/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.459276:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8380 with x1830945721767936 ext(2097152->3145727) 00010000:00010000:3.0:1746126627.459285:0:21198:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 8 pid: 17475 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746126627.459299:0:21198:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 8 pid: 17475 timeout: 849 lvb_type: 1 00002000:00010000:3.0:1746126627.459306:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e3a8380 00000100:00100000:2.0:1746126627.464865:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721768448:12345-192.168.203.2@tcp:3:cat.0 Request processed in 43314us (45588us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.464877:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8135 00002000:00100000:2.0:1746126627.464889:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88008e3a9180 x1830945721768448/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.464899:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a9180 with x1830945721768448 ext(2097152->3145727) 00002000:00010000:2.0:1746126627.464904:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a9180 00000100:00100000:2.0:1746126627.475120:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721768576:12345-192.168.203.2@tcp:3:cat.0 Request processed in 51871us (55811us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.475132:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8136 00002000:00100000:2.0:1746126627.475143:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88008e3a8000 x1830945721768576/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.475152:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8000 with x1830945721768576 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.475157:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e3a8000 00000100:00100000:0.0:1746126627.477564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.477624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.477655:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721769088 00000100:00100000:0.0:1746126627.477664:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721769088 00010000:00010000:0.0:1746126627.477702:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 8 pid: 17475 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746126627.477741:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7463 00000100:00100000:0.0:1746126627.477748:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721769088:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126627.477761:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126627.477782:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 8 pid: 17475 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746126627.477798:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 8 pid: 17475 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746126627.477819:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092dc7e00/0xb50e825867615429 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed80 expref: 8 pid: 17475 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746126627.477855:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.477857:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.477864:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.477871:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.477903:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126627.477914:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721483776:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126627.477984:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.478007:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721769216 00000100:00100000:0.0:1746126627.478010:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721769216 00000100:00100000:0.0:1746126627.478036:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14232 00000100:00100000:0.0:1746126627.478040:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:31660:x1830945721769216:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1746126627.478051:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126627.478063:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edaa expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.478080:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.478085:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126627.478086:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126627.478089:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 22 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.478103:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 7 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.478111:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 7 pid: 4642 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746126627.478118:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721483904:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126627.478142:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.480202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.484047:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721483776:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126627.484073:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126627.484113:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1964:x1830945721769088:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6364us (6559us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.484124:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7463 00000100:00100000:0.0:1746126627.484240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.484281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.484305:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ddad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721483904:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126627.484326:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 22 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.484341:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570fa00, rc 0) 00000100:00100000:0.0:1746126627.484363:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:31660:x1830945721769216:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6322us (6739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.484369:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14232 00000100:00100000:3.0:1746126627.484375:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721769728 00000100:00100000:3.0:1746126627.484385:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721769728 00002000:00100000:3.0:1746126627.484429:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2703360->2707455) req@ffff88009f11d180 x1830945721769728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.484438:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11d180 with x1830945721769728 ext(2703360->2707455) 00002000:00010000:3.0:1746126627.484447:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11d180 00000100:00100000:3.0:1746126627.484467:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721769472 00000100:00100000:3.0:1746126627.484470:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721769472 00000100:00100000:2.0:1746126627.484577:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8137 00000100:00100000:2.0:1746126627.484589:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721769728:12345-192.168.203.2@tcp:3:multiop.0 00002000:00100000:3.0:1746126627.484629:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1499136->1781759) req@ffff88012ddae680 x1830945721769472/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.484641:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddae680 with x1830945721769472 ext(1499136->1781759) 00010000:00010000:3.0:1746126627.484649:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 8 pid: 4642 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.484662:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 8 pid: 4642 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746126627.484667:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ddae680 00000100:00100000:3.0:1746126627.484681:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1878 00000100:00100000:3.0:1746126627.484687:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1966:x1830945721769472:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:2.0:1746126627.484754:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721769728:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 168us (514us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126627.484760:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8137 00002000:00100000:2.0:1746126627.484766:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x321:0x0] (2703360->2707455) req@ffff88009f11d180 x1830945721769728/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.484774:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f11d180 with x1830945721769728 ext(2703360->2707455) 00002000:00010000:2.0:1746126627.484778:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f11d180 00000100:00100000:1.0:1746126627.485045:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721769344 00000100:00100000:1.0:1746126627.485051:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721769344 00000100:00100000:1.0:1746126627.485082:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14233 00000100:00100000:1.0:1746126627.485088:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+7:31655:x1830945721769344:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.485096:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.485109:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edb1 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.485125:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.485132:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126627.485134:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126627.485137:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 8 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.485162:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 13 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.485172:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 13 pid: 10890 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746126627.485182:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721484032:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126627.485227:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746126627.490190:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:23766:1830945721484032:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126627.490223:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 8 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.490240:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e37000, rc 0) 00000100:00100000:1.0:1746126627.490284:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f11d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31655:x1830945721769344:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5195us (10091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.490292:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14233 00000100:00100000:3.0:1746126627.493404:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1966:x1830945721769472:12345-192.168.203.2@tcp:4:cat.0 Request processed in 8709us (9113us total) trans 17179873330 rc 0/0 00000100:00100000:3.0:1746126627.493416:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1878 00002000:00100000:3.0:1746126627.493425:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x322:0x0] (1499136->1781759) req@ffff88012ddae680 x1830945721769472/t17179873330(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/448 e 0 to 0 dl 1746126638 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.493434:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ddae680 with x1830945721769472 ext(1499136->1781759) 00010000:00010000:3.0:1746126627.493444:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 10 pid: 4642 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.493454:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 10 pid: 4642 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746126627.493460:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ddae680 00000100:00100000:0.0:1746126627.498560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.498598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.498633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.498646:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721769856 00000100:00100000:1.0:1746126627.498660:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721770240 00000100:00100000:2.0:1746126627.498661:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721769856 00000100:00100000:1.0:1746126627.498669:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721770240 00000100:00100000:2.0:1746126627.498715:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00100000:2.0:1746126627.498723:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1963:x1830945721769856:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1746126627.498783:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1963:x1830945721769856:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.498788:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00100000:1.0:1746126627.498807:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14234 00000100:00100000:1.0:1746126627.498815:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+22:31652:x1830945721770240:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126627.498855:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.498873:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edb8 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.498900:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 23 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.498909:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.498915:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.498916:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.498920:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2662399] (req 2097152->2662399) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.498949:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.498960:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 9 pid: 8438 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746126627.498971:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721484160:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126627.499341:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721770112 00000100:00100000:3.0:1746126627.499345:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721770112 00002000:00100000:3.0:1746126627.499374:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2703360->3145727) req@ffff8800a5955880 x1830945721770112/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.499383:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5955880 with x1830945721770112 ext(2703360->3145727) 00010000:00010000:3.0:1746126627.499390:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 14 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.499399:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 14 pid: 10890 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746126627.499404:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5955880 00010000:00010000:1.0:1746126627.500155:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 23 pid: 20294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.500164:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 23 pid: 20294 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746126627.500180:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721484288:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126627.500228:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1879 00000100:00100000:3.0:1746126627.500236:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+14:1966:x1830945721770112:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:1.0:1746126627.500556:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126627.503053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.504263:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721770368 00000100:00100000:0.0:1746126627.504274:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721770368 00010000:00010000:0.0:1746126627.504310:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 10 pid: 4642 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746126627.504355:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7464 00000100:00100000:0.0:1746126627.504363:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721770368:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126627.504377:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126627.504404:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 10 pid: 4642 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.504417:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 10 pid: 4642 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.504440:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fe80800/0xb50e82586761540d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->1781759) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed5d expref: 10 pid: 4642 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746126627.504473:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.504475:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126627.504482:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.504490:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.504529:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126627.504540:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b160e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721484416:192.168.203.2@tcp:105: 00000100:00100000:0.0:1746126627.504619:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5211c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.510807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.511048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.511129:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721770496 00000100:00100000:2.0:1746126627.511140:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721770496 00000100:00100000:1.0:1746126627.511166:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721484160:192.168.203.2@tcp:104: 00010000:00010000:2.0:1746126627.511176:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 10 pid: 8438 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746126627.511177:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721484288:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126627.511204:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721770624 00000100:00100000:2.0:1746126627.511206:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721770624 00010000:00010000:1.0:1746126627.511206:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->2662399] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 23 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.511216:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 24 pid: 20294 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.511222:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e36c00, rc 0) 00000100:00100000:2.0:1746126627.511232:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7465 00000100:00100000:2.0:1746126627.511240:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721770496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126627.511253:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126627.511267:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ddad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:31652:x1830945721770240:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 12453us (12667us total) trans 0 rc 0/0 00010000:00010000:2.0:1746126627.511275:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 10 pid: 8438 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746126627.511275:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14234 00010000:00010000:2.0:1746126627.511285:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 10 pid: 8438 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746126627.511360:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7466 00000100:00100000:3.0:1746126627.511368:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721770624:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126627.511377:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126627.511629:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092dc6000/0xb50e825867615430 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed87 expref: 10 pid: 8438 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746126627.511632:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 23 pid: 20294 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.511641:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 23 pid: 20294 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.511700:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e39a800/0xb50e8258676153c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed2c expref: 23 pid: 20294 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.512115:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.512118:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.512125:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.512132:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.512143:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126627.512163:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 22 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.512175:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721484544:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126627.512264:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721770624:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 897us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126627.512271:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7466 00000100:00100000:2.0:1746126627.512290:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.525582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.525809:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b160e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7073:1830945721484416:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126627.525850:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126627.525890:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1964:x1830945721770368:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 21527us (22847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.525902:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7464 00000100:00100000:1.0:1746126627.525942:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721770880 00000100:00100000:1.0:1746126627.525948:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721770880 00002000:00100000:1.0:1746126627.525982:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2658304->2662399) req@ffff88012b163b80 x1830945721770880/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126627.526004:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163b80 with x1830945721770880 ext(2658304->2662399) 00002000:00010000:1.0:1746126627.526008:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b163b80 00000100:00100000:1.0:1746126627.526024:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8138 00000100:00100000:1.0:1746126627.526032:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721770880:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:1.0:1746126627.526173:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721770880:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 142us (600us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126627.526178:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8138 00002000:00100000:1.0:1746126627.526183:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x325:0x0] (2658304->2662399) req@ffff88012b163b80 x1830945721770880/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126627.526189:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b163b80 with x1830945721770880 ext(2658304->2662399) 00002000:00010000:1.0:1746126627.526192:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b163b80 00000100:00100000:2.0:1746126627.526262:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721484544:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126627.526273:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126627.526289:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b163800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1964:x1830945721770496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 15051us (15494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.526295:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7465 00000100:00100000:2.0:1746126627.531672:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1966:x1830945721770112:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 31424us (33024us total) trans 21474840474 rc 0/0 00000100:00100000:2.0:1746126627.531686:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1879 00002000:00100000:2.0:1746126627.531697:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (2703360->3145727) req@ffff8800a5955880 x1830945721770112/t21474840474(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/448 e 0 to 0 dl 1746126638 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.531706:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5955880 with x1830945721770112 ext(2703360->3145727) 00010000:00010000:2.0:1746126627.531716:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 16 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.531732:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 16 pid: 10890 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746126627.531738:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5955880 00000100:00100000:0.0:1746126627.533383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.533451:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721771264 00000100:00100000:2.0:1746126627.533463:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721771264 00002000:00100000:2.0:1746126627.533507:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012b160e00 x1830945721771264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.533516:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b160e00 with x1830945721771264 ext(1048576->2097151) 00002000:00010000:2.0:1746126627.533520:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b160e00 00000100:00100000:2.0:1746126627.533551:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8139 00000100:00100000:2.0:1746126627.533559:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721771264:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:0.0:1746126627.544904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.544933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.544953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126627.545873:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721771776 00000100:00100000:3.0:1746126627.545884:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721771776 00010000:00010000:3.0:1746126627.545925:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 18 pid: 10890 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746126627.545945:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721771392 00000100:00100000:0.0:1746126627.545949:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721771392 00000100:00100000:3.0:1746126627.545955:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7467 00000100:00100000:3.0:1746126627.545963:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721771776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126627.545977:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746126627.545978:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009220b100 x1830945721771392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.545997:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b100 with x1830945721771392 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.546002:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b100 00002000:00010000:3.0:1746126627.546011:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126626 -> 1746126627 00002000:00010000:3.0:1746126627.546015:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126626 -> 1746126627 00000100:00100000:0.0:1746126627.546015:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721771520 00000100:00100000:0.0:1746126627.546017:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721771520 00010000:00010000:3.0:1746126627.546020:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 18 pid: 10890 timeout: 849 lvb_type: 0 00002000:00100000:0.0:1746126627.546027:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009220b800 x1830945721771520/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746126627.546033:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 18 pid: 10890 timeout: 849 lvb_type: 0 00002000:00100000:0.0:1746126627.546034:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b800 with x1830945721771520 ext(1048576->2097151) 00002000:00010000:0.0:1746126627.546037:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b800 00000100:00100000:0.0:1746126627.546048:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8140 00000100:00100000:0.0:1746126627.546052:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721771392:12345-192.168.203.2@tcp:3:multiop.0 00010000:00010000:3.0:1746126627.546055:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e36800/0xb50e82586761544c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eda3 expref: 18 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.546076:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126627.546078:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126627.546084:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 7 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.546091:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 7 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.546124:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 7 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126627.546134:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721484672:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126627.546209:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126627.546253:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8141 00000100:00100000:3.0:1746126627.546261:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721771520:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:3.0:1746126627.565855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.565945:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7892:1830945721484672:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126627.565968:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126627.566023:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721771776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 20060us (21127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.566034:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7467 00000100:00100000:2.0:1746126627.566571:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721771264:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 33012us (33195us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.566579:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8139 00002000:00100000:2.0:1746126627.566590:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x31f:0x0] (1048576->2097151) req@ffff88012b160e00 x1830945721771264/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.566599:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b160e00 with x1830945721771264 ext(1048576->2097151) 00002000:00010000:2.0:1746126627.566603:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b160e00 00000100:00100000:2.0:1746126627.566618:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772032 00000100:00100000:2.0:1746126627.566623:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772032 00002000:00100000:2.0:1746126627.566645:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f134e00 x1830945721772032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.566651:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134e00 with x1830945721772032 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.566655:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f134e00 00000100:00100000:2.0:1746126627.566668:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8142 00000100:00100000:2.0:1746126627.566673:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721772032:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.571574:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721771520:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 25301us (26606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.571587:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8141 00002000:00100000:2.0:1746126627.571598:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x323:0x0] (1048576->2097151) req@ffff88009220b800 x1830945721771520/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.571607:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b800 with x1830945721771520 ext(1048576->2097151) 00002000:00010000:2.0:1746126627.571612:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b800 00000100:00100000:2.0:1746126627.584125:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721771392:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 38058us (39177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.584138:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8140 00002000:00100000:2.0:1746126627.584148:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x322:0x0] (1048576->2097151) req@ffff88009220b100 x1830945721771392/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.584158:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009220b100 with x1830945721771392 ext(1048576->2097151) 00002000:00010000:2.0:1746126627.584164:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009220b100 00000100:00100000:2.0:1746126627.586730:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721772032:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20044us (20873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.586742:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8142 00002000:00100000:2.0:1746126627.586752:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009f134e00 x1830945721772032/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.586762:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f134e00 with x1830945721772032 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.586769:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f134e00 00000100:00100000:0.0:1746126627.606478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.606912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.606980:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772160 00000100:00100000:1.0:1746126627.606984:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772288 00000100:00100000:1.0:1746126627.606999:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772288 00000100:00100000:2.0:1746126627.607000:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772160 00000100:00100000:1.0:1746126627.607054:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14235 00000100:00100000:1.0:1746126627.607062:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+15:31660:x1830945721772288:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.607081:0:23766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.607100:0:23766:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edc6 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.607124:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.607126:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.607133:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.607143:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14236 00010000:00010000:1.0:1746126627.607148:0:23766:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 16 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.607151:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31655:x1830945721772160:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.607158:0:23766:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e662a00, rc 0) 00010000:00010000:2.0:1746126627.607159:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126627.607171:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edbf expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.607189:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.607196:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126627.607197:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126627.607200:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126627.607201:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+16:31660:x1830945721772288:12345-192.168.203.2@tcp:101:cat.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.607208:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14235 00010000:00010000:2.0:1746126627.607229:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 21 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.607241:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 21 pid: 23766 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746126627.607253:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721484800:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126627.607322:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19900 going to sleep for 11 seconds 00000100:00100000:2.0:1746126627.611213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126627.611383:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772416 00000100:00100000:3.0:1746126627.611391:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772416 00002000:00100000:3.0:1746126627.611433:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2662399) req@ffff88008e3aaa00 x1830945721772416/t0(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.611442:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aaa00 with x1830945721772416 ext(2097152->2662399) 00010000:00010000:3.0:1746126627.611451:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 22 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.611464:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 22 pid: 23766 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746126627.611470:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3aaa00 00000100:00100000:3.0:1746126627.611497:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1880 00000100:00100000:3.0:1746126627.611504:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721772416:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:0.0:1746126627.612603:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721484800:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126627.612635:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126627.612652:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a26e00, rc 0) 00000100:00100000:0.0:1746126627.612696:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31655:x1830945721772160:12345-192.168.203.2@tcp:101:cat.0 Request processed in 5543us (6226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126627.612704:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14236 00000100:00100000:2.0:1746126627.612904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.613008:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772672 00000100:00100000:2.0:1746126627.613015:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772672 00002000:00100000:2.0:1746126627.613047:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008e3aa300 x1830945721772672/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.613055:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aa300 with x1830945721772672 ext(2097152->3145727) 00002000:00010000:2.0:1746126627.613059:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3aa300 00000100:00100000:2.0:1746126627.613082:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8143 00000100:00100000:2.0:1746126627.613089:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721772672:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.628947:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721772672:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15846us (16032us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.628960:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8143 00002000:00100000:2.0:1746126627.628974:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x321:0x0] (2097152->3145727) req@ffff88008e3aa300 x1830945721772672/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.628984:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aa300 with x1830945721772672 ext(2097152->3145727) 00002000:00010000:2.0:1746126627.629137:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3aa300 00000100:00100000:3.0:1746126627.634445:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721772416:12345-192.168.203.2@tcp:4:cat.0 Request processed in 22929us (23228us total) trans 17179873331 rc 0/0 00000100:00100000:3.0:1746126627.634458:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1880 00002000:00100000:3.0:1746126627.634470:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (2097152->2662399) req@ffff88008e3aaa00 x1830945721772416/t17179873331(0) o4->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/448 e 0 to 0 dl 1746126638 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126627.634479:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3aaa00 with x1830945721772416 ext(2097152->2662399) 00010000:00010000:3.0:1746126627.634488:0:31371:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 24 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746126627.634505:0:31371:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 24 pid: 23766 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746126627.634512:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e3aaa00 00000100:00100000:0.0:1746126627.645438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.645545:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772800 00000100:00100000:2.0:1746126627.645556:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772800 00000100:00100000:2.0:1746126627.645602:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14237 00000100:00100000:2.0:1746126627.645611:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:31660:x1830945721772800:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1746126627.645630:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126627.645649:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edcd expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.645678:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126627.645681:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126627.645685:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.645702:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 25 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.645713:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac15c00, rc 0) 00000100:00100000:2.0:1746126627.645774:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:31660:x1830945721772800:12345-192.168.203.2@tcp:101:cat.0 Request processed in 164us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.645780:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14237 00000100:00100000:0.0:1746126627.646926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.647007:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721772928 00000100:00100000:2.0:1746126627.647013:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721772928 00010000:00010000:2.0:1746126627.647037:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 25 pid: 23766 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746126627.647070:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7468 00000100:00100000:2.0:1746126627.647076:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1963:x1830945721772928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126627.647088:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126627.647106:0:7892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126626 -> 1746126627 00002000:00010000:2.0:1746126627.647109:0:7892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126626 -> 1746126627 00010000:00010000:2.0:1746126627.647115:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 25 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.647126:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 25 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.647147:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xb50e825867615461 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb8 expref: 25 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.647169:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.647170:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.647177:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 8 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.647185:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 8 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.647192:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.647193:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.647196:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.647201:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.647230:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.647242:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721484928:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126627.647333:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 8 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.647342:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721485056:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126627.647362:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.654361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126627.654425:0:31371:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721773184 00000100:00100000:3.0:1746126627.654434:0:31371:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721773184 00000100:00100000:2.0:1746126627.654474:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721484928:192.168.203.2@tcp:105: 00002000:00100000:3.0:1746126627.654480:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e3f6300 x1830945721773184/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126627.654485:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721485056:192.168.203.2@tcp:105: 00002000:00100000:3.0:1746126627.654489:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6300 with x1830945721773184 ext(3145728->4194303) 00002000:00010000:3.0:1746126627.654493:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6300 00010000:00010000:2.0:1746126627.654503:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126627.654512:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8144 00000100:00100000:3.0:1746126627.654518:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721773184:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.654642:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009220ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721772928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 7564us (7717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.654651:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7468 00000100:00100000:0.0:1746126627.672880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.672914:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.673008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.673070:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721773568 00000100:00100000:0.0:1746126627.673080:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721773568 00002000:00100000:0.0:1746126627.673121:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e3f7800 x1830945721773568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.673131:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7800 with x1830945721773568 ext(2097152->3145727) 00002000:00010000:0.0:1746126627.673136:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f7800 00000100:00100000:0.0:1746126627.673148:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721773696 00000100:00100000:0.0:1746126627.673150:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721773696 00002000:00100000:0.0:1746126627.673158:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e3f5f80 x1830945721773696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.673164:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5f80 with x1830945721773696 ext(3145728->4194303) 00002000:00010000:0.0:1746126627.673167:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5f80 00000100:00100000:0.0:1746126627.673173:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721773824 00000100:00100000:0.0:1746126627.673174:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721773824 00002000:00100000:0.0:1746126627.673180:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009204dc00 x1830945721773824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.673185:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204dc00 with x1830945721773824 ext(3145728->4194303) 00002000:00010000:0.0:1746126627.673187:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204dc00 00000100:00100000:0.0:1746126627.673201:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8145 00000100:00100000:0.0:1746126627.673206:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721773568:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126627.673297:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8146 00000100:00100000:1.0:1746126627.673304:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721773696:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1746126627.673515:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8147 00000100:00100000:1.0:1746126627.673521:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721773824:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1746126627.674642:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721773184:12345-192.168.203.2@tcp:3:cat.0 Request processed in 20121us (20289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.674651:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8144 00002000:00100000:2.0:1746126627.674658:0:31371:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009e3f6300 x1830945721773184/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.674664:0:31371:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f6300 with x1830945721773184 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.674668:0:31371:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f6300 00000100:00100000:1.0:1746126627.692250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.693108:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721774080 00000100:00100000:1.0:1746126627.693119:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721774080 00000100:00100000:1.0:1746126627.693178:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14238 00000100:00100000:1.0:1746126627.693186:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721774080:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1746126627.693205:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.693224:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e662200/0xb50e82586761547d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edd4 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.693251:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.693253:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.693262:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e662200/0xb50e82586761547d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edd4 expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.693277:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e662200/0xb50e82586761547d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edd4 expref: 10 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.693289:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e662200, rc 0) 00000100:00100000:1.0:1746126627.693339:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1963:x1830945721774080:12345-192.168.203.2@tcp:101:cat.0 Request processed in 154us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.693345:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14238 00000100:00100000:1.0:1746126627.712306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.712974:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+26:1964:x1830945721773824:12345-192.168.203.2@tcp:3:cat.0 Request processed in 39449us (39963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126627.712987:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8147 00002000:00100000:2.0:1746126627.713010:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3145728->4194303) req@ffff88009204dc00 x1830945721773824/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.713019:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204dc00 with x1830945721773824 ext(3145728->4194303) 00002000:00010000:2.0:1746126627.713025:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009204dc00 00000100:00100000:2.0:1746126627.713049:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721774336 00000100:00100000:2.0:1746126627.713058:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721774336 00002000:00100000:2.0:1746126627.713087:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204df80 x1830945721774336/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.713099:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204df80 with x1830945721774336 ext(4194304->4976639) 00002000:00010000:2.0:1746126627.713102:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204df80 00000100:00100000:2.0:1746126627.713116:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8148 00000100:00100000:2.0:1746126627.713122:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721774336:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:0.0:1746126627.717754:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721773568:12345-192.168.203.2@tcp:3:cat.0 Request processed in 44533us (44868us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126627.718119:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8145 00002000:00100000:0.0:1746126627.718135:0:21198:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x325:0x0] (2097152->3145727) req@ffff88009e3f7800 x1830945721773568/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126627.718145:0:21198:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f7800 with x1830945721773568 ext(2097152->3145727) 00002000:00010000:0.0:1746126627.718151:0:21198:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f7800 00000100:00100000:1.0:1746126627.729410:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721773696:12345-192.168.203.2@tcp:3:cat.0 Request processed in 56093us (56481us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126627.729424:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8146 00002000:00100000:1.0:1746126627.729439:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->4194303) req@ffff88009e3f5f80 x1830945721773696/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126627.729449:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5f80 with x1830945721773696 ext(3145728->4194303) 00002000:00010000:1.0:1746126627.729455:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5f80 00000100:00100000:2.0:1746126627.738509:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721774336:12345-192.168.203.2@tcp:3:cat.0 Request processed in 25375us (26204us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126627.738521:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8148 00002000:00100000:2.0:1746126627.738534:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009204df80 x1830945721774336/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.738542:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009204df80 with x1830945721774336 ext(4194304->4976639) 00002000:00010000:2.0:1746126627.738548:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009204df80 00000100:00100000:0.0:1746126627.743586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.744932:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721774592 00000100:00100000:2.0:1746126627.744943:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721774592 00002000:00100000:2.0:1746126627.745002:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e3f5500 x1830945721774592/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.745012:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5500 with x1830945721774592 ext(4194304->4976639) 00002000:00010000:2.0:1746126627.745017:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5500 00000100:00100000:0.0:1746126627.745851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.746702:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8149 00000100:00100000:2.0:1746126627.746715:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721774592:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:3.0:1746126627.750244:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721774720 00000100:00100000:3.0:1746126627.750257:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721774720 00000100:00100000:3.0:1746126627.750325:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14239 00000100:00100000:3.0:1746126627.750333:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:31663:x1830945721774720:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:3.0:1746126627.750351:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126627.750370:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4eddb expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.750399:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.750408:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.750415:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126627.750417:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126627.750420:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eddb expref: 11 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.750451:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 23 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.750462:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 23 pid: 10890 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746126627.750473:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721485184:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126627.750582:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.750589:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746126627.750595:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721485312:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126627.750614:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126627.756854:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721485184:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126627.756873:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721485312:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126627.756902:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eddb expref: 11 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.756921:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136897200, rc 0) 00000100:00100000:3.0:1746126627.756969:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:31663:x1830945721774720:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 6636us (11119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126627.756982:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14239 00000100:00100000:2.0:1746126627.762237:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721774592:12345-192.168.203.2@tcp:3:cat.0 Request processed in 15512us (18647us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746126627.762250:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8149 00002000:00100000:2.0:1746126627.762265:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (4194304->4976639) req@ffff88009e3f5500 x1830945721774592/t0(0) o3->27c713d7-92e0-4974-b612-500c641c1d6c@192.168.203.2@tcp:388/0 lens 488/440 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.762276:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5500 with x1830945721774592 ext(4194304->4976639) 00002000:00010000:2.0:1746126627.762282:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f5500 00000100:00100000:3.0:1746126627.763320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.763752:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721774848 00000100:00100000:2.0:1746126627.763761:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721774848 00010000:00010000:2.0:1746126627.763793:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746126627.764147:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7469 00000100:00100000:2.0:1746126627.764155:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1964:x1830945721774848:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126627.764168:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126627.764192:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.764204:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.764228:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a26e00/0xb50e82586761546f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edbf expref: 11 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.764473:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126627.764730:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1964:x1830945721774848:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 574us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.764736:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7469 00000100:00100000:0.0:1746126627.765071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.765218:0:7892:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721774976 00000100:00100000:2.0:1746126627.765224:0:7892:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721774976 00010000:00010000:2.0:1746126627.765241:0:7892:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746126627.765257:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7470 00000100:00100000:2.0:1746126627.765262:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721774976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126627.765272:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126627.765285:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.765294:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.765309:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac15c00/0xb50e825867615476 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edcd expref: 24 pid: 10890 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746126627.765318:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.765320:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126627.765326:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eddb expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.765333:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eddb expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126627.765362:0:7892:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eddb expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126627.765373:0:7892:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721485440:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126627.766258:0:7892:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af19b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126627.768238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126627.768353:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721775104 00000100:00100000:3.0:1746126627.768363:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721775104 00000100:00100000:3.0:1746126627.768721:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14240 00000100:00100000:3.0:1746126627.768729:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+24:1964:x1830945721775104:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1746126627.768749:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126627.768765:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136896e00/0xb50e82586761548b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ede2 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126627.768814:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721485568:192.168.203.2@tcp:106: 00000100:00100000:3.0:1746126627.770160:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126627.770457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.770540:0:7892:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7892:1830945721485440:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126627.770558:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126627.770590:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+25:1964:x1830945721774976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 5326us (5518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126627.770599:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7470 00000100:00100000:2.0:1746126627.770631:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721775360 00000100:00100000:2.0:1746126627.770635:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721775360 00002000:00100000:2.0:1746126627.770666:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3006464->3010559) req@ffff88012a3f3050 x1830945721775360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.770674:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a3f3050 with x1830945721775360 ext(3006464->3010559) 00002000:00010000:2.0:1746126627.770678:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012a3f3050 00000100:00100000:2.0:1746126627.770699:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8150 00000100:00100000:2.0:1746126627.770705:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a3f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721775360:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126627.770867:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a3f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721775360:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 162us (412us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126627.770873:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8150 00002000:00100000:2.0:1746126627.770877:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x325:0x0] (3006464->3010559) req@ffff88012a3f3050 x1830945721775360/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.770884:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a3f3050 with x1830945721775360 ext(3006464->3010559) 00002000:00010000:2.0:1746126627.770886:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012a3f3050 00002000:00010000:3.0:1746126627.773860:0:10890:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime: 1746126626 -> 1746126627 00000100:00100000:3.0:1746126627.773890:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721485568:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126627.773920:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136896e00/0xb50e82586761548b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ede2 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126627.773933:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136896e00/0xb50e82586761548b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ede2 expref: 24 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126627.773946:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136896e00, rc 0) 00000100:00100000:3.0:1746126627.774876:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721775104:12345-192.168.203.2@tcp:101:cat.0 Request processed in 6144us (6641us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126627.774886:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14240 00000100:00100000:0.0:1746126627.779785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.779924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.779952:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721775488 00000100:00100000:1.0:1746126627.779963:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721775488 00000100:00100000:1.0:1746126627.780013:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721775616 00000100:00100000:1.0:1746126627.780015:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721775616 00000100:00100000:1.0:1746126627.780035:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14241 00000100:00100000:1.0:1746126627.780044:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721775488:12345-192.168.203.2@tcp:101:cat.0 00000100:00100000:3.0:1746126627.780045:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14242 00000100:00100000:3.0:1746126627.780059:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+8:31663:x1830945721775616:12345-192.168.203.2@tcp:101:multiop.0 00010000:00010000:1.0:1746126627.780060:0:9686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126627.780075:0:10890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126627.780078:0:9686:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e663600/0xb50e825867615492 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ede9 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780089:0:10890:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edf0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780113:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780121:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780128:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126627.780128:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721485696:192.168.203.2@tcp:106: 00010000:00010000:3.0:1746126627.780129:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126627.780133:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3952639] (req 3145728->3952639) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf0 expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780157:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 15 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780169:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 15 pid: 23766 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746126627.780178:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721485824:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126627.780207:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00010000:00010000:3.0:1746126627.780229:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.780643:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746126627.780653:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721485952:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126627.782872:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126627.783441:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721485824:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126627.783520:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9686:1830945721485696:192.168.203.2@tcp:106: 00010000:00010000:1.0:1746126627.783542:0:9686:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e663600/0xb50e825867615492 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ede9 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.783559:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e663600/0xb50e825867615492 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ede9 expref: 24 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126627.783581:0:9686:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e663600, rc 0) 00000100:00100000:1.0:1746126627.783614:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721775488:12345-192.168.203.2@tcp:101:cat.0 Request processed in 3572us (3836us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126627.783622:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14241 00000100:00100000:3.0:1746126627.787491:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10890:1830945721485952:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126627.787518:0:10890:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->3952639] (req 3145728->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf0 expref: 9 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126627.787534:0:10890:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136896800, rc 0) 00000100:00100000:3.0:1746126627.787582:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdfe2706-19d2-45db-b997-730767bcbc1c+9:31663:x1830945721775616:12345-192.168.203.2@tcp:101:multiop.0 Request processed in 7528us (7657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126627.787591:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14242 00000100:00100000:0.0:1746126627.794086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126627.794142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126627.794244:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721775744 00000100:00100000:1.0:1746126627.794253:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721775744 00010000:00010000:1.0:1746126627.794293:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746126627.794329:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721775872 00000100:00100000:1.0:1746126627.794332:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721775872 00010000:00010000:1.0:1746126627.794343:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 16 pid: 23766 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746126627.794356:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7471 00000100:00100000:1.0:1746126627.794363:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+9:1963:x1830945721775744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126627.794377:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126627.794403:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.794413:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.794441:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e37000/0xb50e82586761545a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edb1 expref: 9 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.794466:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126627.794506:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1963:x1830945721775744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 141us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.794511:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7471 00000100:00100000:1.0:1746126627.794526:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7472 00000100:00100000:1.0:1746126627.794530:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721775872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126627.794536:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126627.794542:0:7073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 16 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.794550:0:7073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 16 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.794559:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e662a00/0xb50e825867615468 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edc6 expref: 16 pid: 23766 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746126627.794566:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.794568:0:7073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126627.794573:0:7073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf0 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.794580:0:7073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf0 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126627.794608:0:7073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf0 expref: 7 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126627.794618:0:7073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721486080:192.168.203.2@tcp:105: 00000100:00100000:1.0:1746126627.795467:0:7073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126627.802916:0:7073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7073:1830945721486080:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126627.802940:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126627.803019:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27c713d7-92e0-4974-b612-500c641c1d6c+15:1963:x1830945721775872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8485us (8873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126627.803029:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7472 00000100:00100000:0.0:1746126627.813358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126627.813468:0:21460:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721776128 00000100:00100000:2.0:1746126627.813479:0:21460:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721776128 00002000:00100000:2.0:1746126627.813531:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3948544->3952639) req@ffff88009e3f4000 x1830945721776128/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/0 e 0 to 0 dl 1746126638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.813547:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4000 with x1830945721776128 ext(3948544->3952639) 00002000:00010000:2.0:1746126627.813553:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4000 00000100:00100000:2.0:1746126627.813930:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8151 00000100:00100000:2.0:1746126627.813939:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721776128:12345-192.168.203.2@tcp:3:multiop.0 00000100:00100000:2.0:1746126627.814123:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721776128:12345-192.168.203.2@tcp:3:multiop.0 Request processed in 185us (776us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126627.814129:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8151 00002000:00100000:2.0:1746126627.814135:0:21460:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x321:0x0] (3948544->3952639) req@ffff88009e3f4000 x1830945721776128/t0(0) o3->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:388/0 lens 488/4536 e 0 to 0 dl 1746126638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126627.814143:0:21460:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f4000 with x1830945721776128 ext(3948544->3952639) 00002000:00010000:2.0:1746126627.814146:0:21460:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e3f4000 00010000:00010000:0.0:1746126627.869139:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126628.473779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.473825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.473888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.473916:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721776384 00000100:00100000:0.0:1746126628.473926:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721776384 00000100:00100000:0.0:1746126628.473968:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721776640 00000100:00100000:0.0:1746126628.473970:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721776640 00000100:00100000:0.0:1746126628.473980:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721776256 00000100:00100000:0.0:1746126628.473982:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721776256 00000100:00100000:0.0:1746126628.474020:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14243 00000100:00100000:0.0:1746126628.474027:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+12:1965:x1830945721776384:12345-192.168.203.2@tcp:16:kworker.0 00000100:00080000:0.0:1746126628.474090:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126628.474125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.474144:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721776512 00000100:00100000:0.0:1746126628.474147:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721776512 00002000:00100000:0.0:1746126628.474170:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3006464->3145727) req@ffff88009e3f5c00 x1830945721776512/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:389/0 lens 488/0 e 0 to 0 dl 1746126639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126628.474179:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5c00 with x1830945721776512 ext(3006464->3145727) 00002000:00010000:0.0:1746126628.474185:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f5c00 00000100:00100000:0.0:1746126628.474198:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8152 00000100:00100000:0.0:1746126628.474203:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+13:1965:x1830945721776512:12345-192.168.203.2@tcp:4:multiop.0 00000100:00100000:0.0:1746126628.474480:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14244 00000100:00100000:0.0:1746126628.474485:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721776640:12345-192.168.203.2@tcp:16:kworker.0 00000100:00100000:1.0:1746126628.477139:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14245 00000100:00100000:1.0:1746126628.477155:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721776256:12345-192.168.203.2@tcp:16:kworker.0 00000100:00100000:3.0:1746126628.493867:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1965:x1830945721776512:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 19653us (19731us total) trans 17179873332 rc 0/0 00000100:00100000:3.0:1746126628.493882:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8152 00002000:00100000:3.0:1746126628.493894:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x325:0x0] (3006464->3145727) req@ffff88009e3f5c00 x1830945721776512/t17179873332(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:389/0 lens 488/448 e 0 to 0 dl 1746126639 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126628.493904:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e3f5c00 with x1830945721776512 ext(3006464->3145727) 00002000:00010000:3.0:1746126628.493909:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e3f5c00 00000100:00100000:1.0:1746126628.565793:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cdfe2706-19d2-45db-b997-730767bcbc1c+14:1965:x1830945721776256:12345-192.168.203.2@tcp:16:kworker.0 Request processed in 88633us (91892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126628.565805:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14245 00000001:00080000:1.0:1746126628.565859:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873329 is committed 00000001:00080000:1.0:1746126628.565875:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873331 is committed 00000001:00080000:1.0:1746126628.565883:0:2105:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873330 is committed 00000100:00100000:0.0:1746126628.566414:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cdfe2706-19d2-45db-b997-730767bcbc1c+11:1965:x1830945721776384:12345-192.168.203.2@tcp:16:kworker.0 Request processed in 92387us (92646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126628.566422:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14243 00000100:00100000:0.0:1746126628.566459:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721776640:12345-192.168.203.2@tcp:16:kworker.0 Request processed in 91974us (92634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126628.566464:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14244 00000100:00100000:2.0:1746126628.574489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126628.574677:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721776768 00000100:00100000:3.0:1746126628.574687:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721776768 00002000:00100000:3.0:1746126628.574754:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3952639) req@ffff88008e3a8a80 x1830945721776768/t0(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:389/0 lens 488/0 e 0 to 0 dl 1746126639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126628.574764:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8a80 with x1830945721776768 ext(3145728->3952639) 00002000:00010000:3.0:1746126628.574770:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3a8a80 00000100:00100000:3.0:1746126628.574788:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8153 00000100:00100000:3.0:1746126628.574796:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1965:x1830945721776768:12345-192.168.203.2@tcp:4:multiop.0 00000100:00080000:0.0:1746126628.575469:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126628.589096:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1965:x1830945721776768:12345-192.168.203.2@tcp:4:multiop.0 Request processed in 14288us (14604us total) trans 21474840475 rc 0/0 00000100:00100000:3.0:1746126628.589109:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8153 00002000:00100000:3.0:1746126628.589122:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x321:0x0] (3145728->3952639) req@ffff88008e3a8a80 x1830945721776768/t21474840475(0) o4->cdfe2706-19d2-45db-b997-730767bcbc1c@192.168.203.2@tcp:389/0 lens 488/448 e 0 to 0 dl 1746126639 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126628.589131:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e3a8a80 with x1830945721776768 ext(3145728->3952639) 00002000:00010000:3.0:1746126628.589137:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e3a8a80 00000100:00100000:0.0:1746126628.596942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126628.597098:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721777024 00000100:00100000:2.0:1746126628.597108:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721777024 00000100:00100000:2.0:1746126628.597486:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3878 00000100:00100000:2.0:1746126628.597495:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+20:31686:x1830945721777024:12345-192.168.203.2@tcp:35:umount.0 00000100:00080000:0.0:1746126628.597912:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126628.600022:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31686:x1830945721777024:12345-192.168.203.2@tcp:35:umount.0 Request processed in 2519us (3080us total) trans 8589943303 rc 0/0 00000100:00100000:2.0:1746126628.600034:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3878 00000100:00100000:0.0:1746126628.603785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126628.603862:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721777280 00000100:00100000:2.0:1746126628.603871:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721777280 00000100:00100000:2.0:1746126628.603919:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3879 00000100:00100000:2.0:1746126628.603925:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+21:31686:x1830945721777280:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:2.0:1746126628.604142:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdfe2706-19d2-45db-b997-730767bcbc1c+22:31686:x1830945721777280:12345-192.168.203.2@tcp:35:umount.0 Request processed in 217us (367us total) trans 8589943304 rc 0/0 00000100:00100000:2.0:1746126628.604148:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3879 00000100:00100000:0.0:1746126628.607927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.607967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.608004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.608083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126628.608110:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721778048 00000100:00100000:0.0:1746126628.608119:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721778048 00000100:00100000:0.0:1746126628.608163:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721777920 00000100:00100000:0.0:1746126628.608166:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721777920 00000100:00100000:0.0:1746126628.608180:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721778176 00000100:00100000:0.0:1746126628.608182:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721778176 00000100:00100000:0.0:1746126628.608197:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 711 00000100:00100000:0.0:1746126628.608207:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eae29f21-b1cc-49e5-9783-c4d6118c328d+17:1964:x1830945721778048:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126628.608228:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126628.608248:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009920fc00/0xb50e82586760ba76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee49137 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126628.608265:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126628.608303:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eae29f21-b1cc-49e5-9783-c4d6118c328d+16:1964:x1830945721778048:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126628.608310:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 711 00000100:00100000:0.0:1746126628.608324:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 712 00000100:00100000:0.0:1746126628.608328:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eae29f21-b1cc-49e5-9783-c4d6118c328d+15:1964:x1830945721777920:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126628.608334:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126628.608341:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012dbb2a00/0xb50e82586760ba6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4910d expref: 15 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126628.608349:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126628.608360:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eae29f21-b1cc-49e5-9783-c4d6118c328d+14:1964:x1830945721777920:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126628.608364:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 712 00000100:00100000:0.0:1746126628.608395:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 713 00000100:00100000:0.0:1746126628.608400:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eae29f21-b1cc-49e5-9783-c4d6118c328d+13:1964:x1830945721778176:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126628.608405:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126628.608412:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012dbb3c00/0xb50e82586760ba7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4913e expref: 13 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126628.608420:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126628.608431:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eae29f21-b1cc-49e5-9783-c4d6118c328d+12:1964:x1830945721778176:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126628.608437:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 713 00000100:00100000:2.0:1746126628.608533:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721777792 00000100:00100000:2.0:1746126628.608538:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721777792 00000100:00100000:2.0:1746126628.608562:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14246 00000100:00100000:2.0:1746126628.608567:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1962:x1830945721777792:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:2.0:1746126628.608590:0:4641:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb50e82586760ba92 00000020:00010000:2.0:1746126628.608598:0:4641:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f525000: total 0 00000100:00080000:2.0:1746126628.608602:0:4641:0:(import.c:66:import_set_state_nolock()) ffff88009f526800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746126628.608637:0:4641:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873332 00000020:00010000:1.0:1746126628.608739:0:10996:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f525000: total 0 00010000:00010000:1.0:1746126628.608771:0:10996:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f525000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746126628.608811:0:10996:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136897200/0xb50e825867615484 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eddb expref: 8 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126628.608820:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+7:1962:x1830945721777792:12345-192.168.203.2@tcp:9:umount.0 Request processed in 253us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126628.608846:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14246 00010000:00010000:1.0:1746126628.608865:0:10996:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e662200/0xb50e82586761547d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edd4 expref: 6 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126628.608890:0:10996:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cc3a00/0xb50e825867615437 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed8e expref: 5 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126628.608903:0:10996:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f525000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746126628.608914:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746126628.608916:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746126628.608917:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126628.622074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126628.622176:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721778688 00000100:00100000:2.0:1746126628.622185:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721778688 00000100:00100000:2.0:1746126628.622232:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14247 00000100:00100000:2.0:1746126628.622239:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+10:1962:x1830945721778688:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:2.0:1746126628.622272:0:4641:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb50e82586760ba8b 00000020:00010000:2.0:1746126628.622281:0:4641:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008e4a1800: total 0 00000100:00080000:2.0:1746126628.622285:0:4641:0:(import.c:66:import_set_state_nolock()) ffff88008e4a6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746126628.622330:0:4641:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840475 00000020:00010000:1.0:1746126628.622339:0:7076:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008e4a1800: total 0 00010000:00010000:1.0:1746126628.622372:0:7076:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008e4a1800, canceled 0 locks, left on hash table 3. 00000100:00100000:2.0:1746126628.622515:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cdfe2706-19d2-45db-b997-730767bcbc1c+8:1962:x1830945721778688:12345-192.168.203.2@tcp:9:umount.0 Request processed in 275us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126628.622521:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14247 00002000:00010000:1.0:1746126628.622694:0:7076:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:1.0:1746126628.622720:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39a400/0xb50e825867615422 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed79 expref: 7 pid: 9686 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126628.622749:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136896800/0xb50e825867615499 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x44801000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf0 expref: 6 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126628.622771:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e39b000/0xb50e825867615406 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed64 expref: 5 pid: 10890 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126628.622780:0:7076:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008e4a1800, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746126628.622789:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746126628.622790:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746126628.622792:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126628.630862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126628.631014:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721779072 00000100:00100000:2.0:1746126628.631025:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721779072 00000100:00100000:2.0:1746126628.631072:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9096 00000100:00100000:2.0:1746126628.631080:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+22:1962:x1830945721779072:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:2.0:1746126628.631114:0:20362:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb50e82586760ba84 00000020:00010000:2.0:1746126628.631124:0:20362:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800996af000: total 0 00000100:00080000:2.0:1746126628.631127:0:20362:0:(import.c:66:import_set_state_nolock()) ffff8800996a9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746126628.631157:0:20362:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943304 00000020:00010000:3.0:1746126628.631614:0:7075:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800996af000: total 0 00010000:00010000:3.0:1746126628.631618:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746126628.631662:0:7075:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800996af000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1746126628.631696:0:7075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126628.631700:0:7075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126628.631707:0:7075:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348b0200/0xb50e825867614f9f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea7e expref: 21 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126628.631729:0:7075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126628.631731:0:7075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126628.631733:0:7075:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d33e000/0xb50e82586760c8c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee49941 expref: 20 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126628.631744:0:7075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126628.631746:0:7075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126628.631748:0:7075:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092dc7a00/0xb50e8258676153f8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed56 expref: 19 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126628.631758:0:7075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126628.631759:0:7075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746126628.631761:0:7075:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54200/0xb50e825867615016 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4eacb expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126628.631774:0:7075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126628.631776:0:7075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746126628.631778:0:7075:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee0600/0xb50e82586760bb2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee491df expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126628.631786:0:7075:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800996af000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1746126628.631796:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746126628.631797:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746126628.631799:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746126628.632906:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cdfe2706-19d2-45db-b997-730767bcbc1c+15:1962:x1830945721779072:12345-192.168.203.2@tcp:39:umount.0 Request processed in 1821us (2086us total) trans 8589943305 rc 0/0 00000100:00100000:2.0:1746126628.632915:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9096 00010000:00010000:0.0:1746126628.871347:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126629.103424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.103796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.103819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.103934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.103960:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721779712 00000100:00100000:0.0:1746126629.103968:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721779712 00000100:00100000:0.0:1746126629.104037:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14248 00000100:00100000:0.0:1746126629.104046:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+6:1962:x1830945721779712:12345-192.168.203.2@tcp:9:umount.0 00000100:00100000:1.0:1746126629.104054:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721779200 00000100:00100000:1.0:1746126629.104059:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721779200 00000020:00000080:0.0:1746126629.104074:0:4642:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb50e82586760babc 00000020:00010000:0.0:1746126629.104080:0:4642:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800996ab800: total 0 00000100:00080000:0.0:1746126629.104085:0:4642:0:(import.c:66:import_set_state_nolock()) ffff8800996a8000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1746126629.104090:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721779456 00000100:00100000:1.0:1746126629.104093:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721779456 00000001:00000004:0.0:1746126629.104113:0:4642:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873332 00000100:00100000:0.0:1746126629.104282:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+4:1962:x1830945721779712:12345-192.168.203.2@tcp:9:umount.0 Request processed in 237us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.104289:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14248 00000100:00080000:0.0:1746126629.104347:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1746126629.104362:0:10996:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800996ab800: total 0 00010000:00010000:0.0:1746126629.104378:0:10996:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800996ab800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746126629.104427:0:10996:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e85c00/0xb50e82586760d3eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4a079 expref: 3 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.104450:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721779328 00010000:00010000:0.0:1746126629.104450:0:10996:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800996ab800, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1746126629.104454:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721779328 00000100:00100000:1.0:1746126629.104454:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 714 00010000:00010000:0.0:1746126629.104458:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746126629.104460:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126629.104461:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eae29f21-b1cc-49e5-9783-c4d6118c328d+14:1964:x1830945721779200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126629.104462:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746126629.104471:0:7073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126629.104474:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 715 00000100:00100000:3.0:1746126629.104478:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 716 00000100:00100000:0.0:1746126629.104479:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eae29f21-b1cc-49e5-9783-c4d6118c328d+14:1964:x1830945721779456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126629.104481:0:7073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880098dfc800/0xb50e82586760ba99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee49168 expref: 14 pid: 14543 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.104482:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eae29f21-b1cc-49e5-9783-c4d6118c328d+14:1965:x1830945721779328:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126629.104485:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126629.104487:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126629.104492:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880098dfda00/0xb50e82586760baa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee49199 expref: 13 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.104493:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880099291800/0xb50e82586760baa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee49192 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.104494:0:7073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126629.104500:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126629.104506:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126629.104515:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eae29f21-b1cc-49e5-9783-c4d6118c328d+11:1964:x1830945721779200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 55us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.104515:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eae29f21-b1cc-49e5-9783-c4d6118c328d+11:1964:x1830945721779456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 36us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.104517:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eae29f21-b1cc-49e5-9783-c4d6118c328d+11:1965:x1830945721779328:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 35us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.104521:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 714 00000100:00100000:0.0:1746126629.107404:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 715 00000100:00100000:3.0:1746126629.107434:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 716 00000100:00100000:0.0:1746126629.108471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.108895:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721779840 00000100:00100000:2.0:1746126629.108904:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721779840 00000100:00100000:2.0:1746126629.108962:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14249 00000100:00100000:2.0:1746126629.108971:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+5:1962:x1830945721779840:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:2.0:1746126629.109012:0:4641:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb50e82586760bab5 00000100:00080000:2.0:1746126629.109020:0:4641:0:(import.c:66:import_set_state_nolock()) ffff88012c041800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746126629.109055:0:4641:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840475 00000100:00100000:2.0:1746126629.109231:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+2:1962:x1830945721779840:12345-192.168.203.2@tcp:9:umount.0 Request processed in 261us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.109237:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14249 00000100:00080000:0.0:1746126629.109347:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746126629.109361:0:7076:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126629.115248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.115990:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721780096 00000100:00100000:2.0:1746126629.116001:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721780096 00000100:00080000:0.0:1746126629.116356:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746126629.116973:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9097 00000100:00100000:2.0:1746126629.116993:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+14:1962:x1830945721780096:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:2.0:1746126629.117032:0:20362:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xb50e82586760baae 00000020:00010000:2.0:1746126629.117039:0:20362:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800996ac000: total 0 00000100:00080000:2.0:1746126629.117043:0:20362:0:(import.c:66:import_set_state_nolock()) ffff8800996aa800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746126629.117076:0:20362:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943305 00000100:00100000:2.0:1746126629.117263:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55cb041c-8ab3-4e1a-a61b-2dbe6361acd3+13:1962:x1830945721780096:12345-192.168.203.2@tcp:39:umount.0 Request processed in 281us (2024us total) trans 8589943306 rc 0/0 00000100:00100000:2.0:1746126629.117268:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9097 00000020:00010000:3.0:1746126629.117343:0:7075:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800996ac000: total 0 00010000:00010000:3.0:1746126629.117387:0:7075:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800996ac000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1746126629.117418:0:7075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009eb53c00) 00010000:00010000:3.0:1746126629.117421:0:7075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746126629.117428:0:7075:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57e2000/0xb50e82586760baca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee491c3 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.117464:0:7075:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800996ac000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1746126629.117475:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746126629.117477:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746126629.117478:0:7075:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746126629.144977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.145191:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721780224 00000100:00100000:1.0:1746126629.145200:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721780224 00000100:00100000:1.0:1746126629.145277:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14250 00000100:00100000:1.0:1746126629.145284:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721780224:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126629.145302:0:4642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126629.145322:0:4642:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edf7 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126629.145345:0:4642:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c723, atime: 0x6813c722, ctime: 0x6813c723, blocks: 0x163f 00010000:00010000:1.0:1746126629.145363:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.145365:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.145372:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.145388:0:4642:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 16 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.145398:0:4642:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44600, rc 0) 00000100:00100000:1.0:1746126629.145441:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721780224:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 159us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.145447:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14250 00000100:00100000:0.0:1746126629.145513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00080000:2.0:1746126629.145532:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126629.145593:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721780352 00000100:00100000:3.0:1746126629.145597:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721780352 00000100:00100000:3.0:1746126629.145632:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14251 00000100:00100000:3.0:1746126629.145638:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+19:1965:x1830945721780352:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126629.145646:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126629.145657:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4edfe expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746126629.145672:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c723, atime: 0x6813c722, ctime: 0x6813c723, blocks: 0x1029 00010000:00010000:3.0:1746126629.145680:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.145681:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.145685:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.145695:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 20 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.145701:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a3e800, rc 0) 00000100:00100000:3.0:1746126629.145718:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721780352:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.145722:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14251 00000100:00080000:2.0:1746126629.145751:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126629.150099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.150204:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721780608 00000100:00100000:3.0:1746126629.150214:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721780608 00000100:00080000:2.0:1746126629.150461:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746126629.150495:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3880 00000100:00100000:3.0:1746126629.150505:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f02d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+235:31708:x1830945721780608:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1746126629.150744:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f02d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+236:31708:x1830945721780608:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 241us (653us total) trans 8589943307 rc 0/0 00000100:00100000:3.0:1746126629.150750:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3880 00000100:00100000:0.0:1746126629.152532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.152864:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721780864 00000100:00100000:1.0:1746126629.152872:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721780864 00000100:00100000:1.0:1746126629.152927:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9098 00000100:00100000:1.0:1746126629.152933:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+236:31708:x1830945721780864:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126629.152953:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126629.152956:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746126629.152995:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918fc800/0xb50e8258676153b9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed25 expref: 236 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.153026:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093416200/0xb50e825867610068 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4bbc3 expref: 235 pid: 15560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.153037:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126629.153041:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126629.153437:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676154ae lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee05 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.153528:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44800/0xb50e8258676154b5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126629.153539:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44800/0xb50e8258676154b5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126629.153549:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44800/0xb50e8258676154b5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746126629.153559:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00010000:00010000:1.0:1746126629.153658:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44200/0xb50e8258676154ae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee05 expref: 237 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.153670:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44800/0xb50e8258676154b5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee05 expref: 236 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.153676:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126629.153679:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126629.153680:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44800, rc 0) 00000100:00100000:1.0:1746126629.153729:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+236:31708:x1830945721780864:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 796us (1202us total) trans 8589943308 rc 0/0 00000100:00100000:1.0:1746126629.153735:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9098 00000100:00100000:0.0:1746126629.155753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.155783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.155897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.156028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.156046:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721780992 00000100:00100000:3.0:1746126629.156053:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721780992 00000100:00100000:3.0:1746126629.156087:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781120 00000100:00100000:3.0:1746126629.156089:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781120 00000100:00100000:3.0:1746126629.156098:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781248 00000100:00100000:3.0:1746126629.156100:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781248 00000100:00100000:3.0:1746126629.156118:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14252 00000100:00100000:3.0:1746126629.156124:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1965:x1830945721780992:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126629.156161:0:4641:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156176:0:4641:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.156182:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.156184:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.156187:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156214:0:4641:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.156224:0:4641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 16 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.156236:0:4641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721486208:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.156298:0:4641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126629.156316:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14253 00000100:00100000:3.0:1746126629.156321:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721781120:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126629.156338:0:10890:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156349:0:10890:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156355:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.156356:0:10890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.156359:0:10890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156372:0:10890:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 21 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156379:0:10890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 21 pid: 10890 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746126629.156389:0:10890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721486336:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.156406:0:10890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126629.156425:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14254 00000100:00100000:3.0:1746126629.156430:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721781248:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1746126629.156443:0:23766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156452:0:23766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 21 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.156458:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.156459:0:23766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.156461:0:23766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.156478:0:23766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 21 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.156485:0:23766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 21 pid: 4642 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.156492:0:23766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721486464:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.156505:0:23766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092084780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126629.156892:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781376 00000100:00100000:2.0:1746126629.156897:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781376 00000100:00100000:2.0:1746126629.156917:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14255 00000100:00100000:2.0:1746126629.156922:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721781376:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:2.0:1746126629.156938:0:9686:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.156949:0:9686:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 17 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126629.156954:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.156955:0:9686:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.156957:0:9686:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.156971:0:9686:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 17 pid: 23766 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126629.156977:0:9686:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 17 pid: 23766 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.156995:0:9686:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721486592:192.168.203.2@tcp:104: 00000100:00100000:2.0:1746126629.157023:0:9686:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.158119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.158193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.161560:0:10890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10890:1830945721486336:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126629.161594:0:10890:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.162031:0:23766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:23766:1830945721486464:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126629.162044:0:23766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.162064:0:4641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4641:1830945721486208:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126629.162075:0:4641:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126629.162157:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781504 00000100:00100000:1.0:1746126629.162166:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781504 00000100:00100000:1.0:1746126629.162206:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781632 00000100:00100000:1.0:1746126629.162209:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781632 00000100:00100000:1.0:1746126629.162234:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14256 00000100:00100000:1.0:1746126629.162241:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+18:1965:x1830945721781504:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126629.162287:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.162302:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 18 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.162308:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.162309:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.162312:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 4/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.162346:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 18 pid: 4642 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.162356:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 18 pid: 4642 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.162368:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721486720:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126629.162445:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126629.162460:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14257 00000100:00100000:1.0:1746126629.162465:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721781632:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1746126629.162483:0:4642:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.162493:0:4642:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 22 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.162498:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.162499:0:4642:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.162501:0:4642:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.162516:0:4642:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 22 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.162523:0:4642:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 22 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.162533:0:4642:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721486848:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126629.162552:0:4642:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009348a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.162876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.162926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.163056:0:9686:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9686:1830945721486592:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.163075:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781888 00010000:00010000:2.0:1746126629.163075:0:9686:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.163078:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781888 00010000:00010000:3.0:1746126629.163095:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746126629.163110:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721781760 00000100:00100000:3.0:1746126629.163112:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721781760 00010000:00010000:3.0:1746126629.163119:0:7072:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 19 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.165307:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7473 00000100:00100000:1.0:1746126629.165322:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721781888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126629.165337:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126629.165363:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746126629.165374:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746126629.165394:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570fa00/0xb50e825867615453 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edaa expref: 23 pid: 10890 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746126629.165409:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.165411:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.165414:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165421:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165444:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126629.165486:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721781888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 171us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.165494:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7473 00000100:00100000:1.0:1746126629.165514:0:7892:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7474 00000100:00100000:1.0:1746126629.165518:0:7892:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721781760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126629.165527:0:7892:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126629.165540:0:7892:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 19 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746126629.165547:0:7892:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 19 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746126629.165558:0:7892:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e37800/0xb50e8258676153e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed3a expref: 19 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746126629.165566:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.165567:0:7892:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.165569:0:7892:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165574:0:7892:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165585:0:7892:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126629.165596:0:7892:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721781760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 78us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.165601:0:7892:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7474 00010000:00010000:1.0:1746126629.165712:0:10890:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165720:0:10890:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165739:0:10890:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165745:0:10890:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165751:0:10890:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165757:0:10890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5a3fe00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126629.165760:0:10890:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165766:0:10890:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165775:0:10890:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.165779:0:10890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3fe00/0xb50e8258676154ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10890 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126629.165814:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721781120:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 9493us (10031us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.165822:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14253 00010000:00010000:3.0:1746126629.166117:0:4641:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166124:0:4641:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166139:0:4641:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166145:0:4641:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166151:0:4641:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166155:0:4641:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5a3e200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.166158:0:4641:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166164:0:4641:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166173:0:4641:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.166179:0:4641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a3e200/0xb50e8258676154c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.166220:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721780992:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 10096us (10472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.166226:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14252 00000100:00100000:0.0:1746126629.167252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.168018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.168032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.168093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.168113:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782016 00000100:00100000:0.0:1746126629.168121:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782016 00010000:00010000:0.0:1746126629.168149:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 17 pid: 23766 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.168624:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830945721486720:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126629.168647:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126629.169157:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782144 00000100:00100000:0.0:1746126629.169160:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782144 00010000:00010000:0.0:1746126629.169175:0:7073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 21 pid: 4642 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.169317:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782400 00000100:00100000:2.0:1746126629.169321:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782400 00010000:00010000:2.0:1746126629.169335:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 22 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.169347:0:11130:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782272 00000100:00100000:2.0:1746126629.169348:0:11130:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782272 00010000:00010000:2.0:1746126629.169355:0:11130:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 18 pid: 4642 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.169364:0:11130:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7475 00000100:00100000:2.0:1746126629.169369:0:11130:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721782016:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126629.169379:0:11130:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.169400:0:11130:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 18 pid: 23766 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.169409:0:11130:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 18 pid: 23766 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.169429:0:11130:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e37600/0xb50e8258676153ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed48 expref: 18 pid: 23766 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.169450:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.169452:0:11130:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.169456:0:11130:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.169463:0:11130:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.169481:0:11130:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126629.169514:0:11130:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721782016:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 144us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.169520:0:11130:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7475 00000100:00100000:3.0:1746126629.169645:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7476 00000100:00100000:3.0:1746126629.169655:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721782144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126629.169664:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126629.169677:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 22 pid: 4642 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.169685:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 22 pid: 4642 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.169696:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b210e00/0xb50e825867615445 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ed9c expref: 22 pid: 4642 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.169705:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.169707:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.169709:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169715:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169728:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126629.169739:0:23766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169750:0:23766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169768:0:23766:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169775:0:23766:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169781:0:23766:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169787:0:23766:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c0a600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.169790:0:23766:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169796:0:23766:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169803:0:23766:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169809:0:23766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c0a600/0xb50e8258676154d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.169859:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27c713d7-92e0-4974-b612-500c641c1d6c+21:1965:x1830945721781248:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 13428us (13961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.169867:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14254 00000100:00100000:3.0:1746126629.169898:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721782144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 247us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.169903:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7476 00000100:00100000:3.0:1746126629.169912:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7477 00000100:00100000:3.0:1746126629.169917:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721782400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126629.169923:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126629.169932:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 19 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.169940:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 19 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.169950:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.169951:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.169953:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169959:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.169967:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126629.169989:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721782400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 71us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.169994:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7477 00000100:00100000:3.0:1746126629.170007:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7478 00000100:00100000:3.0:1746126629.170013:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721782272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126629.170019:0:7072:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126629.170028:0:7072:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 16 pid: 4642 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.170036:0:7072:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 16 pid: 4642 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.170045:0:7072:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ace44600/0xb50e8258676154a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edf7 expref: 16 pid: 4642 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.170053:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.170054:0:7072:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.170056:0:7072:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170061:0:7072:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170076:0:7072:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126629.170085:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170091:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170104:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170114:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170119:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170124:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace44c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.170126:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170132:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170140:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170145:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ace44c00/0xb50e8258676154df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.170175:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27c713d7-92e0-4974-b612-500c641c1d6c+15:1965:x1830945721781504:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 7935us (12060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.170181:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14256 00000100:00100000:3.0:1746126629.170203:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27c713d7-92e0-4974-b612-500c641c1d6c+14:1963:x1830945721782272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 190us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.170207:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7478 00010000:00010000:3.0:1746126629.170239:0:9686:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170246:0:9686:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170259:0:9686:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170264:0:9686:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170269:0:9686:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170274:0:9686:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d7f2e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.170276:0:9686:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170281:0:9686:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170289:0:9686:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170295:0:9686:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f2e00/0xb50e8258676154d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.170322:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27c713d7-92e0-4974-b612-500c641c1d6c+13:1965:x1830945721781376:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 13399us (14293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.170328:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14255 00010000:00010000:3.0:1746126629.170492:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a3e800/0xb50e8258676154a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4edfe expref: 18 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.170502:0:4642:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:4642:1830945721486848:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126629.170514:0:4642:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170521:0:4642:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170527:0:4642:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170540:0:4642:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170546:0:4642:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170551:0:4642:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170557:0:4642:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c066800 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.170559:0:4642:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170569:0:4642:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170578:0:4642:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.170583:0:4642:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c066800/0xb50e8258676154e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4642 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.170617:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27c713d7-92e0-4974-b612-500c641c1d6c+17:1965:x1830945721781632:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 8151us (12424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.170622:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14257 00000100:00100000:0.0:1746126629.172092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.173287:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782656 00000100:00100000:1.0:1746126629.173295:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782656 00000100:00100000:1.0:1746126629.173350:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9099 00000100:00100000:1.0:1746126629.173358:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+236:31708:x1830945721782656:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:1.0:1746126629.173406:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746126629.173431:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b54c00/0xb50e825867615039 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ead2 expref: 236 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.173449:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d4e800/0xb50e825867614f98 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea77 expref: 235 pid: 20362 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.173459:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093778400/0xb50e825867614fa6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ea85 expref: 234 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.173467:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:1.0:1746126629.173472:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126629.173501:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126629.173511:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746126629.173519:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000040:00080000:1.0:1746126629.174504:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2725, 88 off231664 00000004:00080000:1.0:1746126629.174513:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751088684703ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174804:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2850, 88 off242760 00000004:00080000:1.0:1746126629.174810:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751088982965ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174851:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2851, 88 off242848 00000004:00080000:1.0:1746126629.174854:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089026940ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174862:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2726, 88 off231752 00000004:00080000:1.0:1746126629.174864:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089036830ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174872:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2727, 88 off231840 00000004:00080000:1.0:1746126629.174874:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089046183ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174897:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2852, 88 off242936 00000004:00080000:1.0:1746126629.174900:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089072287ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174908:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2853, 88 off243024 00000004:00080000:1.0:1746126629.174909:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089082103ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174915:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2728, 88 off231928 00000004:00080000:1.0:1746126629.174917:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089089860ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174923:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2854, 88 off243112 00000004:00080000:1.0:1746126629.174925:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089097520ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174931:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2729, 88 off232016 00000004:00080000:1.0:1746126629.174933:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089105695ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174938:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2855, 88 off243200 00000004:00080000:1.0:1746126629.174941:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089113162ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174946:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2730, 88 off232104 00000004:00080000:1.0:1746126629.174948:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089120715ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174953:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2856, 88 off243288 00000004:00080000:1.0:1746126629.174958:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089130217ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174964:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2731, 88 off232192 00000004:00080000:1.0:1746126629.174967:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089139863ns, next at 687927188999ns, rc = 0 00000040:00080000:1.0:1746126629.174973:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2857, 88 off243376 00000004:00080000:1.0:1746126629.174976:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089148313ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.174994:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2858, 88 off243464 00000004:00080000:1.0:1746126629.174997:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751089169460ns, next at 687959345514ns, rc = 0 00000040:00080000:1.0:1746126629.175004:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2732, 88 off232280 00000004:00080000:1.0:1746126629.175006:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751089178805ns, next at 687927188999ns, rc = 0 00000004:00010000:1.0:1746126629.211768:0:14548:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008dab9500 reply state ffff88008e756800 transno 8589943309 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746126629.211785:0:14548:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746126629.211916:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+235:31708:x1830945721782656:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 38554us (39823us total) trans 8589943309 rc 0/0 00000100:00100000:1.0:1746126629.211926:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9099 00000001:00080000:1.0:1746126629.211961:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943300 is committed 00000001:00080000:1.0:1746126629.211971:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943287 is committed 00000001:00080000:1.0:1746126629.211991:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943309 is committed 00000004:00080000:1.0:1746126629.211996:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2116 committed 00000004:00080000:1.0:1746126629.212002:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2239 committed 00000004:00080000:1.0:1746126629.212009:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2238 committed 00000004:00080000:1.0:1746126629.212010:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2115 committed 00000004:00080000:1.0:1746126629.212012:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2237 committed 00000004:00080000:1.0:1746126629.212013:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2114 committed 00000004:00080000:1.0:1746126629.212016:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2236 committed 00000004:00080000:1.0:1746126629.212018:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2113 committed 00000004:00080000:1.0:1746126629.212019:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2235 committed 00000004:00080000:1.0:1746126629.212020:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2112 committed 00000004:00080000:1.0:1746126629.212022:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2234 committed 00000004:00080000:1.0:1746126629.212024:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2233 committed 00000004:00080000:1.0:1746126629.212026:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2111 committed 00000004:00080000:1.0:1746126629.212027:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2110 committed 00000004:00080000:1.0:1746126629.212029:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2232 committed 00000004:00080000:1.0:1746126629.212030:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2231 committed 00000004:00080000:1.0:1746126629.212032:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2109 committed 00000001:00100000:1.0:1746126629.212059:0:14617:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55cb041c-8ab3-4e1a-a61b-2dbe6361acd3 00000001:00080000:1.0:1746126629.212064:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943306 is committed 00000001:00100000:1.0:1746126629.212067:0:14617:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cdfe2706-19d2-45db-b997-730767bcbc1c 00000001:00080000:1.0:1746126629.212072:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943305 is committed 00000020:00000080:1.0:1746126629.212112:0:14617:0:(genops.c:904:class_export_put()) final put ffff8800996af000/cdfe2706-19d2-45db-b997-730767bcbc1c 00000020:00000080:1.0:1746126629.212137:0:14617:0:(genops.c:904:class_export_put()) final put ffff8800996ac000/55cb041c-8ab3-4e1a-a61b-2dbe6361acd3 00000100:00100000:1.0:1746126629.212273:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721486976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212315:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212353:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721487488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212364:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212376:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746126629.212379:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721487360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212389:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212397:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721487872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212406:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212418:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212437:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212447:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212455:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746126629.212458:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212467:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212474:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009204e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.212484:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.212501:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721486976 00000100:00100000:1.0:1746126629.212507:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721486976 00010000:00010000:2.0:1746126629.212547:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126629.212555:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126629.212561:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126629.212566:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5932000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126629.212570:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126629.212575:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126629.212588:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126629.212591:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126629.212595:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746126629.212600:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5932000/0xb50e8258676154ed lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746126629.212695:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.212720:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.212737:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.212748:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.212757:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746126629.212760:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.212770:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.212778:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.212787:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.212798:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487488 00000100:00100000:2.0:1746126629.212801:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487488 00000100:00100000:2.0:1746126629.212849:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487360 00000100:00100000:2.0:1746126629.212851:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487360 00000100:00100000:2.0:1746126629.212857:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487872 00000100:00100000:2.0:1746126629.212858:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487872 00000100:00100000:2.0:1746126629.212869:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487232 00000100:00100000:2.0:1746126629.212870:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487232 00000100:00100000:2.0:1746126629.212875:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487744 00000100:00100000:2.0:1746126629.212876:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487744 00000100:00100000:2.0:1746126629.212882:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487104 00000100:00100000:2.0:1746126629.212883:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487104 00000100:00100000:2.0:1746126629.212888:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721487616 00000100:00100000:2.0:1746126629.212889:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721487616 00000100:00100000:2.0:1746126629.212895:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488384 00000100:00100000:2.0:1746126629.212897:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488384 00000100:00100000:2.0:1746126629.212905:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488896 00000100:00100000:2.0:1746126629.212906:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488896 00000100:00100000:2.0:1746126629.212911:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488000 00000100:00100000:2.0:1746126629.212912:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488000 00000100:00100000:2.0:1746126629.212916:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488512 00000100:00100000:2.0:1746126629.212918:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488512 00000100:00100000:2.0:1746126629.212924:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14258 00000100:00100000:2.0:1746126629.212930:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3297:x1830945721487488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213142:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721487488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (775us total) trans 17179873333 rc 0/0 00000100:00100000:2.0:1746126629.213147:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14258 00000100:00100000:2.0:1746126629.213157:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14259 00000100:00100000:2.0:1746126629.213161:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3297:x1830945721487360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213264:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721487360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (873us total) trans 17179873334 rc 0/0 00000100:00100000:2.0:1746126629.213269:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14259 00000100:00100000:2.0:1746126629.213277:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14260 00000100:00100000:2.0:1746126629.213280:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3297:x1830945721487872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213354:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721487872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (946us total) trans 17179873335 rc 0/0 00000100:00100000:2.0:1746126629.213360:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14260 00000100:00100000:2.0:1746126629.213369:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14261 00000100:00100000:2.0:1746126629.213373:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830945721487232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213442:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721487232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1011us total) trans 17179873336 rc 0/0 00000100:00100000:2.0:1746126629.213447:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14261 00000100:00100000:2.0:1746126629.213455:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14262 00000100:00100000:2.0:1746126629.213458:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830945721487744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213518:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721487744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (1069us total) trans 17179873337 rc 0/0 00000100:00100000:2.0:1746126629.213522:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14262 00000100:00100000:2.0:1746126629.213533:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14263 00000100:00100000:2.0:1746126629.213536:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830945721487104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213616:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721487104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1147us total) trans 17179873338 rc 0/0 00000100:00100000:2.0:1746126629.213622:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14263 00000100:00100000:2.0:1746126629.213630:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14264 00000100:00100000:2.0:1746126629.213633:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830945721487616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.213702:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721487616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1216us total) trans 17179873339 rc 0/0 00000100:00100000:2.0:1746126629.213706:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14264 00000100:00100000:2.0:1746126629.213714:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14265 00000100:00100000:2.0:1746126629.213717:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830945721488384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.213856:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721488384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (1135us total) trans 21474840476 rc 0/0 00000100:00100000:2.0:1746126629.213860:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14265 00000100:00100000:2.0:1746126629.213868:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14266 00000100:00100000:2.0:1746126629.213871:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830945721488896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.213936:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721488896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1186us total) trans 21474840477 rc 0/0 00000100:00100000:2.0:1746126629.213943:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14266 00000100:00100000:2.0:1746126629.213949:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14267 00000100:00100000:2.0:1746126629.213953:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830945721488000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214055:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721488000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (1283us total) trans 21474840478 rc 0/0 00000100:00100000:2.0:1746126629.214061:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14267 00000100:00100000:2.0:1746126629.214069:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14268 00000100:00100000:2.0:1746126629.214073:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830945721488512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214136:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830945721488512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1348us total) trans 21474840479 rc 0/0 00000100:00100000:2.0:1746126629.214141:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14268 00000100:00080000:2.0:1746126629.214161:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746126629.214164:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746126629.214176:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.214209:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.214237:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873322 gen 2 00000004:00080000:2.0:1746126629.214242:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15c00, transno 17179873275 00000004:00080000:2.0:1746126629.214250:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15500, transno 17179873276 00000004:00080000:2.0:1746126629.214252:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14e00, transno 17179873277 00000004:00080000:2.0:1746126629.214254:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15180, transno 17179873278 00000004:00080000:2.0:1746126629.214256:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b17800, transno 17179873279 00000004:00080000:2.0:1746126629.214258:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b15f80, transno 17179873280 00000004:00080000:2.0:1746126629.214260:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14700, transno 17179873281 00000004:00080000:2.0:1746126629.214262:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b14380, transno 17179873282 00000004:00080000:2.0:1746126629.214264:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091da0380, transno 17179873283 00000004:00080000:2.0:1746126629.214267:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f57100, transno 17179873284 00000004:00080000:2.0:1746126629.214269:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f57800, transno 17179873285 00000004:00080000:2.0:1746126629.214270:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f256300, transno 17179873286 00000004:00080000:2.0:1746126629.214272:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f56680, transno 17179873287 00000004:00080000:2.0:1746126629.214274:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f257800, transno 17179873288 00000004:00080000:2.0:1746126629.214276:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f56d80, transno 17179873289 00000004:00080000:2.0:1746126629.214277:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f57b80, transno 17179873290 00000004:00080000:2.0:1746126629.214279:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a448e300, transno 17179873291 00000004:00080000:2.0:1746126629.214281:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f55880, transno 17179873292 00000004:00080000:2.0:1746126629.214283:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fce00, transno 17179873305 00000004:00080000:2.0:1746126629.214285:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fdc00, transno 17179873306 00000004:00080000:2.0:1746126629.214287:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2ff800, transno 17179873307 00000004:00080000:2.0:1746126629.214289:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8ca80, transno 17179873308 00000004:00080000:2.0:1746126629.214291:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fdf80, transno 17179873309 00000004:00080000:2.0:1746126629.214293:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fd500, transno 17179873310 00000004:00080000:2.0:1746126629.214295:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fea00, transno 17179873311 00000004:00080000:2.0:1746126629.214296:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fd180, transno 17179873312 00000004:00080000:2.0:1746126629.214297:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b2fed80, transno 17179873313 00000004:00080000:2.0:1746126629.214299:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcce00, transno 17179873314 00000004:00080000:2.0:1746126629.214301:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcea00, transno 17179873315 00000004:00080000:2.0:1746126629.214303:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02f100, transno 17179873316 00000004:00080000:2.0:1746126629.214305:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bced80, transno 17179873317 00000004:00080000:2.0:1746126629.214307:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcf800, transno 17179873318 00000004:00080000:2.0:1746126629.214309:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02ea00, transno 17179873319 00000004:00080000:2.0:1746126629.214310:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135bcd880, transno 17179873320 00000004:00080000:2.0:1746126629.214312:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02c000, transno 17179873321 00000004:00080000:2.0:1746126629.214314:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f02d880, transno 17179873322 00000100:00100000:2.0:1746126629.214318:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009204f100 x1830945721487104/t17179873338(17179873338) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126645 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746126629.214327:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204f100/2, rc 0, transno 17179873338 00000100:00100000:2.0:1746126629.214331:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.214338:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204e300/2, rc 0, transno 17179873339 00000100:00100000:2.0:1746126629.214340:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.214345:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204d880/2, rc 0, transno 17179873336 00000100:00100000:2.0:1746126629.214348:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.214352:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204fb80/2, rc 0, transno 17179873337 00000100:00100000:2.0:1746126629.214354:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721487744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.214360:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746126629.214364:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214376:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.214383:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.214403:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488256 00000100:00100000:2.0:1746126629.214406:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488256 00000100:00100000:2.0:1746126629.214417:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488768 00000100:00100000:2.0:1746126629.214418:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488768 00000100:00100000:2.0:1746126629.214422:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488128 00000100:00100000:2.0:1746126629.214423:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488128 00000100:00100000:2.0:1746126629.214427:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721488640 00000100:00100000:2.0:1746126629.214428:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721488640 00000100:00100000:2.0:1746126629.214434:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14269 00000100:00100000:2.0:1746126629.214437:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721488256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214507:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721488256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (310us total) trans 21474840480 rc 0/0 00000100:00100000:2.0:1746126629.214513:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14269 00000100:00100000:2.0:1746126629.214520:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14270 00000100:00100000:2.0:1746126629.214523:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721488768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214598:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721488768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (377us total) trans 21474840481 rc 0/0 00000100:00100000:2.0:1746126629.214602:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14270 00000100:00100000:2.0:1746126629.214608:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14271 00000100:00100000:2.0:1746126629.214611:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721488128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214682:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721488128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (304us total) trans 21474840482 rc 0/0 00000100:00100000:2.0:1746126629.214686:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14271 00000100:00100000:2.0:1746126629.214693:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14272 00000100:00100000:2.0:1746126629.214696:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830945721488640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.214754:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830945721488640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (360us total) trans 21474840483 rc 0/0 00000100:00100000:2.0:1746126629.214758:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14272 00000100:00100000:2.0:1746126629.214775:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840467 gen 2 00000004:00080000:2.0:1746126629.214777:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e723b80, transno 21474840452 00000004:00080000:2.0:1746126629.214782:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8cad80, transno 21474840453 00000004:00080000:2.0:1746126629.214784:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8ed80, transno 21474840454 00000004:00080000:2.0:1746126629.214786:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c9500, transno 21474840455 00000004:00080000:2.0:1746126629.214788:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c8380, transno 21474840456 00000004:00080000:2.0:1746126629.214790:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8ea00, transno 21474840457 00000004:00080000:2.0:1746126629.214792:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e723800, transno 21474840458 00000004:00080000:2.0:1746126629.214794:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4c8f100, transno 21474840459 00000004:00080000:2.0:1746126629.214796:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5956680, transno 21474840460 00000004:00080000:2.0:1746126629.214798:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f54700, transno 21474840461 00000004:00080000:2.0:1746126629.214800:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4f55f80, transno 21474840462 00000004:00080000:2.0:1746126629.214802:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5955180, transno 21474840463 00000004:00080000:2.0:1746126629.214804:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5955500, transno 21474840464 00000004:00080000:2.0:1746126629.214805:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5954700, transno 21474840465 00000004:00080000:2.0:1746126629.214807:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5956d80, transno 21474840466 00000004:00080000:2.0:1746126629.214809:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5956300, transno 21474840467 00000100:00100000:2.0:1746126629.214812:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008e3a9500 x1830945721488000/t21474840478(21474840478) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746126645 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746126629.214817:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a9500/2, rc 0, transno 21474840478 00000100:00100000:2.0:1746126629.214819:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.214841:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3ab480/2, rc 0, transno 21474840479 00000100:00100000:2.0:1746126629.214844:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.214851:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a8700/2, rc 0, transno 21474840476 00000100:00100000:2.0:1746126629.214853:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.214858:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a8000/2, rc 0, transno 21474840477 00000100:00100000:2.0:1746126629.214860:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721488896:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.215033:0:14592:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 16 done 00000004:00080000:2.0:1746126629.215051:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204f480/2, rc 0, transno 17179873334 00000100:00100000:2.0:1746126629.215054:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721487360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.215060:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204ea00/2, rc 0, transno 17179873335 00000100:00100000:2.0:1746126629.215062:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721487872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.215068:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204ed80/2, rc 0, transno 17179873333 00000100:00100000:2.0:1746126629.215070:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721487488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.215081:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a9880/2, rc 0, transno 21474840482 00000100:00100000:2.0:1746126629.215083:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.215088:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a8380/2, rc 0, transno 21474840483 00000100:00100000:2.0:1746126629.215090:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488640:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.215094:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a8e00/2, rc 0, transno 21474840480 00000100:00100000:2.0:1746126629.215096:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.215100:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e3a9180/2, rc 0, transno 21474840481 00000100:00100000:2.0:1746126629.215101:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721488768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126629.221309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000020:00000080:3.0:1746126629.221338:0:13479:0:(genops.c:863:class_export_destroy()) destroying export ffff8800996af000/cdfe2706-19d2-45db-b997-730767bcbc1c for lustre-MDT0000 00000020:00000080:3.0:1746126629.221394:0:13479:0:(genops.c:863:class_export_destroy()) destroying export ffff8800996ac000/55cb041c-8ab3-4e1a-a61b-2dbe6361acd3 for lustre-MDT0000 00000020:00000080:3.0:1746126629.221424:0:13479:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800996a9800 for lustre-MDT0000 00000020:00000080:3.0:1746126629.221429:0:13479:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800996aa800 for lustre-MDT0000 00000100:00100000:3.0:1746126629.221501:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14273 00000100:00100000:3.0:1746126629.221516:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3297:x1830945721486976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126629.221784:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009204e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3297:x1830945721486976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (9467us total) trans 17179873340 rc 0/0 00000100:00100000:3.0:1746126629.221791:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14273 00000100:00100000:3.0:1746126629.222453:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782784 00000100:00100000:3.0:1746126629.222462:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782784 00000100:00100000:3.0:1746126629.222498:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9100 00000100:00100000:3.0:1746126629.222504:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31708:x1830945721782784:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126629.222518:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126629.222535:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee0c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.222586:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.222600:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.222618:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126629.222621:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126629.222624:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e67400, rc 0) 00000100:00100000:3.0:1746126629.222660:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31708:x1830945721782784:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 155us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.222666:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9100 00000004:00080000:2.0:1746126629.222989:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009204c700/2, rc 0, transno 17179873340 00000100:00100000:2.0:1746126629.222996:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009204c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721486976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126629.223112:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 36 done 00000100:00100000:2.0:1746126629.223236:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746126629.223247:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721489024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.223616:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126629.223693:0:4642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721489024 00000100:00100000:1.0:1746126629.223697:0:4642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721489024 00000100:00100000:1.0:1746126629.223719:0:4642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14274 00000100:00100000:1.0:1746126629.223724:0:4642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830945721489024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126629.223905:0:4642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1830945721489024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (289us total) trans 17179873341 rc 0/0 00000100:00100000:1.0:1746126629.223911:0:4642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14274 00000004:00080000:2.0:1746126629.224677:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab9880/2, rc 0, transno 17179873341 00000100:00100000:2.0:1746126629.224682:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721489024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126629.229744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.229818:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721782912 00000100:00100000:0.0:1746126629.229850:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721782912 00000100:00100000:3.0:1746126629.229915:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9101 00000100:00100000:3.0:1746126629.229923:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+222:31708:x1830945721782912:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126629.229942:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126629.229960:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66000/0xb50e8258676154fb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee13 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.230046:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66a00/0xb50e825867615502 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126629.230058:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66a00/0xb50e825867615502 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126629.230068:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66a00/0xb50e825867615502 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746126629.230093:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2a7:0x0]: returning size 9170784 00000004:00200000:3.0:1746126629.230096:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746126629.230110:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66a00/0xb50e825867615502 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746126629.230129:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66000/0xb50e8258676154fb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee13 expref: 224 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.230142:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66a00/0xb50e825867615502 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee13 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.230148:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126629.230151:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126629.230154:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e66a00, rc 0) 00000100:00100000:3.0:1746126629.230211:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+223:31708:x1830945721782912:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 288us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.230216:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9101 00000100:00100000:0.0:1746126629.233338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.233375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.233455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.233468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.233594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.233746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.233985:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783040 00000100:00100000:2.0:1746126629.233994:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783040 00000100:00100000:2.0:1746126629.234038:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783296 00000100:00100000:2.0:1746126629.234041:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783296 00000100:00100000:2.0:1746126629.234053:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783552 00000100:00100000:2.0:1746126629.234055:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783552 00000100:00100000:2.0:1746126629.234063:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783168 00000100:00100000:2.0:1746126629.234064:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783168 00000100:00100000:2.0:1746126629.234074:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783424 00000100:00100000:2.0:1746126629.234076:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783424 00000100:00100000:2.0:1746126629.234089:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14275 00000100:00100000:2.0:1746126629.234096:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721783040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126629.234114:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126629.234135:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee1a expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126629.234159:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31d:0x0] initial LVB size: 1048576, mtime: 0x6813c71f, atime: 0x6813c71d, ctime: 0x6813c71f, blocks: 0x79f 00010000:00010000:2.0:1746126629.234178:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234180:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234188:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126629.234203:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126629.234214:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11000, rc 0) 00000100:00100000:2.0:1746126629.234256:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721783040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 160us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.234261:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14275 00000100:00100000:2.0:1746126629.234276:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14276 00000100:00100000:2.0:1746126629.234280:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721783296:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126629.234287:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126629.234303:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee28 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746126629.234316:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x323:0x0] initial LVB size: 2097152, mtime: 0x6813c722, atime: 0x6813c720, ctime: 0x6813c722, blocks: 0x821 00010000:00010000:2.0:1746126629.234325:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234327:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234330:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126629.234339:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 19 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126629.234344:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11e00, rc 0) 00000100:00100000:2.0:1746126629.234359:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721783296:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 79us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.234364:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14276 00000100:00100000:2.0:1746126629.234373:0:4641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783680 00000100:00100000:2.0:1746126629.234375:0:4641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783680 00000100:00100000:2.0:1746126629.234383:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14277 00000100:00100000:2.0:1746126629.234387:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721783552:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126629.234392:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126629.234395:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14278 00010000:00010000:2.0:1746126629.234399:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee36 expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126629.234405:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721783168:12345-192.168.203.2@tcp:101:lfs.0 00002000:00010000:2.0:1746126629.234409:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x321:0x0] initial LVB size: 4976480, mtime: 0x6813c723, atime: 0x6813c722, ctime: 0x6813c723, blocks: 0x163f 00010000:00010000:0.0:1746126629.234413:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126629.234416:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234418:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234421:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126629.234421:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee21 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.234429:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746126629.234438:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 2097152, mtime: 0x6813c723, atime: 0x6813c723, ctime: 0x6813c723, blocks: 0x821 00010000:00010000:2.0:1746126629.234440:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd11c00, rc 0) 00010000:00010000:0.0:1746126629.234448:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.234449:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.234454:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126629.234459:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721783552:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 71us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.234464:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14277 00010000:00010000:0.0:1746126629.234465:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126629.234472:0:4641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14279 00010000:00010000:0.0:1746126629.234472:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a03000, rc 0) 00000100:00100000:2.0:1746126629.234476:0:4641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+15:1964:x1830945721783424:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126629.234481:0:4641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126629.234486:0:4641:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee2f expref: -99 pid: 4641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126629.234489:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721783168:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 87us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.234494:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14278 00002000:00010000:2.0:1746126629.234496:0:4641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x31f:0x0] initial LVB size: 2097152, mtime: 0x6813c722, atime: 0x6813c71a, ctime: 0x6813c722, blocks: 0x821 00010000:00010000:2.0:1746126629.234502:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234503:0:4641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.234506:0:4641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126629.234509:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14280 00010000:00010000:2.0:1746126629.234514:0:4641:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 16 pid: 4641 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126629.234514:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721783680:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1746126629.234520:0:4641:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd10a00, rc 0) 00010000:00010000:0.0:1746126629.234520:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126629.234527:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee3d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.234534:0:4641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721783424:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 58us (941us total) trans 0 rc 0/0 00002000:00010000:0.0:1746126629.234538:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x325:0x0] initial LVB size: 4194304, mtime: 0x6813c723, atime: 0x6813c722, ctime: 0x6813c723, blocks: 0x1029 00000100:00100000:2.0:1746126629.234539:0:4641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14279 00010000:00010000:0.0:1746126629.234545:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.234546:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.234550:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126629.234558:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126629.234564:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a02a00, rc 0) 00000100:00100000:0.0:1746126629.234576:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721783680:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 63us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.234580:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14280 00000100:00100000:0.0:1746126629.246490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.246531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.246557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.246586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.246601:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.246615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.246622:0:21198:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721783936 00000100:00100000:0.0:1746126629.246629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.246631:0:21198:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721783936 00000100:00100000:0.0:1746126629.246665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.246692:0:21198:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8154 00000100:00100000:1.0:1746126629.246701:0:21198:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721783936:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126629.246737:0:21198:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.246750:0:21198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.246752:0:21198:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.246757:0:21198:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.246768:0:21198:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126629.246781:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721784192 00000100:00100000:0.0:1746126629.246784:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721784192 00000100:00100000:0.0:1746126629.246810:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721784448 00000100:00100000:0.0:1746126629.246812:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721784448 00000100:00100000:0.0:1746126629.246852:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721784704 00000100:00100000:0.0:1746126629.246855:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721784704 00000100:00100000:0.0:1746126629.246871:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721784960 00000100:00100000:0.0:1746126629.246872:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721784960 00000100:00100000:0.0:1746126629.246880:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721785216 00000100:00100000:0.0:1746126629.246882:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721785216 00000100:00100000:0.0:1746126629.246890:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721785472 00000100:00100000:0.0:1746126629.246892:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721785472 00000100:00100000:0.0:1746126629.246898:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721785728 00000100:00100000:0.0:1746126629.246900:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721785728 00000100:00100000:0.0:1746126629.246910:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8155 00000100:00100000:0.0:1746126629.246914:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+23:1963:x1830945721784192:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126629.246933:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.246941:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.246942:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.246945:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.246954:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126629.248392:0:21464:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8156 00000100:00100000:0.0:1746126629.248403:0:21464:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721784448:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:0.0:1746126629.248432:0:21464:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.248442:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.248444:0:21464:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.248446:0:21464:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.248456:0:21464:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126629.248781:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8157 00000100:00100000:1.0:1746126629.248789:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721784704:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:1.0:1746126629.248809:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.248816:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.248817:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.248820:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.248848:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.249762:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8158 00000100:00100000:3.0:1746126629.249771:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+19:1963:x1830945721784960:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126629.249788:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.249796:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.249798:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.249800:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.249809:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.251060:0:31371:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8159 00000100:00100000:3.0:1746126629.251069:0:31371:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721785216:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126629.251090:0:31371:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.251098:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.251099:0:31371:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.251103:0:31371:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.251111:0:31371:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.251174:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8160 00000100:00100000:3.0:1746126629.251179:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721785472:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:3.0:1746126629.251192:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.251198:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.251199:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.251202:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.251208:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.252948:0:21460:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8161 00000100:00100000:2.0:1746126629.252962:0:21460:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721785728:12345-192.168.203.2@tcp:3:lfs.0 00010000:00010000:2.0:1746126629.253003:0:21460:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.253014:0:21460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.253015:0:21460:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.253019:0:21460:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.253030:0:21460:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280480:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280498:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280506:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280512:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ada6000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126629.280515:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280521:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280538:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.280548:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ada6000/0xb50e82586761553a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.280649:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27c713d7-92e0-4974-b612-500c641c1d6c+26:1963:x1830945721784192:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 33727us (34111us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126629.280658:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8155 00010000:00010000:3.0:1746126629.291570:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.291587:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.291594:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.291601:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e66c00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.291605:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.291612:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.291630:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.291635:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e66c00/0xb50e82586761554f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.291744:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721784960:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 41969us (45135us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126629.291754:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8158 00010000:00010000:3.0:1746126629.298196:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.298214:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.298222:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.298228:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093fa3000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.298233:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.298240:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.298259:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.298265:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093fa3000/0xb50e82586761555d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.298360:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721785472:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 47174us (51723us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126629.298371:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8160 00010000:00010000:2.0:1746126629.314933:0:21460:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.314952:0:21460:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.314960:0:21460:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.314967:0:21460:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd11600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126629.314971:0:21460:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.314990:0:21460:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.315010:0:21460:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.315017:0:21460:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd11600/0xb50e825867615564 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.315119:0:21460:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27c713d7-92e0-4974-b612-500c641c1d6c+24:1963:x1830945721785728:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 62156us (68447us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126629.315129:0:21460:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8161 00010000:00010000:1.0:1746126629.317452:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.317467:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.317474:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.317480:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef64e00 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126629.317483:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.317490:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.317506:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.317512:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef64e00/0xb50e825867615548 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126629.319598:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27c713d7-92e0-4974-b612-500c641c1d6c+18:1963:x1830945721784704:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 70799us (73000us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126629.319610:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8157 00010000:00010000:1.0:1746126629.322660:0:21198:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.322676:0:21198:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.322684:0:21198:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.322691:0:21198:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135649200 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:1.0:1746126629.322695:0:21198:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.322701:0:21198:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.322720:0:21198:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.322726:0:21198:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135649200/0xb50e825867615533 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21198 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126629.322815:0:21198:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721783936:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 76111us (76331us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126629.322850:0:21198:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8154 00010000:00010000:3.0:1746126629.329120:0:31371:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.329138:0:31371:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.329151:0:31371:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.329157:0:31371:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e66000 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:3.0:1746126629.329161:0:31371:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.329168:0:31371:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.329186:0:31371:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.329191:0:31371:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e66000/0xb50e825867615556 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31371 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.329290:0:31371:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:27c713d7-92e0-4974-b612-500c641c1d6c+22:1963:x1830945721785216:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 78217us (82667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126629.329302:0:31371:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8159 00010000:00010000:2.0:1746126629.332939:0:21464:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.332956:0:21464:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.332964:0:21464:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.332971:0:21464:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ada6600 already unused, calling callback (ffffffffa08a5d70) 00010000:00010000:2.0:1746126629.332976:0:21464:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.332993:0:21464:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.333013:0:21464:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.333018:0:21464:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ada6600/0xb50e825867615541 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.333092:0:21464:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721784448:12345-192.168.203.2@tcp:3:lfs.0 Request processed in 84688us (86530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126629.333102:0:21464:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8156 00000100:00100000:0.0:1746126629.340568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.340646:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721785984 00000100:00100000:2.0:1746126629.340655:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721785984 00000100:00100000:2.0:1746126629.340712:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9102 00000100:00100000:2.0:1746126629.340719:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:31708:x1830945721785984:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:2.0:1746126629.340771:0:20362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.340798:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e66a00/0xb50e825867615502 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee13 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.340814:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126629.340818:0:20362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126629.340880:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.340892:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.340901:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000004:00010000:2.0:1746126629.341091:0:20362:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a4f56d80 reply state ffff88009e6ed000 transno 8589943310 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00000100:00100000:2.0:1746126629.341098:0:20362:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746126629.341169:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+224:31708:x1830945721785984:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 449us (612us total) trans 8589943310 rc 0/0 00000100:00100000:2.0:1746126629.341175:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9102 00010000:00010000:3.0:1746126629.344070:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126629.344085:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126629.344092:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126629.344102:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebba000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746126629.344106:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126629.344112:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126629.344129:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126629.344132:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126629.344136:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:3.0:1746126629.344141:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebba000/0xb50e82586761556b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00000100:00100000:1.0:1746126629.344670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.344799:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786112 00000100:00100000:3.0:1746126629.344808:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786112 00000100:00100000:3.0:1746126629.344877:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14281 00000100:00100000:3.0:1746126629.344885:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:31708:x1830945721786112:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126629.344901:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126629.344915:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867615572 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee44 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.344939:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.344946:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.344948:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.344950:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867615572 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee44 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.344994:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.345005:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.345017:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721489152:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.345736:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.347706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.347816:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721489152:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126629.347865:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867615572 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee44 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.347880:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace45200, rc 0) 00000100:00100000:3.0:1746126629.347928:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:31708:x1830945721786112:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3043us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.347935:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14281 00000100:00100000:2.0:1746126629.348306:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786240 00000100:00100000:2.0:1746126629.348312:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786240 00010000:00010000:2.0:1746126629.348339:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.348371:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7479 00000100:00100000:2.0:1746126629.348377:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1963:x1830945721786240:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126629.348389:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.348410:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.348420:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.348441:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11000/0xb50e825867615509 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee1a expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.348455:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.348456:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.348462:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867615572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee44 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.348468:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867615572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee44 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.348492:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800ace45200/0xb50e825867615572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee44 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.348503:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721489280:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126629.348561:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7540 going to sleep for 11 seconds 00000100:00100000:2.0:1746126629.350451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.350610:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786368 00000100:00100000:3.0:1746126629.350617:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786368 00000100:00100000:0.0:1746126629.350710:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721489280:192.168.203.2@tcp:105: 00010000:00010000:0.0:1746126629.350726:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126629.350813:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1963:x1830945721786240:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2435us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.350821:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7479 00000100:00100000:3.0:1746126629.350913:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14282 00000100:00100000:3.0:1746126629.350919:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:31708:x1830945721786368:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126629.350933:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126629.350949:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ace44400/0xb50e825867615579 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee4b expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.350974:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.350990:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.350991:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.350994:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44400/0xb50e825867615579 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee4b expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.351019:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126629.351030:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.351040:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721489408:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.351088:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.353241:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721489408:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126629.353271:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ace44400/0xb50e825867615579 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee4b expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.353286:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace44400, rc 0) 00000100:00100000:0.0:1746126629.353324:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:31708:x1830945721786368:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2404us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.353331:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14282 00000100:00100000:0.0:1746126629.353777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.353924:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786496 00000100:00100000:2.0:1746126629.353931:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786496 00010000:00010000:2.0:1746126629.353959:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.354074:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7480 00000100:00100000:2.0:1746126629.354081:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+21:1964:x1830945721786496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126629.354094:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.354116:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.354126:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.354149:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a03000/0xb50e82586761551e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee21 expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.354174:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.354176:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.354182:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ace44400/0xb50e825867615579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee4b expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.354190:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ace44400/0xb50e825867615579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee4b expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.354221:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800ace44400/0xb50e825867615579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee4b expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.354233:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721489536:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126629.354295:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.356435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.356511:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721489536:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126629.356530:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126629.356564:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1964:x1830945721786496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2484us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.356573:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7480 00000100:00100000:1.0:1746126629.356924:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786624 00000100:00100000:1.0:1746126629.356930:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786624 00000100:00100000:1.0:1746126629.356963:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14283 00000100:00100000:1.0:1746126629.356969:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:31708:x1830945721786624:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126629.356992:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126629.357009:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009920e000/0xb50e825867615580 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee52 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.357033:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 21 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.357039:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.357040:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.357044:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009920e000/0xb50e825867615580 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee52 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.357067:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 21 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.357091:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 21 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.357105:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721489664:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126629.357168:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.360082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.360174:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786752 00000100:00100000:2.0:1746126629.360183:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786752 00010000:00010000:2.0:1746126629.360218:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 22 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.360258:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7481 00000100:00100000:2.0:1746126629.360265:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+22:1965:x1830945721786752:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126629.360281:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.360303:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 22 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.360314:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 22 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.360339:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.360341:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.360348:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009920e000/0xb50e825867615580 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee52 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.360360:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009920e000/0xb50e825867615580 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee52 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.360390:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009920e000/0xb50e825867615580 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee52 expref: 22 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.360402:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721489792:192.168.203.2@tcp:105: 00010000:00010000:1.0:1746126629.360452:0:17475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd11e00/0xb50e825867615510 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee28 expref: 22 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.360480:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126629.360700:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721489664:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126629.360722:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009920e000/0xb50e825867615580 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee52 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.360731:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009920e000, rc 0) 00000100:00100000:1.0:1746126629.360758:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:31708:x1830945721786624:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3789us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.360765:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14283 00000100:00100000:2.0:1746126629.362497:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721489792:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126629.362516:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126629.362558:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1965:x1830945721786752:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2293us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.362567:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7481 00000100:00100000:0.0:1746126629.363009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.363246:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721786880 00000100:00100000:1.0:1746126629.363253:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721786880 00000100:00100000:1.0:1746126629.363294:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14284 00000100:00100000:1.0:1746126629.363301:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:31708:x1830945721786880:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126629.363317:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126629.363333:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135648800/0xb50e825867615587 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee59 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.363360:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.363372:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.363374:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.363377:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135648800/0xb50e825867615587 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee59 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.363405:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.363416:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.363427:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721489920:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126629.364506:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126629.367914:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721489920:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126629.367947:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135648800/0xb50e825867615587 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee59 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.367963:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135648800, rc 0) 00000100:00100000:1.0:1746126629.368020:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:31708:x1830945721786880:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 4719us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.368029:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14284 00000100:00100000:0.0:1746126629.368291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.368457:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787008 00000100:00100000:2.0:1746126629.368464:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787008 00010000:00010000:2.0:1746126629.368493:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746126629.368525:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7482 00000100:00100000:2.0:1746126629.368531:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e2c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721787008:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126629.368543:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.368564:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.368580:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.368600:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd10a00/0xb50e825867615525 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee2f expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746126629.368625:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.368627:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126629.368634:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135648800/0xb50e825867615587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee59 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.368642:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135648800/0xb50e825867615587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee59 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126629.368671:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135648800/0xb50e825867615587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee59 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126629.368681:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721490048:192.168.203.2@tcp:105: 00000100:00100000:2.0:1746126629.368744:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ac7780 going to sleep for 11 seconds 00000100:00100000:2.0:1746126629.371205:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721490048:192.168.203.2@tcp:105: 00010000:00010000:2.0:1746126629.371224:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126629.371258:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e2c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721787008:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 2727us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.371268:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7482 00000100:00100000:0.0:1746126629.371479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.371700:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787136 00000100:00100000:1.0:1746126629.371706:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787136 00000100:00100000:1.0:1746126629.371738:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14285 00000100:00100000:1.0:1746126629.371745:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+16:31708:x1830945721787136:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1746126629.371762:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126629.371780:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009920f800/0xb50e82586761558e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee60 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.371805:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.371811:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.371813:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126629.371816:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009920f800/0xb50e82586761558e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee60 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.371866:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126629.371876:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746126629.371886:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721490176:192.168.203.2@tcp:104: 00000100:00100000:1.0:1746126629.373361:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51d2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746126629.374233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1746126629.374321:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17475:1830945721490176:192.168.203.2@tcp:104: 00010000:00010000:1.0:1746126629.374345:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009920f800/0xb50e82586761558e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee60 expref: 17 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126629.374361:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009920f800, rc 0) 00000100:00100000:1.0:1746126629.374395:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+17:31708:x1830945721787136:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2650us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126629.374403:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14285 00000100:00100000:3.0:1746126629.374737:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787264 00000100:00100000:3.0:1746126629.374743:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787264 00010000:00010000:3.0:1746126629.374771:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.374802:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7483 00000100:00100000:3.0:1746126629.374808:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+17:1964:x1830945721787264:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126629.374819:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126629.374863:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.374874:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.374896:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd11c00/0xb50e825867615517 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee36 expref: 17 pid: 4641 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.374923:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.374925:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.374931:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009920f800/0xb50e82586761558e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee60 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.374938:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009920f800/0xb50e82586761558e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee60 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.374966:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009920f800/0xb50e82586761558e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee60 expref: 16 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.374984:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721490304:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126629.375043:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126629.377327:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7074:1830945721490304:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126629.377349:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126629.377860:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+16:1964:x1830945721787264:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3014us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.377871:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7483 00000100:00100000:2.0:1746126629.378142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.378260:0:17475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787392 00000100:00100000:0.0:1746126629.378267:0:17475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787392 00000100:00100000:0.0:1746126629.378299:0:17475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14286 00000100:00100000:0.0:1746126629.378305:0:17475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+20:31708:x1830945721787392:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1746126629.378323:0:17475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126629.378340:0:17475:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867615595 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee67 expref: -99 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.378366:0:17475:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126629.378373:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.378375:0:17475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126629.378378:0:17475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867615595 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee67 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.378404:0:17475:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126629.378416:0:17475:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746126629.378427:0:17475:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721490432:192.168.203.2@tcp:104: 00000100:00100000:0.0:1746126629.378492:0:17475:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093ae6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126629.382112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.382187:0:17475:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17475:1830945721490432:192.168.203.2@tcp:104: 00010000:00010000:0.0:1746126629.382218:0:17475:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867615595 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee67 expref: 21 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126629.382233:0:17475:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099078600, rc 0) 00000100:00100000:0.0:1746126629.382281:0:17475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27c713d7-92e0-4974-b612-500c641c1d6c+21:31708:x1830945721787392:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3975us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126629.382291:0:17475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14286 00000100:00100000:3.0:1746126629.382865:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787520 00000100:00100000:3.0:1746126629.382871:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787520 00010000:00010000:3.0:1746126629.382897:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746126629.382931:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7484 00000100:00100000:3.0:1746126629.382938:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+21:1963:x1830945721787520:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126629.382952:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126629.382973:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.382993:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.383015:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a02a00/0xb50e82586761552c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee3d expref: 21 pid: 8438 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746126629.383037:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.383039:0:7074:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126629.383047:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867615595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee67 expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.383055:0:7074:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867615595 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee67 expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.383083:0:7074:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099078600/0xb50e825867615595 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee67 expref: 20 pid: 17475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126629.383095:0:7074:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721490560:192.168.203.2@tcp:105: 00000100:00100000:3.0:1746126629.383159:0:7074:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126629.386445:0:7074:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7074:1830945721490560:192.168.203.2@tcp:105: 00010000:00010000:3.0:1746126629.386468:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126629.386853:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+20:1963:x1830945721787520:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3885us (4720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.386864:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7484 00000100:00100000:0.0:1746126629.387013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.387113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.387138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.387152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.387164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.387184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1746126629.387202:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787776 00000100:00100000:0.0:1746126629.387208:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787776 00000100:00100000:0.0:1746126629.387234:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721788032 00000100:00100000:0.0:1746126629.387236:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721788032 00000100:00100000:0.0:1746126629.387253:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721788288 00000100:00100000:0.0:1746126629.387255:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721788288 00000100:00100000:0.0:1746126629.387266:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787648 00000100:00100000:0.0:1746126629.387267:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787648 00000100:00100000:0.0:1746126629.387276:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721787904 00000100:00100000:0.0:1746126629.387278:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721787904 00000100:00100000:0.0:1746126629.387288:0:10890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721788160 00000100:00100000:0.0:1746126629.387290:0:10890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721788160 00000100:00100000:0.0:1746126629.387299:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14287 00000100:00100000:0.0:1746126629.387304:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721787776:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126629.387507:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126629.387510:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:0.0:1746126629.387512:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:0.0:1746126629.387514:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126627 -> 1746126629 00002000:00010000:0.0:1746126629.387516:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126629.387541:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721787776:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 236us (529us total) trans 17179873342 rc 0/0 00000100:00100000:0.0:1746126629.387551:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14287 00000100:00100000:0.0:1746126629.387563:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14288 00000100:00100000:0.0:1746126629.387568:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721788032:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126629.387668:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126629.387670:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126626 -> 1746126627 00002000:00010000:0.0:1746126629.387672:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126618 -> 1746126627 00002000:00010000:0.0:1746126629.387674:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126626 -> 1746126629 00002000:00010000:0.0:1746126629.387676:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126629.387693:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721788032:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 125us (580us total) trans 21474840484 rc 0/0 00000100:00100000:0.0:1746126629.387699:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14288 00000100:00100000:0.0:1746126629.387708:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14289 00000100:00100000:0.0:1746126629.387714:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721788288:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126629.387777:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126629.387780:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:0.0:1746126629.387781:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126626 -> 1746126627 00002000:00010000:0.0:1746126629.387783:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126627 -> 1746126629 00002000:00010000:0.0:1746126629.387785:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126629.387801:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721788288:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 87us (662us total) trans 17179873343 rc 0/0 00000100:00100000:0.0:1746126629.387805:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14289 00000100:00100000:0.0:1746126629.387814:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14290 00000100:00100000:0.0:1746126629.387819:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721787648:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126629.387905:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746126629.387907:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126623 -> 1746126627 00002000:00010000:0.0:1746126629.387909:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126621 -> 1746126627 00002000:00010000:0.0:1746126629.387911:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126623 -> 1746126629 00002000:00010000:0.0:1746126629.387913:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:0.0:1746126629.387929:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721787648:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 110us (776us total) trans 21474840485 rc 0/0 00000100:00100000:0.0:1746126629.387934:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14290 00000100:00100000:0.0:1746126629.387943:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14291 00000100:00100000:0.0:1746126629.387947:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+22:1964:x1830945721787904:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126629.388018:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126629.388020:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126626 -> 1746126627 00002000:00010000:0.0:1746126629.388021:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126624 -> 1746126627 00002000:00010000:0.0:1746126629.388023:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126626 -> 1746126629 00002000:00010000:0.0:1746126629.388025:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746126629.388040:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+23:1964:x1830945721787904:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 93us (874us total) trans 17179873344 rc 0/0 00000100:00100000:0.0:1746126629.388045:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14291 00000100:00100000:0.0:1746126629.388054:0:10890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14292 00000100:00100000:0.0:1746126629.388059:0:10890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+18:1964:x1830945721788160:12345-192.168.203.2@tcp:2:lfs.0 00002000:00010000:0.0:1746126629.388115:0:10890:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:0.0:1746126629.388117:0:10890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:0.0:1746126629.388119:0:10890:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126626 -> 1746126627 00002000:00010000:0.0:1746126629.388120:0:10890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126627 -> 1746126629 00002000:00010000:0.0:1746126629.388122:0:10890:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:0.0:1746126629.388138:0:10890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27c713d7-92e0-4974-b612-500c641c1d6c+19:1964:x1830945721788160:12345-192.168.203.2@tcp:2:lfs.0 Request processed in 78us (952us total) trans 21474840486 rc 0/0 00000100:00100000:0.0:1746126629.388143:0:10890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14292 00000100:00100000:0.0:1746126629.390220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.391901:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721788544 00000100:00100000:2.0:1746126629.391914:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721788544 00000100:00100000:2.0:1746126629.392538:0:20362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9103 00000100:00100000:2.0:1746126629.392548:0:20362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:31708:x1830945721788544:12345-192.168.203.2@tcp:55:lfs.0 00010000:00010000:2.0:1746126629.392615:0:20362:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392630:0:20362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392640:0:20362:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392662:0:20362:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392667:0:20362:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392673:0:20362:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392679:0:20362:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebbb800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126629.392682:0:20362:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392688:0:20362:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392698:0:20362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126629.392701:0:20362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1746126629.392706:0:20362:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00010000:00010000:2.0:1746126629.392710:0:20362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ebbb800/0xb50e82586761559c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20362 initiator: MDT0 00000100:00100000:2.0:1746126629.393706:0:20362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27c713d7-92e0-4974-b612-500c641c1d6c+223:31708:x1830945721788544:12345-192.168.203.2@tcp:55:lfs.0 Request processed in 1155us (3488us total) trans 0 rc -22/-22 00000100:00100000:2.0:1746126629.393714:0:20362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9103 00000100:00100000:1.0:1746126629.396573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.396895:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721788800 00000100:00100000:3.0:1746126629.396904:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721788800 00000100:00100000:3.0:1746126629.396950:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3881 00000100:00100000:3.0:1746126629.396957:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+223:31708:x1830945721788800:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:3.0:1746126629.397021:0:14550:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2a7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44800/0xb50e8258676154b5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee05 expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.397069:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746126629.397080:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.397088:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746126629.397118:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 223 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.397129:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 223 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746126629.397141:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14550:1830945721490688:192.168.203.2@tcp:104: 00000100:00100000:3.0:1746126629.397229:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800920843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126629.399749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.399877:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14550:1830945721490688:192.168.203.2@tcp:104: 00010000:00010000:3.0:1746126629.399902:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:2.0:1746126629.400060:0:7074:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721788928 00000100:00100000:2.0:1746126629.400066:0:7074:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721788928 00010000:00010000:2.0:1746126629.400093:0:7074:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 224 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746126629.400116:0:7074:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7485 00000100:00100000:2.0:1746126629.400123:0:7074:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+224:1964:x1830945721788928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126629.400137:0:7074:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126629.400142:0:7074:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 224 pid: 14548 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746126629.400152:0:7074:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 224 pid: 14548 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746126629.400173:0:7074:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e67400/0xb50e8258676154f4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee0c expref: 224 pid: 14548 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746126629.400199:0:7074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126629.400203:0:7074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.400214:0:7074:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.400220:0:7074:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.400235:0:7074:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126629.400280:0:7074:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27c713d7-92e0-4974-b612-500c641c1d6c+223:1964:x1830945721788928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 157us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126629.400286:0:7074:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7485 00010000:00010000:3.0:1746126629.400496:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746126629.400503:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000040:00080000:3.0:1746126629.401228:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2733, 88 off232368 00000004:00080000:3.0:1746126629.401234:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751315406655ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.401280:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2859, 88 off243552 00000004:00080000:3.0:1746126629.401284:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751315456627ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402236:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2860, 88 off243640 00000004:00080000:3.0:1746126629.402241:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751316413630ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402775:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2734, 88 off232456 00000004:00080000:3.0:1746126629.402780:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751316952418ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.402802:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2735, 88 off232544 00000004:00080000:3.0:1746126629.402806:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751316978242ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.402813:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2861, 88 off243728 00000004:00080000:3.0:1746126629.402815:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751316988032ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402821:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2862, 88 off243816 00000004:00080000:3.0:1746126629.402844:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751317016335ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402854:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2736, 88 off232632 00000004:00080000:3.0:1746126629.402857:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751317029860ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.402864:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2863, 88 off243904 00000004:00080000:3.0:1746126629.402866:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751317038690ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402872:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2737, 88 off232720 00000004:00080000:3.0:1746126629.402875:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751317047572ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.402881:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2864, 88 off243992 00000004:00080000:3.0:1746126629.402883:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751317055898ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402889:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2738, 88 off232808 00000004:00080000:3.0:1746126629.402893:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751317065415ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.402899:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2865, 88 off244080 00000004:00080000:3.0:1746126629.402902:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751317074302ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402908:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2739, 88 off232896 00000004:00080000:3.0:1746126629.402910:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751317082962ns, next at 687927188999ns, rc = 0 00000040:00080000:3.0:1746126629.402917:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2866, 88 off244168 00000004:00080000:3.0:1746126629.402919:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751317091470ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402925:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2867, 88 off244256 00000004:00080000:3.0:1746126629.402927:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751317099578ns, next at 687959345514ns, rc = 0 00000040:00080000:3.0:1746126629.402933:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2740, 88 off232984 00000004:00080000:3.0:1746126629.402936:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751317108348ns, next at 687927188999ns, rc = 0 00000001:00080000:0.0:1746126629.432721:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943310 is committed 00000001:00080000:0.0:1746126629.432733:0:14617:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943311 is committed 00000004:00080000:0.0:1746126629.432738:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2124 committed 00000004:00080000:0.0:1746126629.432744:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2248 committed 00000004:00080000:0.0:1746126629.432750:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2247 committed 00000004:00080000:0.0:1746126629.432752:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2123 committed 00000004:00080000:0.0:1746126629.432753:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2246 committed 00000004:00080000:0.0:1746126629.432755:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2122 committed 00000004:00080000:0.0:1746126629.432756:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2245 committed 00000004:00080000:0.0:1746126629.432758:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2121 committed 00000004:00080000:0.0:1746126629.432759:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2244 committed 00000004:00080000:0.0:1746126629.432761:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2120 committed 00000004:00080000:0.0:1746126629.432762:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2243 committed 00000004:00080000:0.0:1746126629.432764:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2242 committed 00000004:00080000:0.0:1746126629.432765:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2119 committed 00000004:00080000:0.0:1746126629.432766:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2118 committed 00000004:00080000:0.0:1746126629.432768:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2241 committed 00000004:00080000:0.0:1746126629.432769:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2240 committed 00000004:00080000:0.0:1746126629.432771:0:14617:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2117 committed 00000100:00100000:0.0:1746126629.432955:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433023:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126629.433069:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433085:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126629.433105:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126629.433109:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433124:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126629.433135:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433147:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126629.433169:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491072 00000100:00100000:0.0:1746126629.433176:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491072 00000100:00100000:0.0:1746126629.433210:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491584 00000100:00100000:0.0:1746126629.433212:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491584 00000100:00100000:0.0:1746126629.433224:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491200 00000100:00100000:0.0:1746126629.433226:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491200 00000100:00100000:0.0:1746126629.433234:0:23766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491712 00000100:00100000:0.0:1746126629.433236:0:23766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491712 00000100:00100000:0.0:1746126629.433248:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14293 00000100:00100000:0.0:1746126629.433254:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3296:x1830945721491072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126629.433431:0:23766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126629.433434:0:23766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:0.0:1746126629.433436:0:23766:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:0.0:1746126629.433437:0:23766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb ctime from disk: 1746126629 -> 1746126629 00002000:00010000:0.0:1746126629.433439:0:23766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x325:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746126629.433470:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721491072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (447us total) trans 17179873345 rc 0/0 00000100:00100000:0.0:1746126629.433476:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14293 00000100:00100000:0.0:1746126629.433491:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14294 00000100:00100000:0.0:1746126629.433495:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3296:x1830945721491584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433562:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721491584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (475us total) trans 17179873346 rc 0/0 00000100:00100000:0.0:1746126629.433567:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14294 00000100:00100000:0.0:1746126629.433575:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14295 00000100:00100000:0.0:1746126629.433578:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3296:x1830945721491200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433642:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721491200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (517us total) trans 17179873347 rc 0/0 00000100:00100000:0.0:1746126629.433646:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14295 00000100:00100000:0.0:1746126629.433653:0:23766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14296 00000100:00100000:0.0:1746126629.433656:0:23766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3296:x1830945721491712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126629.433708:0:23766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3296:x1830945721491712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (560us total) trans 17179873348 rc 0/0 00000100:00100000:0.0:1746126629.433713:0:23766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14296 00000004:00080000:0.0:1746126629.433749:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d6300/2, rc 0, transno 17179873347 00000100:00100000:0.0:1746126629.433756:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126629.433763:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d5180/2, rc 0, transno 17179873348 00000100:00100000:0.0:1746126629.433766:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126629.433771:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d7480/2, rc 0, transno 17179873345 00000100:00100000:0.0:1746126629.433774:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126629.433779:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d7100/2, rc 0, transno 17179873346 00000100:00100000:0.0:1746126629.433782:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721491584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.433920:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721490944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.433944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.433964:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.433990:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434002:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434018:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434032:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721492480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434059:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:2.0:1746126629.434063:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721490816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.434077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434086:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.434098:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434109:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.434119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434129:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721492352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434143:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434152:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721492864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434176:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434191:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434198:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434229:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434240:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746126629.434243:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434256:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434262:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008dad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434273:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746126629.434288:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721490944 00000100:00100000:2.0:1746126629.434291:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721490944 00000100:00100000:2.0:1746126629.434305:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491456 00000100:00100000:2.0:1746126629.434306:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491456 00000100:00100000:2.0:1746126629.434312:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491968 00000100:00100000:2.0:1746126629.434314:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491968 00000100:00100000:2.0:1746126629.434320:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492480 00000100:00100000:2.0:1746126629.434321:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492480 00000100:00100000:2.0:1746126629.434326:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721490816 00000100:00100000:2.0:1746126629.434328:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721490816 00000100:00100000:2.0:1746126629.434333:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491328 00000100:00100000:2.0:1746126629.434335:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491328 00000100:00100000:2.0:1746126629.434340:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721491840 00000100:00100000:2.0:1746126629.434341:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721491840 00000100:00100000:2.0:1746126629.434346:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492352 00000100:00100000:2.0:1746126629.434348:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492352 00000100:00100000:2.0:1746126629.434353:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492864 00000100:00100000:2.0:1746126629.434354:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492864 00000100:00100000:2.0:1746126629.434359:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492224 00000100:00100000:2.0:1746126629.434360:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492224 00000100:00100000:2.0:1746126629.434365:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492736 00000100:00100000:2.0:1746126629.434366:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492736 00000100:00100000:2.0:1746126629.434370:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492096 00000100:00100000:2.0:1746126629.434372:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492096 00000100:00100000:2.0:1746126629.434376:0:4640:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492608 00000100:00100000:2.0:1746126629.434377:0:4640:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492608 00000100:00100000:2.0:1746126629.434384:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14297 00000100:00100000:2.0:1746126629.434388:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830945721490944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126629.434468:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126629.434470:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.434472:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.434474:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb ctime from disk: 1746126629 -> 1746126629 00002000:00010000:2.0:1746126629.434476:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x323:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746126629.434496:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721490944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (551us total) trans 17179873349 rc 0/0 00000100:00100000:2.0:1746126629.434501:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14297 00000100:00100000:2.0:1746126629.434510:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14298 00000100:00100000:2.0:1746126629.434514:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830945721491456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.434582:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721491456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (590us total) trans 17179873350 rc 0/0 00000100:00100000:2.0:1746126629.434587:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14298 00000100:00100000:2.0:1746126629.434595:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14299 00000100:00100000:2.0:1746126629.434599:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721491968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126629.434693:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746126629.434696:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.434697:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.434699:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb ctime from disk: 1746126629 -> 1746126629 00002000:00010000:2.0:1746126629.434700:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31d:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:2.0:1746126629.434718:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721491968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (699us total) trans 21474840487 rc 0/0 00000100:00100000:2.0:1746126629.434723:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14299 00000100:00100000:2.0:1746126629.434732:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14300 00000100:00100000:2.0:1746126629.434735:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721492480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.434809:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721492480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (762us total) trans 21474840488 rc 0/0 00000100:00100000:2.0:1746126629.434814:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14300 00000100:00100000:2.0:1746126629.434822:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14301 00000100:00100000:2.0:1746126629.434862:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830945721490816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746126629.434928:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126629.434930:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.434932:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.434933:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb ctime from disk: 1746126629 -> 1746126629 00002000:00010000:2.0:1746126629.434935:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x322:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746126629.434953:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721490816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (874us total) trans 17179873351 rc 0/0 00000100:00100000:2.0:1746126629.434958:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14301 00000100:00100000:2.0:1746126629.434968:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14302 00000100:00100000:2.0:1746126629.434971:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830945721491328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.435064:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721491328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (964us total) trans 17179873352 rc 0/0 00000100:00100000:2.0:1746126629.435070:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14302 00000100:00100000:2.0:1746126629.435079:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14303 00000100:00100000:2.0:1746126629.435083:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830945721491840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746126629.435154:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721491840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1032us total) trans 17179873353 rc 0/0 00000100:00100000:2.0:1746126629.435158:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14303 00000100:00100000:2.0:1746126629.435167:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14304 00000100:00100000:2.0:1746126629.435172:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721492352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.435250:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721492352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1105us total) trans 21474840489 rc 0/0 00000100:00100000:2.0:1746126629.435255:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14304 00000100:00100000:2.0:1746126629.435367:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14305 00000100:00100000:2.0:1746126629.435372:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830945721492864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.435442:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830945721492864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1277us total) trans 21474840490 rc 0/0 00000100:00100000:2.0:1746126629.435447:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14305 00000100:00100000:2.0:1746126629.435456:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14306 00000100:00100000:2.0:1746126629.435460:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721492224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126629.435526:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb size from disk: 4976480 -> 4976480 00002000:00010000:2.0:1746126629.435529:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.435530:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.435532:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb ctime from disk: 1746126629 -> 1746126629 00002000:00010000:2.0:1746126629.435534:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x321:0x0] updating lvb blocks from disk: 5695 -> 5695 00000100:00100000:2.0:1746126629.435557:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721492224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1365us total) trans 21474840491 rc 0/0 00000100:00100000:2.0:1746126629.435562:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14306 00000100:00100000:2.0:1746126629.435571:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14307 00000100:00100000:2.0:1746126629.435576:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721492736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.435652:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721492736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (1422us total) trans 21474840492 rc 0/0 00000100:00100000:2.0:1746126629.435658:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14307 00000100:00100000:2.0:1746126629.435667:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14308 00000100:00100000:2.0:1746126629.435671:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721492096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746126629.435734:0:4640:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746126629.435736:0:4640:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb mtime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.435738:0:4640:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb atime from disk: 1746126627 -> 1746126627 00002000:00010000:2.0:1746126629.435740:0:4640:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb ctime from disk: 1746126629 -> 1746126629 00002000:00010000:2.0:1746126629.435742:0:4640:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x31f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746126629.435760:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721492096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1502us total) trans 21474840493 rc 0/0 00000100:00100000:2.0:1746126629.435764:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14308 00000100:00100000:2.0:1746126629.435773:0:4640:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14309 00000100:00100000:2.0:1746126629.435777:0:4640:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3297:x1830945721492608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746126629.435867:0:4640:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830945721492608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1593us total) trans 21474840494 rc 0/0 00000100:00100000:2.0:1746126629.435872:0:4640:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14309 00000004:00080000:2.0:1746126629.435917:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad1500/2, rc 0, transno 21474840493 00000100:00100000:2.0:1746126629.435922:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.435930:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad0a80/2, rc 0, transno 21474840494 00000100:00100000:2.0:1746126629.435933:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.435938:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad2680/2, rc 0, transno 21474840491 00000100:00100000:2.0:1746126629.435940:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492224:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.435945:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad0380/2, rc 0, transno 21474840492 00000100:00100000:2.0:1746126629.435947:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1830945721492736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.435969:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d6a00/2, rc 0, transno 17179873351 00000100:00100000:2.0:1746126629.435972:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721490816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.435991:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d4a80/2, rc 0, transno 17179873352 00000100:00100000:2.0:1746126629.435994:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.436002:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d5c00/2, rc 0, transno 17179873353 00000100:00100000:2.0:1746126629.436007:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.436013:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad2a00/2, rc 0, transno 21474840489 00000100:00100000:2.0:1746126629.436015:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721492352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.436022:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dab8380/2, rc 0, transno 21474840490 00000100:00100000:2.0:1746126629.436024:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721492864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.436031:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d7b80/2, rc 0, transno 17179873349 00000100:00100000:2.0:1746126629.436034:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721490944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.436040:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9d5500/2, rc 0, transno 17179873350 00000100:00100000:2.0:1746126629.436042:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746126629.436048:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad3b80/2, rc 0, transno 21474840487 00000100:00100000:2.0:1746126629.436050:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721491968:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746126629.436055:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008dad3100/2, rc 0, transno 21474840488 00000100:00100000:2.0:1746126629.436058:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008dad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721492480:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746126629.436294:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800937baa00 reply state ffff88012db06400 transno 8589943311 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746126629.436305:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746126629.436316:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:3.0:1746126629.436319:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126629.436326:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44800/0xb50e8258676154b5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2a7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee05 expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746126629.436411:0:14550:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746126629.436421:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+221:31708:x1830945721788800:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 39464us (39857us total) trans 8589943311 rc 0/0 00000100:00100000:3.0:1746126629.436429:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3881 00010000:00010000:2.0:1746126629.436745:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.436753:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.436760:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.436765:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace44c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746126629.436768:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.436775:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.436787:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff8800922c3e00) 00010000:00010000:2.0:1746126629.436789:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126629.436792:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746126629.436796:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace44c00/0xb50e8258676155a3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746126629.438408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1746126629.438502:0:20362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721789056 00000100:00100000:2.0:1746126629.438510:0:20362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721789056 00000100:00100000:3.0:1746126629.440645:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9104 00000100:00100000:3.0:1746126629.440661:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+220:31708:x1830945721789056:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1746126629.440687:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126629.440709:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb3b800/0xb50e8258676155aa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ab808939ee4ee6e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.440772:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb3b800/0xb50e8258676155aa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee6e expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.440786:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb3b800/0xb50e8258676155aa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2a7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0x3ab808939ee4ee6e expref: 221 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126629.440803:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2a7:0x0].0x0 (ffff880136a9f600) 00010000:00010000:3.0:1746126629.440805:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126629.440808:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb3b800, rc 0) 00000100:00100000:3.0:1746126629.440891:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27c713d7-92e0-4974-b612-500c641c1d6c+221:31708:x1830945721789056:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 236us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126629.440897:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9104 00000100:00100000:0.0:1746126629.443502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1746126629.444476:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721789312 00000100:00100000:3.0:1746126629.444486:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721789312 00000100:00100000:3.0:1746126629.444531:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3882 00000100:00100000:3.0:1746126629.444539:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+221:31708:x1830945721789312:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1746126629.444790:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27c713d7-92e0-4974-b612-500c641c1d6c+222:31708:x1830945721789312:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 250us (1293us total) trans 8589943312 rc 0/0 00000100:00100000:3.0:1746126629.444796:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3882 00010000:00010000:1.0:1746126629.873173:0:8452:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746126630.135412:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1830945721493120:0@lo:400:kworker.0 00000100:00100000:3.0:1746126630.135417:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721493376:0@lo:400:kworker.0 00000100:00100000:2.0:1746126630.135643:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2fb79569-8691-41f9-a471-439cf21ba3b2:3295:1830945721492992:0@lo:400:kworker.0 00000100:00100000:1.0:1746126630.136633:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126630.136676:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830945721493632:0@lo:400:kworker.0 00000100:00100000:1.0:1746126630.136691:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126630.136707:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126630.136711:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721493248:0@lo:400:kworker.0 00000100:00100000:1.0:1746126630.136724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126630.137282:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493120 00000100:00100000:0.0:1746126630.137290:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493120 00000100:00100000:0.0:1746126630.137334:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493632 00000100:00100000:0.0:1746126630.137336:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493632 00000100:00100000:0.0:1746126630.137349:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493248 00000100:00100000:0.0:1746126630.137351:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493248 00000100:00100000:0.0:1746126630.137365:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1746126630.137371:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830945721493120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126630.137424:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830945721493120:12345-0@lo:400:kworker.0 Request processed in 52us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126630.137430:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1746126630.137445:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746126630.137449:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830945721493632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126630.137469:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830945721493632:12345-0@lo:400:kworker.0 Request processed in 20us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126630.137474:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746126630.137481:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1746126630.137484:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126630.137501:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830945721493248:12345-0@lo:400:kworker.0 Request processed in 17us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126630.137505:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:0.0:1746126630.137518:0:7083:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126630.137968:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1830945721493248:0@lo:400:kworker.0 00000100:00100000:1.0:1746126630.137991:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1830945721493120:0@lo:400:kworker.0 00000100:00100000:1.0:1746126630.138010:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830945721493632:0@lo:400:kworker.0 00000100:00100000:2.0:1746126630.138011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126630.138215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126630.138259:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493376 00000100:00100000:3.0:1746126630.138262:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493376 00000100:00100000:3.0:1746126630.138290:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1746126630.138295:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126630.138331:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3294:x1830945721493376:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126630.138335:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1746126630.138581:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721492992 00000100:00100000:3.0:1746126630.138584:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721492992 00000100:00100000:3.0:1746126630.138601:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746126630.138605:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3295:x1830945721492992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126630.138628:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2fb79569-8691-41f9-a471-439cf21ba3b2+18:3295:x1830945721492992:12345-0@lo:400:kworker.0 Request processed in 23us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126630.138633:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746126630.145661:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2fb79569-8691-41f9-a471-439cf21ba3b2:3295:1830945721492992:0@lo:400:kworker.0 00000100:00100000:3.0:1746126630.145678:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721493504:0@lo:400:kworker.0 00000100:00100000:3.0:1746126630.145735:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126630.145792:0:9686:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493504 00000100:00100000:3.0:1746126630.145798:0:9686:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493504 00000100:00100000:3.0:1746126630.145861:0:9686:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1746126630.145868:0:9686:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721493504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126630.145913:0:9686:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721493504:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126630.145919:0:9686:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1746126630.145948:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721493504:0@lo:400:kworker.0 00000100:00100000:2.0:1746126630.145993:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1830945721493376:0@lo:400:kworker.0 00000100:00100000:1.0:1746126630.164946:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746126630.164966:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721493760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746126630.165035:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126630.165081:0:10577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493760 00000100:00100000:1.0:1746126630.165088:0:10577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493760 00000100:00100000:1.0:1746126630.165124:0:10577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1746126630.165130:0:10577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721493760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746126630.165165:0:10577:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 399179776 pending 3407872 free 3847225344 avail 3845128192 00000100:00100000:1.0:1746126630.165197:0:10577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830945721493760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126630.165204:0:10577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1746126630.165237:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1830945721493760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746126630.165966:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746126630.165986:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721493888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746126630.166013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126630.166040:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945721493888 00000100:00100000:3.0:1746126630.166043:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945721493888 00000100:00100000:3.0:1746126630.166062:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1746126630.166066:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721493888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746126630.166088:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 424607744 pending 1703936 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746126630.166113:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3295:x1830945721493888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126630.166118:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1746126630.166143:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1830945721493888:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1746126630.420385:0:3410:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:1.0:1746126630.878230:0:10996:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69883 lines, 69883 kept, 0 dropped, 0 bad.